You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
Go to file
Yuri Baburov 21906f1c44 Better setup.py, now we're "readability-lxml" in pypi. Thanks to Jerry Charumilind. 13 years ago
readability Sorted out unicode issues, thanks to Lee Semel. 13 years ago
.gitignore Better setup.py, now we're "readability-lxml" in pypi. Thanks to Jerry Charumilind. 13 years ago
README Added command-line usage 13 years ago
setup.py Better setup.py, now we're "readability-lxml" in pypi. Thanks to Jerry Charumilind. 13 years ago

README

This code is under the Apache License 2.0.  http://www.apache.org/licenses/LICENSE-2.0

This is a python port of a ruby port of arc90's readability project

http://lab.arc90.com/experiments/readability/

In few words,
Given a html document, it pulls out the main body text and cleans it up.
It also can clean up title based on latest readability.js code.

Based on:
 - Latest readability.js ( https://github.com/MHordecki/readability-redux/blob/master/readability/readability.js )
 - Ruby port by starrhorne and iterationlabs
 - Python port by gfxmonk ( https://github.com/gfxmonk/python-readability , based on BeautifulSoup )
 - Decruft effort to move to lxml ( http://www.minvolai.com/blog/decruft-arc90s-readability-in-python/ )

Usage:

import urllib
html = urllib.urlopen(url).read()
readable_article = Document(html).summary()
readable_title = Document(html).short_title()

Command-line usage:

python -m readability.readability -u http://yoursite.com/yourpage