Commit Graph

406 Commits (master)
 

Author SHA1 Message Date
Radhi Fadlillah 6a5066abe2 Fix tabular data got removed 5 years ago
PalmerAL f70d36852b check itemprop when determining whether a node is a byline 5 years ago
EvsChen b9f47bcc8d fix(test-util): fix generate testcase tool 5 years ago
Andres Rey d41de78c26 Close img tag 5 years ago
Andres Rey 1187b2dae1 Update test expectations 5 years ago
Andres Rey 3ca8c12d87 Update test expectations 5 years ago
Andres Rey f836a8f291 Add "gdpr" to the list of negative tags 5 years ago
Andres Rey 4ffd482004 Add medicalnewstoday test case with incorrect results 5 years ago
Taylor Buley c0c097c930 update JSDOM example for node 5 years ago
Gijs Kruitbosch 60ef565b67 Don't choke on <meta> tags that do not have a content attribute 5 years ago
Gijs 878545f64d
Make usage sections in README more discoverable
This just reorders some of the content and reduces duplication.
5 years ago
Gijs Kruitbosch 30f9670a5f Avoid setAttribute errors from invalid attributes, fixes #392 5 years ago
Gijs 15d411a865
Add comment to indicate duplicate regexes
This comment was added in mozilla-central and seems useful, adding it to keep m-c and github in sync.
5 years ago
Gijs Kruitbosch d8c837012b Fix benchmark script for script split and new JSDOM version 5 years ago
Gijs Kruitbosch 512e1c18a7 Update to latest JSDOM 5 years ago
Gijs Kruitbosch 977be42d1f Fix link normalization for live HTMLCollections
Newer versions of JSDOM implement getElementsByTagName correctly.
This means it returns a live node list. When calling
`Element.replaceChild` for links inside the loop over that
collection, elements disappear from the list, meaning we miss
every other item. Without this fix, the `clean-links` testcase
breaks.
5 years ago
Gijs Kruitbosch e8bb7f722f Fix whitespace normalization in title metadata
When switching to a newer version of JSDOM, it is more literal
about listing whitespace as part of textContent, including
newlines and not normalizing multiple spaces.

It seems prudent to just always normalize whitespace for titles,
which are guaranteed to be pretty short anyway.
5 years ago
Gijs Kruitbosch 3610476663 Remove CSS that jsdom struggles to parse 5 years ago
Gijs Kruitbosch 2620542dd1 Split off isProbablyReaderable implementation 5 years ago
Maria Luiza Soares 8c41d92560 Assert on siteName in all test cases 5 years ago
Maria Luiza Soares 1bac47c70d Add newly generated test case 5 years ago
Maria Luiza Soares 262fffd703 Retrieve site name on parse, based on meta og:site_name 5 years ago
Gijs 876c81f710 Update sorting function in Readability.js
Simplify sorting function also considering case where arguments are equal

Co-Authored-By: jemrobinson <james.em.robinson@gmail.com>
6 years ago
James Robinson ee18c21fc2 Switched sort function from boolean to explicit -1 and 1 thus avoiding failures to sort when false is evaluated as 0 6 years ago
Dan Burzo 44e90de00b Elements that have no .style (e.g. mathml) are probably visible; fixes #493 6 years ago
Hugo Locurcio 9fbe42683a Add .gitattributes file
This ignores HTML (test data) so the repository is considered
to use JavaScript instead of HTML on GitHub.
6 years ago
Daniel Aleksandersen 3be1aaa01c Recognize Sina Weibo meta tags
http://open.weibo.com/wiki/Weibo_meta_tag
6 years ago
Daniel Aleksandersen 5a69d4a8eb Improve metadata extraction (#478)
* Improve metadata extraction

* Recognize meta[property] as a space-separated list
* Recognize Dulin Core (dc|dcterm): metadata.
* Prefer Dublin Core, Open Graph, Twitter, and HTML in that order.
* _getArticleTitle() is now only used as fallback if document
 doesn't provide good metadata.
6 years ago
Daniel Aleksandersen 0449dbf186 Recognize more iframe video embed video services
* TenCent QQ Video, Alexa Rank 8
* Twitch clips and streams, Alexa Rank 33
* Internet Archive, Alexa Rank 265
* Wikimedia, Alexa Rank 347
6 years ago
Gijs Kruitbosch f782bc5f06 Avoid global flag when looking for metadata using regexes 6 years ago
Johann Hofmann 93a2f1b026
Merge pull request #471 from gijsk/moar-eslint
Add more eslint rules (fixes #457)
6 years ago
Gijs Kruitbosch 30611cc57f Fix quotes issues in test and benchmark files 6 years ago
Gijs Kruitbosch f511d1aa2b Enable eslint checks for quotes and single-line loops/conditionals 6 years ago
Gijs Kruitbosch 7cf95bd427 Fix same-line loops and if statements 6 years ago
Gijs Kruitbosch d9f7bb2965 Fix quotes 6 years ago
Gijs Kruitbosch 7d03bec52d Fix issues with finding nytimes content caused by in-article ads 6 years ago
tmm2018 076bf2017b [docs] - mozilla/readibility - README.md - fixing tiny little issues (grammar, rethorics, spelling, etc.) (#462)
* [docs] - mozilla/readibility - README.md - add articles to the description of the properties of the Readability output
6 years ago
Gijs 4b193ccd6a
Include URI information for `jsdom` in the README.
See #453 for an example of where this led to confusion.
6 years ago
Gijs Kruitbosch 8fec62d246 Strip XML namespaces from tag names to deal with broken serializations 6 years ago
Gijs Kruitbosch 8e92a1fa19 Reuse textNode variable for CDATA blocks, too 6 years ago
David A Roberts ea4165721f Remove single-cell tables 6 years ago
David A Roberts bf64b58d90 Update tests 6 years ago
David A Roberts 72bd1a8532 Don't nest paragraphs 6 years ago
David A Roberts 68c9af4ffa Use numeric encoding for non-XML entities
JSDOMParser can't handle HTML named entities like `&nbsp;`
6 years ago
David A Roberts 611e9e3a6f JSDOMParser: handle CDATA sections 6 years ago
David A Roberts afcc4b8e49 Fix titles not being trimmed sometimes 6 years ago
Gijs Kruitbosch d4b842c82a Match headings on trimmed strings to avoid whitespace causing mismatches 6 years ago
Gijs Kruitbosch 8c02a0d34c Fix #283 and remove hidden nodes 6 years ago
David A Roberts 656a6673d9 Don't put non-phrasing content into paragraphs 6 years ago
David A Roberts 5ae90930cd Don't convert DIVs to Ps when more than 25% links 6 years ago