a58913d975
Bug 1300697 - Add test for New York Times website
7 years ago
ad13a63065
Bug 1332236 - Add tests for cnet.com, r=Gijs
7 years ago
131d923d38
Bug 1167568 - Find a better topCandidate if there are other nodes scores are high enough, r=Gijs
7 years ago
5e9c7a3910
Bug 1322327 - Only remove images which are not descendants of a figure if there is more than one image, update affected tests
8 years ago
c5ff44d8fe
Clean <input>,<textarea>,<select>,<button> elements
8 years ago
a34d054f45
Merge pull request #332 from gijsk/fix-readability-determination-in-generate-testcase
...
Use jsdom for parsing the document to determine readability (fixes #325 ), r=evanxd
8 years ago
63230a307a
Bug 1142312 - Add two more types of unlikely candidates: cover-wrap and yom-remote, r=Gijs
8 years ago
46842048c1
Use jsdom for parsing the document to determine readability ( fixes #325 )
8 years ago
0ab4ac8556
Fix test failures caused by timeout still being too low
8 years ago
e84c0c3f07
Bug 1285543 - Only use "og:title" or "twitter:title" if _getArticleTitle does not return a valid title, r=Gijs
8 years ago
c2f7db51f5
Remove textContent from metadata file ( fixes #324 ) ( #326 )
8 years ago
33dc8fa023
Bug 1255978 - Remove legends candidate, r=Gijs
8 years ago
af0aa5c59f
Bug 1173548 - Find out text direction from ancestors of final candidate, r=Gijs
8 years ago
ece0d1ecea
Bug 1317930 - Tests for msn.com, r=Gijs
8 years ago
1b694cf650
Bug 1310075 - Tests for qq.com. r=Gijs
8 years ago
522f39617f
Bug 1310074 - Tests for yahoo.com. r=Gijs
8 years ago
4fa0d1b207
Bug 1177619 - Score div nodes which have br nodes. r=Gijs
8 years ago
8bfd2a978d
Bug 1310073 - Tests for wikipedia.org. r=Gijs
8 years ago
1a12befa41
Fix code style, tighten up eslint rules ( #301 )
8 years ago
46b08a5ea5
Address issue #277 by marking 'modal' unlikely+negative
8 years ago
a4d1e9ca12
Fix oversight in comment removal code exposed by better/newer jsdom implementation
8 years ago
e830ac9dd8
Fix eslint issues identified in m-c
8 years ago
dffa760c04
Fix issue #267 by ignoring hash URIs when making URIs absolute
8 years ago
f87a12400b
Reuse test from pull request #239 which passes without modifications (modified by @gijsk to pass in the current XHTML test environment)
8 years ago
2e1cb3f467
Fix issue #251 by making JSDOMParser expect XML and stop making excuses for 'self-closed' things, when all that does is cause trouble
8 years ago
a801846a45
Merge pull request #204 from mozilla/tweak-great-grandparent-scoring
...
Updated great grandparent node scoring.
9 years ago
ae0833522c
Improved embedded video elements detection.
9 years ago
46304bb5fe
Updated great grandparent node scoring.
9 years ago
88ef3893b5
Fixes #180 - Score intermediary headings.
9 years ago
dc1b2c9fa0
Refs #195 - Exclude nodes likely to be related content.
9 years ago
cc18cb5787
Ref #195 - Add support for dailymotion videos.
9 years ago
9dbc009376
Fixes #113 - Recursive node ancestor scoring.
9 years ago
44879722b6
Fixes #183 - Preserve list items.
9 years ago
5912e0c872
Add Firefox User-Agent when generating the test case.
9 years ago
79aa2fca87
Merge pull request #189 from mozilla/dont-remove-headings
...
Fixes #150 - Keep article intermediary headings.
9 years ago
af6da2a87d
Merge pull request #190 from mozilla/improved-author-meta-extraction
...
Improved author metadata detection.
9 years ago
7aee44adb2
Improved author metadata detection.
9 years ago
5f184053cd
Make isProbablyReaderable include <pre>, and deal with long <br>-separated paragraphs and/or shorter-than-5-paragraph text and such.
9 years ago
2451a07a7d
Fixes #150 - Keep article intermediary headings.
9 years ago
319a50b4f0
Fixes #184 - Don't strip class names from article content
9 years ago
49e40768aa
Merge pull request #185 from mozilla/score-section-tags-by-default
...
Fixes #139 #143 : Added more weight to section tags.
9 years ago
f6ffa6acde
Fixes #139 #143 : Added more weight to section tags.
9 years ago
58cd789cd3
Improved title extraction 'algorithm'.
9 years ago
de89036cd5
Fixes #130 - Using js-beautify for HTML formatting.
9 years ago
b37ff08bc7
Merge pull request #169 from mozilla/clean-footer-tags
...
Fixes #163 - Avoid including footer tag contents.
9 years ago
12c6a11f67
Fixes #163 - Avoid including footer tag contents.
9 years ago
6eeabf90c1
Fixes #164 - Add support for title alt semantic metadata.
9 years ago
0ff82de0f4
Implement createTextNode, do more relaxed escaping there, update testcase.
9 years ago
37a8cd4171
Bug 1147584 - Don't remove unlikely <a> tags, and replace <a> tags with their text content if they won't be useful links
9 years ago
a6014f5854
Merge pull request #132 from gijsk/heise-ad-prioritization
...
Don't look at banners and skyscrapers, remove <noscript> elements
9 years ago
a6346a0ad4
Don't look at banners and skyscrapers, remove <noscript> elements
9 years ago
4424b0bad7
Refs #128 - Add support for options to Readability constructor. r=@gijsk
9 years ago
c53ca31907
Fixed test result output being sent at once
9 years ago
4d41f5e4ed
Refs #117 - Drop social/share buttons.
9 years ago
d725ebc953
Fixes #99 : JSDOMParser tag name case handling. r=@gijsk
9 years ago
a04f9d9a68
Fix embedded video testcase to work with both jsdom and JSDOMParser
9 years ago
225adef137
Turn off JS when using JSDOM in tests.
9 years ago
b1f6c62b25
Fix tests for readability to also work with jsdom
...
For instance, jsdom's more spec-compliant parsing causes issues with auto-closing elements (lifehacker article) and with not having self-closing <img> and <br> tags. The former was fixed by removing offending markup, the latter by adjusting JSDOMParser to be more sane, and the expected outputs to cope with this.
Finally, JSDOMParser automatically drops comments. The test code needed to manually do this in the jsdom case.
9 years ago
62801faa0e
Fix JSDOMParser to do some HTML escaping and identify as JSDOMParser + add tests
9 years ago
3b636b59f0
Added readerable value to test pages metadata.
9 years ago
6b7834f798
add test for isProbablyReaderable
9 years ago
2bfa678cab
Added separate command for reference benchmark.
9 years ago
1e14d47bb7
Added benchmarks.
9 years ago
f2b04930c1
Merge pull request #87 from gijsk/script-parsing-should-deal-with-comments
...
Fix script parsing to ignore closing tags in comments
9 years ago
8ddba60425
Fix script parsing to ignore closing tags in comments
9 years ago
f8d37e4276
Don't remove elements containing figures or having them as a parent.
9 years ago
b6730703a1
Fixes #81 - Keep article images.
9 years ago
cdcbd94cd5
Add tests for the lifehacker page
9 years ago
194a5376c8
Merge pull request #63 from mozilla/preserve-embedded-tweets
...
Preserve inline tweets as they're part of article contents.
9 years ago
aeeabb7c79
Print exception stack when generating a test case fails.
9 years ago
14b33b69db
Merge pull request #65 from mozilla/support-embed-videos
...
Fixes #56 - Updated support for embedded Youtube & Vimeo videos.
9 years ago
ad52d8ee30
Fixes #53 - Fixed dot-slash relative URI resolution.
9 years ago
2d5f59f3eb
Fixes #56 - Updated support for embedded Youtube & Vimeo videos.
9 years ago
d83763c8a1
Preserve inline tweets as they're part of article contents.
9 years ago
cf3dce6cf2
Refs #58 - Stripped embed tags.
9 years ago
eee224560b
Addressed review comments from @Gijsk.
9 years ago
4f9615cb9a
Use forEach when it makes sense.
9 years ago
14afc21b96
Fix code to ignore titles when we already have one.
9 years ago
a924e31729
Add testcase for current Medium behaviour including SVG that desktop sees.
9 years ago
955951659d
Bug 1143725 - fix the Herald Sun website
9 years ago
f9e770ad3b
Write a bunch of tests for jsdomparser
9 years ago
d0df9d8479
Merge pull request #40 from leibovic/byline
...
Improve byline algorithm. r=Gijs
9 years ago
3c2d93cd09
Improve byline algorithm
9 years ago
f4670a1531
Better test docs.
9 years ago
df02218905
More detailed test reports.
9 years ago
2b09db3300
Improve logging for errors in test runs, add a way to run just some tests (using an env var because mocha doesn't support passing arguments)
9 years ago
639c878af5
Generate expected-metadata.json in generate-testcase.js
9 years ago
1b5d896b8b
Add expected-metadata.json for existing tests
9 years ago
6490d7205d
Update test to check metadata
9 years ago
5efddf6620
Update all the tests, add a bunch of random things so we have some base idea of what stuff we're breaking when changing things.
9 years ago
1c42f29aa5
Create a script to generate testcases, actually use our version of JSDOMParser
9 years ago
fac76c6c1a
Added support for readability log messages forwarding to node.
9 years ago
7da6e82fec
Switched to using jsdom for tests.
9 years ago
1d2df4a70e
Bug 1144441 - avoid leaving out paragraphs
9 years ago
03d9e36161
Merge pull request #22 from gijsk/fix-empty-classes
...
Don't create/leave empty class attributes around all the nodes we're using. r=margaret
9 years ago
99f338a03a
Added logging to test output.
9 years ago
b62fd27ba6
Don't create/leave empty class attributes around all the nodes we're using.
9 years ago
aebd13b12b
Bug 1127778 - fix Readability test suite to always use its own copy so travis build passes
9 years ago
3c277a1701
Bug 1127778 - fix paragraph reordering and add a test for it.
9 years ago
3bef3e7029
Added basic functional test + travis setup.
9 years ago
Evan Tseng
Sebastian Hengst
andrei-ch
Evan Tseng
Gijs Kruitbosch
Wes Johnston
Nicolas Perriault
Alexis Métaireau
Margaret Leibovic