Commit Graph

179 Commits (f33a6c2a2309077bdb8d8fff60eb8dc22d50cb5f)

Author SHA1 Message Date
Gijs Kruitbosch e830ac9dd8 Fix eslint issues identified in m-c 8 years ago
Gijs Kruitbosch dffa760c04 Fix issue #267 by ignoring hash URIs when making URIs absolute 8 years ago
Wes Johnston f87a12400b Reuse test from pull request #239 which passes without modifications (modified by @gijsk to pass in the current XHTML test environment) 9 years ago
Gijs Kruitbosch 2e1cb3f467 Fix issue #251 by making JSDOMParser expect XML and stop making excuses for 'self-closed' things, when all that does is cause trouble 9 years ago
Gijs a801846a45 Merge pull request #204 from mozilla/tweak-great-grandparent-scoring
Updated great grandparent node scoring.
9 years ago
Nicolas Perriault ae0833522c Improved embedded video elements detection. 9 years ago
Nicolas Perriault 46304bb5fe Updated great grandparent node scoring. 9 years ago
Nicolas Perriault 88ef3893b5 Fixes #180 - Score intermediary headings. 9 years ago
Nicolas Perriault dc1b2c9fa0 Refs #195 - Exclude nodes likely to be related content. 9 years ago
Nicolas Perriault cc18cb5787 Ref #195 - Add support for dailymotion videos. 9 years ago
Nicolas Perriault 9dbc009376 Fixes #113 - Recursive node ancestor scoring. 9 years ago
Nicolas Perriault 44879722b6 Fixes #183 - Preserve list items. 9 years ago
Alexis Métaireau 5912e0c872 Add Firefox User-Agent when generating the test case. 9 years ago
Gijs 79aa2fca87 Merge pull request #189 from mozilla/dont-remove-headings
Fixes #150 - Keep article intermediary headings.
9 years ago
Margaret Leibovic af6da2a87d Merge pull request #190 from mozilla/improved-author-meta-extraction
Improved author metadata detection.
9 years ago
Nicolas Perriault 7aee44adb2 Improved author metadata detection. 9 years ago
Gijs Kruitbosch 5f184053cd Make isProbablyReaderable include <pre>, and deal with long <br>-separated paragraphs and/or shorter-than-5-paragraph text and such. 9 years ago
Nicolas Perriault 2451a07a7d Fixes #150 - Keep article intermediary headings. 9 years ago
Margaret Leibovic 319a50b4f0 Fixes #184 - Don't strip class names from article content 9 years ago
Gijs 49e40768aa Merge pull request #185 from mozilla/score-section-tags-by-default
Fixes #139 #143: Added more weight to section tags.
9 years ago
Nicolas Perriault f6ffa6acde Fixes #139 #143: Added more weight to section tags. 9 years ago
Nicolas Perriault 58cd789cd3 Improved title extraction 'algorithm'. 9 years ago
Nicolas Perriault de89036cd5 Fixes #130 - Using js-beautify for HTML formatting. 9 years ago
Gijs b37ff08bc7 Merge pull request #169 from mozilla/clean-footer-tags
Fixes #163 - Avoid including footer tag contents.
9 years ago
Nicolas Perriault 12c6a11f67 Fixes #163 - Avoid including footer tag contents. 9 years ago
Nicolas Perriault 6eeabf90c1 Fixes #164 - Add support for title alt semantic metadata. 9 years ago
Gijs Kruitbosch 0ff82de0f4 Implement createTextNode, do more relaxed escaping there, update testcase. 9 years ago
Margaret Leibovic 37a8cd4171 Bug 1147584 - Don't remove unlikely <a> tags, and replace <a> tags with their text content if they won't be useful links 9 years ago
Gijs a6014f5854 Merge pull request #132 from gijsk/heise-ad-prioritization
Don't look at banners and skyscrapers, remove <noscript> elements
9 years ago
Gijs Kruitbosch a6346a0ad4 Don't look at banners and skyscrapers, remove <noscript> elements 9 years ago
Nicolas Perriault 4424b0bad7 Refs #128 - Add support for options to Readability constructor. r=@gijsk 9 years ago
Gijs Kruitbosch c53ca31907 Fixed test result output being sent at once 9 years ago
Nicolas Perriault 4d41f5e4ed Refs #117 - Drop social/share buttons. 9 years ago
Nicolas Perriault d725ebc953 Fixes #99: JSDOMParser tag name case handling. r=@gijsk 9 years ago
Gijs Kruitbosch a04f9d9a68 Fix embedded video testcase to work with both jsdom and JSDOMParser 9 years ago
Gijs Kruitbosch 225adef137 Turn off JS when using JSDOM in tests. 9 years ago
Gijs Kruitbosch b1f6c62b25 Fix tests for readability to also work with jsdom
For instance, jsdom's more spec-compliant parsing causes issues with auto-closing elements (lifehacker article) and with not having self-closing <img> and <br> tags. The former was fixed by removing offending markup, the latter by adjusting JSDOMParser to be more sane, and the expected outputs to cope with this.

Finally, JSDOMParser automatically drops comments. The test code needed to manually do this in the jsdom case.
9 years ago
Gijs Kruitbosch 62801faa0e Fix JSDOMParser to do some HTML escaping and identify as JSDOMParser + add tests 9 years ago
Nicolas Perriault 3b636b59f0 Added readerable value to test pages metadata. 9 years ago
Margaret Leibovic 6b7834f798 add test for isProbablyReaderable 9 years ago
Nicolas Perriault 2bfa678cab Added separate command for reference benchmark. 9 years ago
Nicolas Perriault 1e14d47bb7 Added benchmarks. 9 years ago
Gijs f2b04930c1 Merge pull request #87 from gijsk/script-parsing-should-deal-with-comments
Fix script parsing to ignore closing tags in comments
9 years ago
Gijs Kruitbosch 8ddba60425 Fix script parsing to ignore closing tags in comments 9 years ago
Nicolas Perriault f8d37e4276 Don't remove elements containing figures or having them as a parent. 9 years ago
Nicolas Perriault b6730703a1 Fixes #81 - Keep article images. 9 years ago
Gijs Kruitbosch cdcbd94cd5 Add tests for the lifehacker page 9 years ago
Gijs 194a5376c8 Merge pull request #63 from mozilla/preserve-embedded-tweets
Preserve inline tweets as they're part of article contents.
9 years ago
Nicolas Perriault aeeabb7c79 Print exception stack when generating a test case fails. 9 years ago
Gijs 14b33b69db Merge pull request #65 from mozilla/support-embed-videos
Fixes #56 - Updated support for embedded Youtube & Vimeo videos.
9 years ago
Nicolas Perriault ad52d8ee30 Fixes #53 - Fixed dot-slash relative URI resolution. 9 years ago
Nicolas Perriault 2d5f59f3eb Fixes #56 - Updated support for embedded Youtube & Vimeo videos. 9 years ago
Nicolas Perriault d83763c8a1 Preserve inline tweets as they're part of article contents. 9 years ago
Nicolas Perriault cf3dce6cf2 Refs #58 - Stripped embed tags. 9 years ago
Nicolas Perriault eee224560b Addressed review comments from @Gijsk. 9 years ago
Nicolas Perriault 4f9615cb9a Use forEach when it makes sense. 9 years ago
Gijs Kruitbosch 14afc21b96 Fix code to ignore titles when we already have one. 9 years ago
Gijs Kruitbosch a924e31729 Add testcase for current Medium behaviour including SVG that desktop sees. 9 years ago
Gijs Kruitbosch 955951659d Bug 1143725 - fix the Herald Sun website 9 years ago
Gijs Kruitbosch f9e770ad3b Write a bunch of tests for jsdomparser 9 years ago
Margaret Leibovic d0df9d8479 Merge pull request #40 from leibovic/byline
Improve byline algorithm. r=Gijs
9 years ago
Margaret Leibovic 3c2d93cd09 Improve byline algorithm 9 years ago
Nicolas Perriault f4670a1531 Better test docs. 9 years ago
Nicolas Perriault df02218905 More detailed test reports. 9 years ago
Gijs Kruitbosch 2b09db3300 Improve logging for errors in test runs, add a way to run just some tests (using an env var because mocha doesn't support passing arguments) 9 years ago
Margaret Leibovic 639c878af5 Generate expected-metadata.json in generate-testcase.js 9 years ago
Margaret Leibovic 1b5d896b8b Add expected-metadata.json for existing tests 9 years ago
Margaret Leibovic 6490d7205d Update test to check metadata 9 years ago
Gijs Kruitbosch 5efddf6620 Update all the tests, add a bunch of random things so we have some base idea of what stuff we're breaking when changing things. 9 years ago
Gijs Kruitbosch 1c42f29aa5 Create a script to generate testcases, actually use our version of JSDOMParser 9 years ago
Nicolas Perriault fac76c6c1a Added support for readability log messages forwarding to node. 9 years ago
Nicolas Perriault 7da6e82fec Switched to using jsdom for tests. 9 years ago
Gijs Kruitbosch 1d2df4a70e Bug 1144441 - avoid leaving out paragraphs 9 years ago
Margaret Leibovic 03d9e36161 Merge pull request #22 from gijsk/fix-empty-classes
Don't create/leave empty class attributes around all the nodes we're using. r=margaret
9 years ago
Nicolas Perriault 99f338a03a Added logging to test output. 9 years ago
Gijs Kruitbosch b62fd27ba6 Don't create/leave empty class attributes around all the nodes we're using. 9 years ago
Gijs Kruitbosch aebd13b12b Bug 1127778 - fix Readability test suite to always use its own copy so travis build passes 9 years ago
Gijs Kruitbosch 3c277a1701 Bug 1127778 - fix paragraph reordering and add a test for it. 9 years ago
Nicolas Perriault 3bef3e7029 Added basic functional test + travis setup. 9 years ago