Commit Graph

292 Commits

Author SHA1 Message Date
Evan Tseng
b46e316034 Bug 1338468 - Tests for tumblr.com, r=Gijs 2017-02-10 17:39:25 +08:00
Evan Tseng
bd2d9f8100 Bug 1338475 - Tests for pixnet.net, r=Gijs 2017-02-10 17:35:22 +08:00
Evan Tseng
1369f923db Merge pull request #348 from gijsk/1322674-table-divs
Fix bug 1322674 by only conditionally removing content from tables when the tables are layout tables, r=evanxd
2017-02-09 18:27:01 +08:00
Gijs Kruitbosch
66c013c4fb Make it easier to find where errors are coming from based on the error message 2017-01-30 15:19:37 +01:00
Gijs Kruitbosch
9baea36169 Fix bug 1322674 by not removing content in data tables 2017-01-30 15:19:10 +01:00
Evan Tseng
498a7b2bf6 Merge pull request #347 from evanxd/bug-1259763
Bug 1259763 - Remove h2 when there is only one h2 and its text content substantially equals article title, r=Gijs
2017-01-29 11:50:07 +08:00
Evan Tseng
19f2124c82 Bug 1259763 - Remove h2 when there is only one h2 and its text content substantially equals article title, r=Gijs 2017-01-28 13:41:56 +08:00
Evan Tseng
ccc8e9bf4c Bug 1330931 - Add tests for nytimes.com, r=Gijs 2017-01-23 11:56:36 +00:00
Evan Tseng
15e1f03261 Bug 1300697 - Reader View missed first few paragraphs on New York Times website, r=Gijs 2017-01-21 17:46:50 +00:00
andrei-ch
5b1e69bdf2 Bug fix: still not grabbing full content from nytimes.com articles
Solution: strip one level of empty <DIV> elements so they don’t
obstruct merging adjacent content downstream.
2017-01-21 17:46:50 +00:00
andrei-ch
486927ebd9 Bug fix: many pages only grab partial content (dirty.ru, nytimes.com)
1) Avoid conversion of whitespace text nodes into paragraphs. They
create a lot of noise and actually prevent sibling joining logic from
working in many pages.

2) Handle case when adjacent content is actually located in parent's
sibling node instead of top candidate’s sibling.
2017-01-21 17:46:50 +00:00
Evan Tseng
a58913d975 Bug 1300697 - Add test for New York Times website 2017-01-21 17:46:50 +00:00
Evan Tseng
a762f8c3be Merge pull request #342 from evanxd/bug-1332236
Bug 1332236 - Add tests for cnet.com, r=Gijs
2017-01-20 11:22:41 +08:00
Evan Tseng
ad13a63065 Bug 1332236 - Add tests for cnet.com, r=Gijs 2017-01-20 11:17:49 +08:00
Gijs Kruitbosch
2b28d6022f Merge branch 'Treora-commonjs' 2017-01-17 16:18:20 +00:00
Gijs Kruitbosch
f1797fcf7e Merge branch 'commonjs' of https://github.com/Treora/readability into Treora-commonjs 2017-01-17 16:17:04 +00:00
Gerben
43c54e8a71 Fix tiny mistake (typeof dump !== 'undefined') 2017-01-17 14:43:11 +00:00
Evan Tseng
e1c7170d85 Merge pull request #309 from evanxd/bug-1167568
Bug 1167568 - Find a better topCandidate if there are other nodes scores are high enough, r=Gijs
2017-01-17 12:08:39 +08:00
Evan Tseng
131d923d38 Bug 1167568 - Find a better topCandidate if there are other nodes scores are high enough, r=Gijs 2017-01-17 11:29:57 +08:00
Gerben
d63576be0f CommonJS support: set module.exports = Readability 2017-01-17 01:38:59 +01:00
Evan Tseng
cec7d90a14 Merge pull request #336 from gijsk/remove-ews-hack
Remove hack for EWS content management system, r=evanxd
2017-01-13 13:32:52 +08:00
Gijs
0d3043dacb Remove hack for EWS content management system
Per issue #322
2017-01-11 16:48:56 +00:00
Sebastian Hengst
5e9c7a3910 Bug 1322327 - Only remove images which are not descendants of a figure if there is more than one image, update affected tests 2016-12-21 16:31:25 +00:00
andrei-ch
c5ff44d8fe Clean <input>,<textarea>,<select>,<button> elements 2016-12-17 13:37:27 +00:00
Evan Tseng
a34d054f45 Merge pull request #332 from gijsk/fix-readability-determination-in-generate-testcase
Use jsdom for parsing the document to determine readability (fixes #325), r=evanxd
2016-12-15 17:30:24 +08:00
Evan Tseng
c83826c326 Merge pull request #329 from evanxd/bug-1142312
Bug 1142312 - Add two more types of unlikely candidates: cover-wrap and yom-remote, r=Gijs
2016-12-15 11:37:16 +08:00
Evan Tseng
63230a307a Bug 1142312 - Add two more types of unlikely candidates: cover-wrap and yom-remote, r=Gijs 2016-12-15 11:30:40 +08:00
Gijs Kruitbosch
46842048c1 Use jsdom for parsing the document to determine readability (fixes #325) 2016-12-14 13:44:29 +00:00
andrei-ch
4a0d08c56a font-to-span conversion skips half the font elements on 'real' DOMs 2016-12-14 12:18:47 +00:00
Gijs Kruitbosch
0ab4ac8556 Fix test failures caused by timeout still being too low 2016-12-14 11:41:38 +00:00
Evan Tseng
e84c0c3f07 Bug 1285543 - Only use "og:title" or "twitter:title" if _getArticleTitle does not return a valid title, r=Gijs 2016-12-14 11:34:15 +00:00
Gijs
c2f7db51f5 Remove textContent from metadata file (fixes #324) (#326) 2016-12-09 13:28:56 -10:00
Evan Tseng
33dc8fa023 Bug 1255978 - Remove legends candidate, r=Gijs 2016-11-25 11:12:47 +00:00
Evan Tseng
af0aa5c59f Bug 1173548 - Find out text direction from ancestors of final candidate, r=Gijs 2016-11-25 10:24:41 +00:00
Evan Tseng
ece0d1ecea Bug 1317930 - Tests for msn.com, r=Gijs 2016-11-16 10:32:55 +00:00
Evan Tseng
1b694cf650 Bug 1310075 - Tests for qq.com. r=Gijs 2016-11-09 12:02:44 +00:00
Gijs Kruitbosch
ac878bf7c1 Move to .eslintrc.js file 2016-11-02 09:12:45 +00:00
Evan Tseng
522f39617f Bug 1310074 - Tests for yahoo.com. r=Gijs 2016-11-02 08:54:57 +00:00
Evan Tseng
4fa0d1b207 Bug 1177619 - Score div nodes which have br nodes. r=Gijs 2016-11-01 10:25:57 +00:00
Evan Tseng
8bfd2a978d Bug 1310073 - Tests for wikipedia.org. r=Gijs 2016-10-28 10:59:56 +01:00
Taylor Hunt
71aa562387 Add microformats2 class names to heuristics (#303)
Microformats updated their old `hentry` to [a newer
`h-entry`](http://microformats.org/wiki/h-entry).

With the [number of IndieWeb sites breaking into the
ten-thousands](http://tantek.com/2016/190/b1/state-of-indieweb-summit),
this seems like a fair idea.
2016-08-13 23:06:24 +01:00
Gijs
1a12befa41 Fix code style, tighten up eslint rules (#301) 2016-07-19 21:44:27 +01:00
Ivan Persidsky
fd11f92adb Use a dedicated method and backward iteration for removing nodes (#300)
This improves compat with "real" DOMs that provide a live NodeList as the return value of getElementsByTagName.
2016-07-18 12:56:51 +01:00
Gijs Kruitbosch
140d4c4aca Only compute textContent once. 2016-05-04 15:09:21 +01:00
usergit
327bfcb93f exposed textContent to be returned
this returns the text content only, this is useful as it allows the content to be easily accessible
2016-05-03 23:59:39 -07:00
Gijs
69b81f5d70 Fix #287: convert getElementsByTagName result to an array (#288) 2016-04-20 08:59:42 +01:00
Margaret Leibovic
c3c91a739b Merge pull request #278 from gijsk/simplyfound-hidden-modal-dialog
Address issue #277 by marking 'modal' unlikely+negative
2016-03-18 14:49:35 -04:00
Gijs Kruitbosch
46b08a5ea5 Address issue #277 by marking 'modal' unlikely+negative 2016-03-17 10:53:57 +00:00
Gijs
fcc645019f Merge pull request #275 from pdehaan/issue-273-no-inner-declarations
Add 'no-inner-declarations' rule to .eslintrc
2016-03-15 20:30:20 +00:00
Peter deHaan
1842b5ee12 Add 'no-inner-declarations' rule to .eslintrc 2016-03-15 13:21:23 -07:00