Archives/readability
2
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
336 Commits 14 Branches 0 Tags 29 MiB
1bac47c70d
Commit Graph

336 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Maria Luiza Soares
1bac47c70d Add newly generated test case 2018-12-21 18:28:28 +00:00
Maria Luiza Soares
262fffd703 Retrieve site name on parse, based on meta og:site_name 2018-12-21 18:28:28 +00:00
Gijs
876c81f710 Update sorting function in Readability.js 
Simplify sorting function also considering case where arguments are equal

Co-Authored-By: jemrobinson <james.em.robinson@gmail.com>
 2018-11-20 12:08:07 +00:00
James Robinson
ee18c21fc2 Switched sort function from boolean to explicit -1 and 1 thus avoiding failures to sort when false is evaluated as 0 2018-11-20 12:08:07 +00:00
Dan Burzo
44e90de00b Elements that have no .style (e.g. mathml) are probably visible; fixes #493 2018-11-07 13:29:41 +00:00
Hugo Locurcio
9fbe42683a Add .gitattributes file 
This ignores HTML (test data) so the repository is considered
to use JavaScript instead of HTML on GitHub.
 2018-11-01 15:41:20 +00:00
Daniel Aleksandersen
3be1aaa01c Recognize Sina Weibo meta tags 
http://open.weibo.com/wiki/Weibo_meta_tag
 2018-08-28 11:04:29 +01:00
Daniel Aleksandersen
5a69d4a8eb Improve metadata extraction (#478) 
* Improve metadata extraction

* Recognize meta[property] as a space-separated list
* Recognize Dulin Core (dc|dcterm): metadata.
* Prefer Dublin Core, Open Graph, Twitter, and HTML in that order.
* _getArticleTitle() is now only used as fallback if document
 doesn't provide good metadata.
 2018-08-25 00:28:00 +01:00
Daniel Aleksandersen
0449dbf186 Recognize more iframe video embed video services 
* TenCent QQ Video, Alexa Rank 8
* Twitch clips and streams, Alexa Rank 33
* Internet Archive, Alexa Rank 265
* Wikimedia, Alexa Rank 347
 2018-08-22 16:08:46 +01:00
Gijs Kruitbosch
f782bc5f06 Avoid global flag when looking for metadata using regexes 2018-08-21 17:56:25 +02:00
Johann Hofmann
93a2f1b026
Merge pull request #471 from gijsk/moar-eslint 
Add more eslint rules (fixes #457)
 2018-07-16 07:15:08 +02:00
Gijs Kruitbosch
30611cc57f Fix quotes issues in test and benchmark files 2018-07-15 15:43:50 +01:00
Gijs Kruitbosch
f511d1aa2b Enable eslint checks for quotes and single-line loops/conditionals 2018-07-14 22:09:14 +01:00
Gijs Kruitbosch
7cf95bd427 Fix same-line loops and if statements 2018-07-14 22:09:00 +01:00
Gijs Kruitbosch
d9f7bb2965 Fix quotes 2018-07-14 14:28:41 +01:00
Gijs Kruitbosch
7d03bec52d Fix issues with finding nytimes content caused by in-article ads 2018-07-10 14:13:01 +01:00
tmm2018
076bf2017b [docs] - mozilla/readibility - README.md - fixing tiny little issues (grammar, rethorics, spelling, etc.) (#462) 
* [docs] - mozilla/readibility - README.md - add articles to the description of the properties of the Readability output
 2018-06-13 08:14:36 -07:00
Gijs
4b193ccd6a
Include URI information for jsdom in the README. 
See #453 for an example of where this led to confusion.
 2018-06-12 10:12:55 -07:00
Gijs Kruitbosch
8fec62d246 Strip XML namespaces from tag names to deal with broken serializations 2018-06-09 09:51:16 +01:00
Gijs Kruitbosch
8e92a1fa19 Reuse textNode variable for CDATA blocks, too 2018-06-09 09:49:25 +01:00
David A Roberts
ea4165721f Remove single-cell tables 2018-06-09 09:49:01 +01:00
David A Roberts
bf64b58d90 Update tests 2018-06-08 11:06:01 +01:00
David A Roberts
72bd1a8532 Don't nest paragraphs 2018-06-08 11:06:01 +01:00
David A Roberts
68c9af4ffa Use numeric encoding for non-XML entities 
JSDOMParser can't handle HTML named entities like `&nbsp;`
 2018-06-08 11:06:01 +01:00
David A Roberts
611e9e3a6f JSDOMParser: handle CDATA sections 2018-06-08 11:06:01 +01:00
David A Roberts
afcc4b8e49 Fix titles not being trimmed sometimes 2018-06-08 11:06:01 +01:00
Gijs Kruitbosch
d4b842c82a Match headings on trimmed strings to avoid whitespace causing mismatches 2018-05-24 16:32:16 +01:00
Gijs Kruitbosch
8c02a0d34c Fix #283 and remove hidden nodes 2018-05-16 21:54:12 +01:00
David A Roberts
656a6673d9 Don't put non-phrasing content into paragraphs 2018-05-16 10:43:30 +01:00
David A Roberts
5ae90930cd Don't convert DIVs to Ps when more than 25% links 2018-05-15 13:29:55 +01:00
David A Roberts
9f2c5cb42e Put phrasing content into paragraphs 
This removes the need for `p.readability-styled` elements.
 2018-05-15 13:29:55 +01:00
David A Roberts
c823a6efb2 Fix generate-testcase.js 2018-05-14 09:44:33 +01:00
Gijs Kruitbosch
f4ab856992 Check for a document being passed 
This provides a descriptive error message if no document is passed, and
ignores the first argument if the second argument looks like
a reasonable DOM document instance.
 2018-05-01 12:29:22 +01:00
David A Roberts
7a24801958 Don't include root html node in candidates 
Fixes #435
 2018-04-29 09:22:00 +01:00
David A Roberts
acfd3759a1 Generate XHTML-compatible input for test cases 
Fixes the bug noted in the README
 2018-04-28 22:28:16 +01:00
David A Roberts
d60184966c Remove unused URI parameter from constructor 2018-04-26 10:30:15 +01:00
David A Roberts
5ee03bc960 Stop Readability depending on Node.* constants 2018-04-22 16:23:46 +01:00
Andres Rey
3c76104adb Fix engadget test case 2018-03-23 00:27:50 +00:00
Andres Rey
4b99f41ec9 Add engadget test case 2018-03-23 00:27:50 +00:00
Andres Rey
6c5bc62959 Remove aside tags on test cases 2018-03-23 00:27:50 +00:00
Andres Rey
6fd816496c Clean <aside> tags on _prepArticle 2018-03-23 00:27:50 +00:00
David A Roberts
f8d9b1c224 Update test expectations 2018-03-19 13:20:29 +00:00
David A Roberts
8414158fa9 Fix _replaceBrs 
Previously, `nextElem` was not actually proceeding to the next element, and therefore aborting the paragraph at the first `<br>` (rather than the first `<br><br>` as the comment indicates).
 2018-03-19 13:20:29 +00:00
Joan Espasa Arxer
3ff9a166fb Changed wordThreshold to charThreshold to better reflect the semantics. 2018-03-13 14:37:27 +00:00
Brad Philips
8525c6af36 Fix relative URIs given <base> tags (#422) 2018-03-02 11:38:14 +00:00
Gijs Kruitbosch
d598baf02b Improve URL handling in JSDOMParser and Readability.js 
This change ups the required node version to 7.0 because it relies on the builtin url module.

We now pass a url when constructing a jsdom document or JSDOMParser document.
Because this is an API change, I'm increasing the package version.

Ultimately, I would like to remove the  argument from the readability constructor. It should
use the documentURI from the document it is passed.
 2018-02-28 11:29:29 +00:00
Andres Rey
834672ef86 Return longest text after failing to detect text longer than the configured value (#423) 
Save extracted text across attempts and return the longest one when all attempts fail, and add a test case from hukumusume
 2018-02-27 14:26:54 +00:00
Tom Z?hner
264b8e8968 Remove link elements when preparing article for display 2018-01-30 15:11:59 +00:00
Thomas Jaggi
fd1557560a [Docs] Fixed JSDOM usage note 2018-01-02 22:12:53 +00:00
Andres Rey
fa9d8bda48 Add la-nacion test case 2017-12-11 14:00:48 +00:00