Gijs Kruitbosch
60ef565b67
Don't choke on <meta> tags that do not have a content attribute
6 years ago
Gijs
878545f64d
Make usage sections in README more discoverable
...
This just reorders some of the content and reduces duplication.
6 years ago
Gijs Kruitbosch
30f9670a5f
Avoid setAttribute errors from invalid attributes, fixes #392
6 years ago
Gijs
15d411a865
Add comment to indicate duplicate regexes
...
This comment was added in mozilla-central and seems useful, adding it to keep m-c and github in sync.
6 years ago
Gijs Kruitbosch
d8c837012b
Fix benchmark script for script split and new JSDOM version
6 years ago
Gijs Kruitbosch
512e1c18a7
Update to latest JSDOM
6 years ago
Gijs Kruitbosch
977be42d1f
Fix link normalization for live HTMLCollections
...
Newer versions of JSDOM implement getElementsByTagName correctly.
This means it returns a live node list. When calling
`Element.replaceChild` for links inside the loop over that
collection, elements disappear from the list, meaning we miss
every other item. Without this fix, the `clean-links` testcase
breaks.
6 years ago
Gijs Kruitbosch
e8bb7f722f
Fix whitespace normalization in title metadata
...
When switching to a newer version of JSDOM, it is more literal
about listing whitespace as part of textContent, including
newlines and not normalizing multiple spaces.
It seems prudent to just always normalize whitespace for titles,
which are guaranteed to be pretty short anyway.
6 years ago
Gijs Kruitbosch
3610476663
Remove CSS that jsdom struggles to parse
6 years ago
Gijs Kruitbosch
2620542dd1
Split off isProbablyReaderable implementation
6 years ago
Maria Luiza Soares
8c41d92560
Assert on siteName in all test cases
6 years ago
Maria Luiza Soares
1bac47c70d
Add newly generated test case
6 years ago
Maria Luiza Soares
262fffd703
Retrieve site name on parse, based on meta og:site_name
6 years ago
Gijs
876c81f710
Update sorting function in Readability.js
...
Simplify sorting function also considering case where arguments are equal
Co-Authored-By: jemrobinson <james.em.robinson@gmail.com>
6 years ago
James Robinson
ee18c21fc2
Switched sort function from boolean to explicit -1 and 1 thus avoiding failures to sort when false is evaluated as 0
6 years ago
Dan Burzo
44e90de00b
Elements that have no .style (e.g. mathml) are probably visible; fixes #493
6 years ago
Hugo Locurcio
9fbe42683a
Add .gitattributes file
...
This ignores HTML (test data) so the repository is considered
to use JavaScript instead of HTML on GitHub.
6 years ago
Daniel Aleksandersen
3be1aaa01c
Recognize Sina Weibo meta tags
...
http://open.weibo.com/wiki/Weibo_meta_tag
6 years ago
Daniel Aleksandersen
5a69d4a8eb
Improve metadata extraction ( #478 )
...
* Improve metadata extraction
* Recognize meta[property] as a space-separated list
* Recognize Dulin Core (dc|dcterm): metadata.
* Prefer Dublin Core, Open Graph, Twitter, and HTML in that order.
* _getArticleTitle() is now only used as fallback if document
doesn't provide good metadata.
6 years ago
Daniel Aleksandersen
0449dbf186
Recognize more iframe video embed video services
...
* TenCent QQ Video, Alexa Rank 8
* Twitch clips and streams, Alexa Rank 33
* Internet Archive, Alexa Rank 265
* Wikimedia, Alexa Rank 347
6 years ago
Gijs Kruitbosch
f782bc5f06
Avoid global flag when looking for metadata using regexes
6 years ago
Johann Hofmann
93a2f1b026
Merge pull request #471 from gijsk/moar-eslint
...
Add more eslint rules (fixes #457 )
6 years ago
Gijs Kruitbosch
30611cc57f
Fix quotes issues in test and benchmark files
6 years ago
Gijs Kruitbosch
f511d1aa2b
Enable eslint checks for quotes and single-line loops/conditionals
6 years ago
Gijs Kruitbosch
7cf95bd427
Fix same-line loops and if statements
6 years ago
Gijs Kruitbosch
d9f7bb2965
Fix quotes
6 years ago
Gijs Kruitbosch
7d03bec52d
Fix issues with finding nytimes content caused by in-article ads
6 years ago
tmm2018
076bf2017b
[docs] - mozilla/readibility - README.md - fixing tiny little issues (grammar, rethorics, spelling, etc.) ( #462 )
...
* [docs] - mozilla/readibility - README.md - add articles to the description of the properties of the Readability output
6 years ago
Gijs
4b193ccd6a
Include URI information for `jsdom` in the README.
...
See #453 for an example of where this led to confusion.
6 years ago
Gijs Kruitbosch
8fec62d246
Strip XML namespaces from tag names to deal with broken serializations
6 years ago
Gijs Kruitbosch
8e92a1fa19
Reuse textNode variable for CDATA blocks, too
6 years ago
David A Roberts
ea4165721f
Remove single-cell tables
6 years ago
David A Roberts
bf64b58d90
Update tests
6 years ago
David A Roberts
72bd1a8532
Don't nest paragraphs
6 years ago
David A Roberts
68c9af4ffa
Use numeric encoding for non-XML entities
...
JSDOMParser can't handle HTML named entities like ` `
6 years ago
David A Roberts
611e9e3a6f
JSDOMParser: handle CDATA sections
6 years ago
David A Roberts
afcc4b8e49
Fix titles not being trimmed sometimes
6 years ago
Gijs Kruitbosch
d4b842c82a
Match headings on trimmed strings to avoid whitespace causing mismatches
6 years ago
Gijs Kruitbosch
8c02a0d34c
Fix #283 and remove hidden nodes
6 years ago
David A Roberts
656a6673d9
Don't put non-phrasing content into paragraphs
6 years ago
David A Roberts
5ae90930cd
Don't convert DIVs to Ps when more than 25% links
6 years ago
David A Roberts
9f2c5cb42e
Put phrasing content into paragraphs
...
This removes the need for `p.readability-styled` elements.
6 years ago
David A Roberts
c823a6efb2
Fix generate-testcase.js
6 years ago
Gijs Kruitbosch
f4ab856992
Check for a document being passed
...
This provides a descriptive error message if no document is passed, and
ignores the first argument if the second argument looks like
a reasonable DOM document instance.
7 years ago
David A Roberts
7a24801958
Don't include root html node in candidates
...
Fixes #435
7 years ago
David A Roberts
acfd3759a1
Generate XHTML-compatible input for test cases
...
Fixes the bug noted in the README
7 years ago
David A Roberts
d60184966c
Remove unused URI parameter from constructor
7 years ago
David A Roberts
5ee03bc960
Stop Readability depending on Node.* constants
7 years ago
Andres Rey
3c76104adb
Fix engadget test case
7 years ago
Andres Rey
4b99f41ec9
Add engadget test case
7 years ago