Radhi Fadlillah
d8366f0686
Keep all attributes that might contain image
5 years ago
Radhi Fadlillah
e85122e8d7
Make eslint happy
5 years ago
Radhi Fadlillah
c8eab07661
Stop using live list while removing nodes
5 years ago
Radhi Fadlillah
1277d22b81
Keep old img src as data attribute
5 years ago
Radhi Fadlillah
6fed28610d
Simplify loop for unwrapping noscript
5 years ago
Radhi Fadlillah
adc6accaec
Fix grammar issues in comments
5 years ago
Radhi Fadlillah
d784bf7e20
Add method to unwrap img inside noscript
5 years ago
Gijs Kruitbosch
dc34dfd8fa
Fix #580 by not using live node lists when removing items
5 years ago
PalmerAL
61ef00a853
add exception for wikimedia math images
5 years ago
Gijs
56ecc4d4ba
Fix eslint issues.
5 years ago
PalmerAL
7c91bdd275
preserve children when removing javascript: links
5 years ago
Gijs
d6fc38c4b4
Fix #564 by allowing 'content' as an indicator of readable content ( #565 )
...
This avoid `contentWithSidebar` causing complete removal of the content.
As a side-effect, it slightly improves byline detection by not removing
content as early on as before.
5 years ago
PalmerAL
b551f1cf6e
Fix missing content on Wikipedia articles ( #560 )
5 years ago
Joe Winett
60f470c4bb
Remove aria-hidden="true" nodes ( fixes #541 ) ( #555 )
...
Remove aria-hidden="true" nodes (fixes #541 )
5 years ago
Jordy van den Aardweg
2982216913
Added "keepClasses" option to prevent cleaning of classes ( #552 )
5 years ago
PalmerAL
9092b2a29c
Remove sharing elements in fewer situations ( #545 )
...
* remove fewer share elements
* simplify and fix social-buttons testcase
5 years ago
PalmerAL
814f0a3884
Add support for detecting lazy-loaded images ( #542 )
...
Add support for detecting lazy-loaded images using `src` or `srcset` attributes.
5 years ago
Radhi
9009f64f9c
Fix table header missing ( #530 )
6 years ago
Radhi
6761a7e412
Fix embedded videos getting removed ( #526 )
...
Fix embedded videos getting removed
6 years ago
PalmerAL
f5c46a7b14
fix formatting
6 years ago
PalmerAL
681bf0c47b
use default threshold for share elements
6 years ago
PalmerAL
e76aba3485
only remove sharing elements if they contain <500 characters
6 years ago
PalmerAL
a014e0c9c8
exclude graphs from nytimes articles
6 years ago
Radhi Fadlillah
6a5066abe2
Fix tabular data got removed
6 years ago
PalmerAL
f70d36852b
check itemprop when determining whether a node is a byline
6 years ago
Andres Rey
f836a8f291
Add "gdpr" to the list of negative tags
6 years ago
Gijs Kruitbosch
60ef565b67
Don't choke on <meta> tags that do not have a content attribute
6 years ago
Gijs Kruitbosch
30f9670a5f
Avoid setAttribute errors from invalid attributes, fixes #392
6 years ago
Gijs
15d411a865
Add comment to indicate duplicate regexes
...
This comment was added in mozilla-central and seems useful, adding it to keep m-c and github in sync.
6 years ago
Gijs Kruitbosch
977be42d1f
Fix link normalization for live HTMLCollections
...
Newer versions of JSDOM implement getElementsByTagName correctly.
This means it returns a live node list. When calling
`Element.replaceChild` for links inside the loop over that
collection, elements disappear from the list, meaning we miss
every other item. Without this fix, the `clean-links` testcase
breaks.
6 years ago
Gijs Kruitbosch
e8bb7f722f
Fix whitespace normalization in title metadata
...
When switching to a newer version of JSDOM, it is more literal
about listing whitespace as part of textContent, including
newlines and not normalizing multiple spaces.
It seems prudent to just always normalize whitespace for titles,
which are guaranteed to be pretty short anyway.
6 years ago
Gijs Kruitbosch
2620542dd1
Split off isProbablyReaderable implementation
6 years ago
Maria Luiza Soares
262fffd703
Retrieve site name on parse, based on meta og:site_name
6 years ago
Gijs
876c81f710
Update sorting function in Readability.js
...
Simplify sorting function also considering case where arguments are equal
Co-Authored-By: jemrobinson <james.em.robinson@gmail.com>
6 years ago
James Robinson
ee18c21fc2
Switched sort function from boolean to explicit -1 and 1 thus avoiding failures to sort when false is evaluated as 0
6 years ago
Dan Burzo
44e90de00b
Elements that have no .style (e.g. mathml) are probably visible; fixes #493
6 years ago
Daniel Aleksandersen
3be1aaa01c
Recognize Sina Weibo meta tags
...
http://open.weibo.com/wiki/Weibo_meta_tag
6 years ago
Daniel Aleksandersen
5a69d4a8eb
Improve metadata extraction ( #478 )
...
* Improve metadata extraction
* Recognize meta[property] as a space-separated list
* Recognize Dulin Core (dc|dcterm): metadata.
* Prefer Dublin Core, Open Graph, Twitter, and HTML in that order.
* _getArticleTitle() is now only used as fallback if document
doesn't provide good metadata.
6 years ago
Daniel Aleksandersen
0449dbf186
Recognize more iframe video embed video services
...
* TenCent QQ Video, Alexa Rank 8
* Twitch clips and streams, Alexa Rank 33
* Internet Archive, Alexa Rank 265
* Wikimedia, Alexa Rank 347
6 years ago
Gijs Kruitbosch
f782bc5f06
Avoid global flag when looking for metadata using regexes
6 years ago
Gijs Kruitbosch
7cf95bd427
Fix same-line loops and if statements
6 years ago
Gijs Kruitbosch
d9f7bb2965
Fix quotes
6 years ago
Gijs Kruitbosch
7d03bec52d
Fix issues with finding nytimes content caused by in-article ads
6 years ago
David A Roberts
ea4165721f
Remove single-cell tables
6 years ago
David A Roberts
72bd1a8532
Don't nest paragraphs
6 years ago
David A Roberts
afcc4b8e49
Fix titles not being trimmed sometimes
6 years ago
Gijs Kruitbosch
d4b842c82a
Match headings on trimmed strings to avoid whitespace causing mismatches
6 years ago
Gijs Kruitbosch
8c02a0d34c
Fix #283 and remove hidden nodes
6 years ago
David A Roberts
656a6673d9
Don't put non-phrasing content into paragraphs
6 years ago
David A Roberts
5ae90930cd
Don't convert DIVs to Ps when more than 25% links
6 years ago