Commit Graph

492 Commits (dx-upgrade-rollup-and-eslint)
 

Author SHA1 Message Date
Mike Ashley 90ccbe09ea dx: upgrading rollup-related packages 5 years ago
Michael Ashley e12c916499
feat: ability to add custom extractors via api (#484)
* feat: ability to add custom extractors via api

* docs: updating readme

* fix: example.com was being used in another test

* fix: timezone was messing up date_published test

* fix: using a unique site for testing

* fix: updated custom extractor api

* docs: updating readme

* fix: removing unused fixture

* fix: updating test description

* feat: ability to add custom extractors via cli
5 years ago
Sven Wiegand f95947fe88 Implemented custom extractor epaper.zeit.de (#488) 5 years ago
Michael Ashley 2422e4717d
fix: incorrect parsing on medium.com (#477)
* fix: medium extractor now pulls content

* fix: remove youtube caption if no preview available

* fix: remove youtube node if no image

* fix: removing dek from medium.com extractor
5 years ago
greenkeeper[bot] 2bed238b68 chore(package): update inquirer to version 7.0.0 (#479) 5 years ago
greenkeeper[bot] 869e44a69f chore(package): update karma-chrome-launcher to version 3.0.0 (#458) 5 years ago
greenkeeper[bot] e4a7a288e5 chore(package): update eslint-config-prettier to version 6.1.0 (#476) 5 years ago
Malo Bourgon 2173c4cf83 deps: Update wuzzy to fix vulnerability (#462) 5 years ago
Jakob Fix a918a9d6fa doc: correct link that points to wrong line (#469) 5 years ago
Michael Ashley 0686ee7956
fix: incorrect parsing on theatlantic.com (#475)
* fix: incorrect parsing on theatlantic.com

* chore: updating theatlantic.com tests & fixtures

* chore: removing script data from minified fixture
5 years ago
Michael Ashley 5e33263d25
chore: minifying biorxiv.com fixture (#478) 5 years ago
david0leong 911b0f87c8 Add custom extractor for biorxiv.org (#467)
* Add custom extractor for biorxiv.org

* Fix content selector

* Improve content selector
5 years ago
Jakob Fix 76d59f2d58 doc: correct internal page links (#470)
Specifically, to the cleaning content and using transform sections.
5 years ago
dependabot[bot] 398cba4d66 chore(deps): bump lodash.merge from 4.6.1 to 4.6.2 (#456)
Bumps [lodash.merge](https://github.com/lodash/lodash) from 4.6.1 to 4.6.2.
- [Release notes](https://github.com/lodash/lodash/releases)
- [Commits](https://github.com/lodash/lodash/commits)

Signed-off-by: dependabot[bot] <support@github.com>
5 years ago
dependabot[bot] 90e208ea13 chore(deps): bump cached-path-relative from 1.0.0 to 1.0.2 (#472)
Bumps [cached-path-relative](https://github.com/ashaffer/cached-path-relative) from 1.0.0 to 1.0.2.
- [Release notes](https://github.com/ashaffer/cached-path-relative/releases)
- [Commits](https://github.com/ashaffer/cached-path-relative/commits)

Signed-off-by: dependabot[bot] <support@github.com>
5 years ago
dependabot[bot] 5bb7c58e95 chore(deps): bump merge from 1.2.0 to 1.2.1 (#473)
Bumps [merge](https://github.com/yeikos/js.merge) from 1.2.0 to 1.2.1.
- [Release notes](https://github.com/yeikos/js.merge/releases)
- [Commits](https://github.com/yeikos/js.merge/compare/v1.2.0...v1.2.1)

Signed-off-by: dependabot[bot] <support@github.com>
5 years ago
greenkeeper[bot] ce572f3a28 chore(package): update brfs-babel to version 2.0.0 (#461) 5 years ago
greenkeeper[bot] 6f65702a6c Update moment-timezone to the latest version 🚀 (#455)
* fix(package): update moment-timezone to version 0.5.26

* chore(package): update lockfile yarn.lock
5 years ago
greenkeeper[bot] c764cebc0c chore(package): update remark-cli to version 7.0.0 (#460) 5 years ago
greenkeeper[bot] 853e041d84 deps: update husky to the latest version 🚀 (#450)
* chore(package): update husky to version 3.0.0

* chore(package): update lockfile yarn.lock
5 years ago
greenkeeper[bot] f42f81218b deps: update iconv-lite to the latest version 🚀 (#447)
* fix(package): update iconv-lite to version 0.5.0

* chore(package): update lockfile yarn.lock
5 years ago
Kirill Danshin 592f175270 tests: remove a duplicate test (#448) 5 years ago
Adam Pash 713de25751
release: 2.1.1 (#446) 5 years ago
greenkeeper[bot] c11b85f405 deps: update eslint-config-prettier to version 5.0.0 (#441) 5 years ago
Jaen 3b0d5fed69 chore: prevent adding phantomjs-prebuilt as a dependency in CI. (#412)
Fixes #384.
5 years ago
Toufic Mouallem 939d181951 fix: support query strings in lazy-loaded srcsets (#387) 5 years ago
Ben Ubois 0942c37876 feat: custom parser for phoronix.com. (#431) 5 years ago
Michael P. Geraci 571a913745 feat: pitchfork extractor (#439)
* generate the custom extractor and get the first test to pass

* add the basic extractors (title, author, date, etc)

* select the score as well as the review text, and break the content test

* prepend the score to the content

* get the date from the datetime attribute

* mangle this test a little, but just a little (it does work properly)

* move from prepending the score to the review text to adding it as a custom field in the extractor
5 years ago
greenkeeper[bot] c8a66b0d77 deps: Update moment-timezone to the latest version 🚀 (#388)
* fix(package): update moment-timezone to version 0.5.24

* chore(package): update lockfile yarn.lock
5 years ago
dependabot[bot] 255da63e26 deps: bump handlebars from 4.0.6 to 4.1.2 (#434)
Bumps [handlebars](https://github.com/wycats/handlebars.js) from 4.0.6 to 4.1.2.
- [Release notes](https://github.com/wycats/handlebars.js/releases)
- [Changelog](https://github.com/wycats/handlebars.js/blob/master/release-notes.md)
- [Commits](https://github.com/wycats/handlebars.js/compare/v4.0.6...v4.1.2)

Signed-off-by: dependabot[bot] <support@github.com>
5 years ago
dependabot[bot] c7abfc25c6 chore(deps): bump sshpk from 1.10.1 to 1.16.1 (#435)
Bumps [sshpk](https://github.com/joyent/node-sshpk) from 1.10.1 to 1.16.1.
- [Release notes](https://github.com/joyent/node-sshpk/releases)
- [Commits](https://github.com/joyent/node-sshpk/commits/v1.16.1)

Signed-off-by: dependabot[bot] <support@github.com>
5 years ago
david0leong 694ea820aa Custom Extractor for clinicaltrials.gov (#305)
* Add prototype of custom extractor for clinicaltrials.gov

* Add .DS_Store to gitignore

* Make tests for title, author and date_published selectors pass

* Make content selector test pass

* Fix date_published test

* Rebuild

* Remove .DS-Store from gitignore

* Improve extractor and text/fixture of clinicaltrials.gov
5 years ago
Toufic Mouallem a7cd9027e2
chore: update husky to version 2.3.0 (#422)
* chore(package): update husky to version 2.3.0

Closes #395

* chore(package): update lockfile yarn.lock
5 years ago
Gina Trapani 9f6f07508c
docs: Add links to README 5 years ago
Toufic Mouallem 3414ebaa62
chore: update jquery to version 3.4.1 (#420) 5 years ago
Wajeeh Zantout 7c8de71c52 fix: new yorker extractor (#414)
* fix: new yorker extractor

* fix: date_published selector

* fix: remove footer from content

* feat: add additional selector for title

* feat: support article with multiple authors
5 years ago
Wajeeh Zantout e66ad8b81c feat: add le monde extractor (#415) 5 years ago
kik0220 f81dc63617 feat: add rbbtoday.com custom parser (#411)
* feat: add rbbtoday.com custom parser

* fix: content test

* fix: dek and content
5 years ago
kik0220 5e1113b3a9 feat: add japan.zdnet.com custom parser (#410)
* feat: add japan.zdnet.com custom parser

* fix: author and date_published selector
5 years ago
kik0220 77e3bc00e2 feat: add wired.jp custom parser (#409)
* feat: add wired.jp custom parser

* fix: author test

* fix: date_published selector

* test: fix dek and contest

* test: fix content (without clean dek)
5 years ago
kik0220 0b36c96de0 feat: add techlog.iij.ad.jp custom parser (#405)
* feat: add techlog.iij.ad.jp custom parser

* fix: date_published and content selector
5 years ago
kik0220 406bf1b1a9 feat: add weekly.ascii.jp custom parser (#401)
* feat: add weekly.ascii.jp custom parser

* fix: title and date_published selector
5 years ago
kik0220 216bfade00 feat: add www.ipa.go.jp custom parser (#408) 5 years ago
kik0220 3ae8f3bde3 feat: add www.oreilly.co.jp custom parser (#407) 5 years ago
kik0220 7396e81b72 feat: add sect.iij.ad.jp custom parser (#404) 5 years ago
kik0220 3f1d9030ee feat: add www.lifehacker.jp custom parser (#403) 5 years ago
kik0220 b077000c4a feat: add getnews.jp custom parser (#402) 5 years ago
kik0220 b5425c3e8a feat: add www.gizmodo.jp custom parser (#400) 5 years ago
kik0220 a38c727a0a feat: add deadline.com custom parser (#383)
* feat: add deadline.com custom parser

* fix: timezone

* fix: date_published selectors

* fix: title and author selector

* test: transform .embed-twitter

* fix: regenerate the fixture and fix content selector
5 years ago
kik0220 74a3c49a3c feat: add japan.cnet.com custom parser (#382)
* feat: add japan.cnet.com custom parser

* fix: remove transform
5 years ago