Commit Graph

338 Commits

Author SHA1 Message Date
Adam Pash
a8face796a Fix extension bugs (#23)
* feat: cleaning supplemental elements in nytimes (visible in web only)

closes https://github.com/postlight/mercury-reader-chrome-extension/issues/102

* wip

* fix: more generous date published bits

* feat: added washington post extractor (including figure transforms)

closes https://github.com/postlight/mercury-reader-chrome-extension/issues/100

* feat: cleaning zoom lightbox from gizmodo/kinja

* lint fix
2016-11-28 16:58:21 -08:00
Adam Pash
3a2f32b0eb feat: added tmz custom parser (#22) 2016-11-28 15:10:28 -08:00
Adam Pash
783a9cfb2f fix: changed overly liberal regex for removing transparent images 2016-11-28 12:10:57 -08:00
Adam Pash
7411922c55 feat: encoding response body based on content-type charset (#21)
Also some small code organization
2016-11-22 10:44:27 -08:00
Adam Pash
88c125d022 chore: package upgrades 2016-11-22 08:45:57 -08:00
Adam Pash
c30fb2e4c0 chore: updated readme 2016-11-22 08:41:35 -08:00
Adam Pash
60a6861e18 Feat: browser support (#19)
Big undertaking to support Mercury in the browser. Builds are working and all tests are passing both for web and node builds. Most code is closely shared.
2016-11-21 14:17:06 -08:00
Adam Pash
eaea57461a fix: servers returning bad headers was breaking request. temporarily (#20)
using fork with a fix for this until request merges the necessary pull request
2016-11-15 13:17:01 -08:00
Adam Pash
629eada1f7 feat: recording/playing back network requests with nock (#18)
* feat: recording/playing back network requests with nock

* lint fix
2016-10-28 14:54:12 -07:00
Adam Pash
6e29848e9c feat: making yarn-friendly for package manager (#17)
* updated several commands; some fixes exposed by yarn upgrade

* removed unnec dep
2016-10-28 11:10:42 -07:00
Adam Pash
e325d860fd Feat: improving ci (#16)
This commit also swaps in yarn for npm and tweaks circle ci a bit.

* appveyor.yml first go

* changing node

* ps

* narrow it down

* trying this

* fix airbnb module

* trying with yarn

* logging

* hybrid?

* trying yarn w/circle

* bump workers?

* build off?

* updating script

* tweaking script for appveyor

* bumping maxworkers

* cleaning up

* build step?

* yarn it

* added appveyor badge
2016-10-28 09:16:21 -07:00
Adam Pash
071218ab3c chore: added repo 2016-10-27 16:53:25 -07:00
Adam Pash
41c3454590 fix: circle test passing badge 2016-10-27 16:35:52 -07:00
Adam Pash
4c9910384a Feat: adding circle ci (#15)
* added circle.yml config

* set maxworkers in circle

* trying diff node versions

* multiple node

* pre nvm install

* testing parallel

* added badge to readme

* clean up circle.yml
2016-10-27 16:20:30 -07:00
Adam Pash
048d654417 feat: parser auto-generates name; lint is more specific 2016-10-27 14:54:38 -07:00
Adam Pash
65c641a879 feat: enforcing line break rules in linter 2016-10-27 11:00:27 -07:00
Adam Pash
4d1d950807 updated generator templates for new style of import/export. also some
adjustments for usability
2016-10-27 10:44:06 -07:00
Adam Pash
7fa90f59b7 making all.js export a generic function to decrease possiblity of error 2016-10-27 10:19:21 -07:00
Adam Pash
de5b120b79 feat: allowing extractors to support multiple domains 2016-10-27 09:20:53 -07:00
Adam Pash
d038a36544 feat: custom medium extractor 2016-10-27 08:47:25 -07:00
Adam Pash
007ddec8ac feat: allowing iframes from src domain 2016-10-27 08:46:10 -07:00
Adam Pash
b65b0c98b0 feat: supporting all GMG sites using DeadspinExtractor 2016-10-26 16:05:15 -07:00
Adam Pash
a73246306d feat: quicker lint by being more specific 2016-10-26 16:05:00 -07:00
Adam Pash
90501ec3b5 fix: increased avatar size 2016-10-26 15:44:49 -07:00
Adam Pash
4b5c029093 feat: added all-contributors 2016-10-26 15:42:55 -07:00
Adam Pash
efd8ebbc69 Add @mutewinter as a contributor 2016-10-26 15:42:14 -07:00
Adam Pash
227bd6a36e Add @droob as a contributor 2016-10-26 15:41:48 -07:00
Adam Pash
9897d9bee8 Add @spiffytoy as a contributor 2016-10-26 15:41:37 -07:00
Adam Pash
615f142c5e Update @adampash as a contributor 2016-10-26 15:41:12 -07:00
Adam Pash
659301b4ab Add @adampash as a contributor 2016-10-26 15:40:16 -07:00
Adam Pash
17317823de fix: bug that stopped proper attr cleaning in certain cases 2016-10-26 14:17:52 -07:00
Adam Pash
40768fa188 feat: support lazy loading video on deadspin 2016-10-26 11:53:42 -07:00
Adam Pash
38c90d239e fix: removeEmpty shouldn't remove elements with images or iframes inside 2016-10-26 11:53:02 -07:00
Adam Pash
c63f500433 fix: narrowed selector to fix blogspot title selector 2016-10-26 11:16:31 -07:00
Adam Pash
d3b11be473 feat: keeping youtube and vimeo iframe embeds (#14)
* feat: keeping youtube and vimeo iframe embeds

* fix: removing class from article correctly
2016-10-26 11:14:37 -07:00
Adam Pash
5c7f2cd28e fix: better selector for nytimes authors 2016-10-17 18:55:58 -07:00
Adam Pash
3b87b557be feat: pulling score from whitelist 2016-10-17 16:26:16 -07:00
Adam Pash
94321111e9 Merge pull request #13 from postlight/feat-apartmenttherapy-parser
feat: Add custom extrator for Apartment Therapy
2016-10-17 08:40:09 -07:00
Drew Bell
76db95e884 feat: Add custom extrator for Apartment Therapy 2016-10-17 10:35:22 -05:00
Adam Pash
4ebfd37408 Merge pull request #12 from postlight/feat-broadwayworld-extractor
feat: Add custom parser for broadwayworld.com
2016-10-13 17:02:04 -07:00
Drew Bell
a708ad3b4f feat: Add custom parser for broadwayworld.com 2016-10-13 16:22:33 -05:00
Adam Pash
896021227d feat: added deadspin custom parser 2016-10-13 13:46:36 -07:00
Adam Pash
422deb4600 feat: generator generates potential selectors for all custom selectable fields 2016-10-10 15:57:47 -07:00
Adam Pash
c314e3befa feat: dek returns null if it's basically the same as the excerpt
Squashed commit of the following:

commit 0ee7d51ce609ad23d2deca1af41e7b4e56681bd7
Author: Adam Pash <adam.pash@gmail.com>
Date:   Mon Oct 10 15:44:28 2016 -0700

    feat: dek does not return if it's basically the same as the excerpt

commit 6ad27f994fff3652e04ffe7c81f1ae0b1647e941
Author: Adam Pash <adam.pash@gmail.com>
Date:   Mon Oct 10 14:35:54 2016 -0700

    feat: added excerpt util
2016-10-10 15:44:58 -07:00
Adam Pash
63c06c8a00 fix: babel-polyfill mess (I think) 2016-10-10 14:16:14 -07:00
Adam Pash
eb0aa0b1f6 feat: some small tweaks to toy's excellent parsers ☺️
Squashed commit of the following:

commit 9638220124a325322d6cda7d16c645185d5fe827
Author: Adam Pash <adam.pash@gmail.com>
Date:   Mon Oct 10 11:02:29 2016 -0700

    fix: removed eslint plugin that was adding unneded async parens

commit ce2268c0f7c1b093c06f156730a0f1bc2aaba39c
Author: Adam Pash <adam.pash@gmail.com>
Date:   Mon Oct 10 10:47:36 2016 -0700

    style: fix async in parens

commit 9591856915eddaf93170da1ce9225b8a378bdf55
Author: Adam Pash <adam.pash@gmail.com>
Date:   Mon Oct 10 10:37:11 2016 -0700

    fix: remove parens around async

commit 6c56054717acc1f7e5499691780f8273f6d07bac
Author: Adam Pash <adam.pash@gmail.com>
Date:   Mon Oct 10 10:35:50 2016 -0700

    fix msn fixture; adjusted yahoo test

commit 4fc117ad5fdc5528f29b0873d60a6a1709642f15
Author: Adam Pash <adam.pash@gmail.com>
Date:   Mon Oct 10 10:14:38 2016 -0700

    removed dek and date_publised tests; neither exist in littlethings

commit 401094b4abc52901255fd2461f5839624f11d8a3
Author: Adam Pash <adam.pash@gmail.com>
Date:   Mon Oct 10 10:08:44 2016 -0700

    feat: updated buzzfeed for content extraction

commit 19548a5485f70ff9b65e3e725d2364d07734ac9c
Author: Adam Pash <adam.pash@gmail.com>
Date:   Mon Oct 10 09:54:30 2016 -0700

    fix: generator should make transforms an object, not array

commit b92113f9f7c97aca9e6d3ce9243abac967d26b63
Author: Adam Pash <adam.pash@gmail.com>
Date:   Mon Oct 10 08:54:38 2016 -0700

    feat: updated politico

commit c026591040f7671cb2a6dd5177a995e21d015482
Author: Adam Pash <adam.pash@gmail.com>
Date:   Mon Oct 10 08:48:52 2016 -0700

    fix: typos

commit 14aa8fa4ce38ff1c2a212cd0225437ae3042c2c3
Author: Adam Pash <adam.pash@gmail.com>
Date:   Mon Oct 10 08:36:12 2016 -0700

    fix: incorrect command in readme

commit fe260e6122877e2cb0130a1ecde0e503017057a3
Author: Adam Pash <adam.pash@gmail.com>
Date:   Mon Oct 10 08:31:11 2016 -0700

    fix: removed dek test because there is no dek on wikia
2016-10-10 11:03:43 -07:00
Toy Vano
3c99404566 Merge pull request #11 from postlight/feat-politico-extractor
feat: added politico extractor
2016-10-05 13:52:57 -04:00
Toy Vano
e766494922 feat: added politico extractor 2016-10-05 13:51:11 -04:00
Toy Vano
dd20e56bc5 Merge pull request #10 from postlight/feat-littlethings-extractor
feat: added littlethings extractor
2016-10-04 15:04:28 -04:00
Toy Vano
fd1ac3f2b9 feat: added littlethings extractor 2016-10-04 15:02:23 -04:00