Archives/mercury-parser
2
0
Fork 0
mirror of https://github.com/postlight/mercury-parser synced 2024-11-17 03:25:31 +00:00
Code Issues Projects Releases Wiki Activity
191 Commits 26 Branches 25 Tags 46 MiB
c4d72fb735
Commit Graph

191 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Toy Vano
e766494922 feat: added politico extractor 2016-10-05 13:51:11 -04:00
Toy Vano
dd20e56bc5 Merge pull request #10 from postlight/feat-littlethings-extractor 
feat: added littlethings extractor
 2016-10-04 15:04:28 -04:00
Toy Vano
fd1ac3f2b9 feat: added littlethings extractor 2016-10-04 15:02:23 -04:00
Toy Vano
84619641b0 Merge remote-tracking branch 'origin/master' 2016-10-04 13:01:36 -04:00
Toy Vano
6c18551ed0 Merge pull request #9 from postlight/feat-wikia-extractor 
feat: added wikia extractor
 2016-10-04 12:11:29 -04:00
Toy Vano
017b9dfcc2 Merge pull request #8 from postlight/feat-buzzfeed-extractor 
feat: added incomplete buzzfeed extractor
 2016-10-04 12:11:22 -04:00
Toy Vano
bdf66314ea Merge pull request #7 from postlight/feat-yahoo-extractor 
feat: added incomplete yahoo extractor
 2016-10-04 12:11:15 -04:00
Toy Vano
b0e1a873c0 Merge pull request #6 from postlight/feat-msn-extractor 
feat: added incomplete msn extractor
 2016-10-04 12:11:07 -04:00
Toy Vano
1519eed3e5 feat: added wikia extractor 2016-10-04 12:06:19 -04:00
Toy Vano
9416ec73a4 feat: added incomplete buzzfeed extractor 2016-10-04 11:28:01 -04:00
Toy Vano
46e26c9b85 Merge branch 'feat-msn-extractor' 2016-10-03 17:51:32 -04:00
Toy Vano
c6c35bd237 feat: added incomplete yahoo extractor 2016-10-03 17:48:11 -04:00
Toy Vano
320c740676 feat: added incomplete msn extractor 2016-10-03 13:27:51 -04:00
Adam Pash
e3ee5e93bf chore: small doc fixes 2016-09-30 15:01:48 -04:00
Adam Pash
d786a7ae0c Merge pull request #5 from postlight/feat-wired-extractor 
feat: added wired custom extractor

AMAAAAAAZING!!!!
 2016-09-30 14:49:45 -04:00
Toy Vano
7ecc696248 feat: added wired custom extractor 2016-09-30 14:32:28 -04:00
Adam Pash
20b7c5a8b6 chore: fix a few typos/links 2016-09-30 12:46:46 -04:00
Adam Pash
173f885674 feat: custom parser + generator + detailed readme instructions 
Squashed commit of the following:

commit 02563daa67712c3679258ebebac60dfa9568dffb
Author: Adam Pash <adam.pash@gmail.com>
Date:   Fri Sep 30 12:25:44 2016 -0400

    updated readme, added newyorker parser for readme guide

commit 0ac613ef823efbffbf4cc9a89e5cb2489d1c4f6f
Author: Adam Pash <adam.pash@gmail.com>
Date:   Fri Sep 30 11:16:52 2016 -0400

    feat: updated parser so the saved fixture absolutizes urls

commit 85c7a2660b21f95c2205ca4a4378a7570687fed0
Author: Adam Pash <adam.pash@gmail.com>
Date:   Fri Sep 30 10:15:26 2016 -0400

    refactor: attribute selectors must be an array for custom extractors

commit f60f93d5d3d9b2f2d9ec6f28d27ae9dcf16ef01e
Author: Adam Pash <adam.pash@gmail.com>
Date:   Thu Sep 29 10:13:14 2016 -0400

    fix: whitelisting srcset and alt attributes

commit e31cb1f4e8a9fc9c3d9b20ef9f40ca6c8d6ad51a
Author: Adam Pash <adam.pash@gmail.com>
Date:   Thu Sep 29 09:44:21 2016 -0400

    some housekeeping for coverage tests

commit 39eafe420c776a1fe7f9fea634fb529a3ed75a71
Author: Adam Pash <adam.pash@gmail.com>
Date:   Wed Sep 28 17:52:08 2016 -0400

    fix: word count for multi-page articles

commit b04e0066b52f190481b1b604c64e3d0b1226ff02
Author: Adam Pash <adam.pash@gmail.com>
Date:   Thu Sep 22 10:40:23 2016 -0400

    major improvements to output

commit 3f3a880b63b47fe21953485da670b6e291ac60e5
Author: Adam Pash <adam.pash@gmail.com>
Date:   Wed Sep 21 17:27:53 2016 -0400

    updated test command

commit 14503426557a870755453572221d95c92cff4bd2
Author: Adam Pash <adam.pash@gmail.com>
Date:   Wed Sep 21 16:00:30 2016 -0400

    shortened generator command

commit 5ebd8343cd4b87b3f5787dab665bff0de96846e1
Author: Adam Pash <adam.pash@gmail.com>
Date:   Wed Sep 21 15:59:14 2016 -0400

    feat: can disable fallback to generic parser (this will be useful for testing custom parsers)
 2016-09-30 12:26:25 -04:00
Adam Pash
39a3c0690d chore: readme improvement 2016-09-21 15:00:00 -04:00
Adam Pash
ef047107ea feat: content cleaner still runs, but can disable some cleaners 2016-09-21 14:38:03 -04:00
Adam Pash
75b1880f01 chore: cleaned up unused files, slight reorg 2016-09-20 11:08:02 -04:00
Adam Pash
ad42055f8f feat: switched test framework to jest 2016-09-20 10:52:16 -04:00
Adam Pash
8f42e119e8 feat: generator for custom parsers and some documentation 
Squashed commit of the following:

commit deaf9e60d031d9ee06e74b8c0895495b187032a5
Author: Adam Pash <adam.pash@gmail.com>
Date:   Tue Sep 20 10:31:09 2016 -0400

    chore: README for custom parsers

commit a8e8ad633e0d1576a52dbc90ce31b98fb2ec21ee
Author: Adam Pash <adam.pash@gmail.com>
Date:   Mon Sep 19 23:36:09 2016 -0400

    draft of readme

commit 4f0f463f821465c282ce006378e5d55f8f41df5f
Author: Adam Pash <adam.pash@gmail.com>
Date:   Mon Sep 19 17:56:34 2016 -0400

    custom extractor used to build basic parser for theatlantic

commit c5562a3cede41f56c4e723dcfa1181b49dcaae4d
Author: Adam Pash <adam.pash@gmail.com>
Date:   Mon Sep 19 17:20:13 2016 -0400

    pre-commit to test custom parser generator

commit 7d50d5b7ab780b79fae38afcb87a7d1da5d139b2
Author: Adam Pash <adam.pash@gmail.com>
Date:   Mon Sep 19 17:19:55 2016 -0400

    feat: added nytimes parser

commit 58b8d83a56927177984ddfdf70830bc4f328f200
Author: Adam Pash <adam.pash@gmail.com>
Date:   Mon Sep 19 17:17:28 2016 -0400

    feat: can do fuzzy search or go straight to file

commit c99add753723a8e2ac64d51d7379ac8e23125526
Author: Adam Pash <adam.pash@gmail.com>
Date:   Mon Sep 19 10:52:26 2016 -0400

    refactored export for custom extractors for easier renames

commit 22563413669651bb497f1bb2a92085b71f2ae324
Author: Adam Pash <adam.pash@gmail.com>
Date:   Fri Sep 16 17:36:13 2016 -0400

    feat: custom extractor generation in place

commit 2285a29908a7f82a5de3c81f6b2b902ddec9bdaa
Author: Adam Pash <adam.pash@gmail.com>
Date:   Fri Sep 16 16:42:20 2016 -0400

    good progress
 2016-09-20 10:37:03 -04:00
Adam Pash
c4f06c7ebc fix: .babelrc was still referencing iris 2016-09-19 13:56:19 -04:00
Adam Pash
f58ccec7aa fix: including babel-runtime as a bandaid for polyfill error 2016-09-19 11:24:43 -04:00
Adam Pash
59fb4c4974 fix: using transform-runtime to avoid babel-polyfill conflicts when used 
in external code
 2016-09-19 11:04:35 -04:00
Adam Pash
b4fbc5b581 chore: barebones readme 2016-09-16 15:11:46 -04:00
Adam Pash
f439f9d2cf refactor: slightly better preview 2016-09-16 15:10:14 -04:00
Adam Pash
7ade83692a feat: improve wikipedia parser 2016-09-16 13:59:05 -04:00
Adam Pash
1597fc79c2 feat: added preview script to test urls on-the-fly 2016-09-16 13:58:41 -04:00
Adam Pash
2ae2dba690 chore: renamed iris to mercury 2016-09-16 13:26:37 -04:00
Adam Pash
005ba47f6f fix: wikpedia transform only grabs one image from .infobox 2016-09-16 13:17:21 -04:00
Adam Pash
44d3a547b2 fix: added dist back to git 2016-09-16 12:56:08 -04:00
Adam Pash
8dc6042dc9 build for comparisons 2016-09-16 11:35:59 -04:00
Adam Pash
9fa502c1f0 feat: test runner takes args for wildcard search on individual test for easier testing 2016-09-16 11:31:34 -04:00
Adam Pash
cbd0636dcf chore: cleaned up python and other unneeded comments 2016-09-16 11:21:23 -04:00
Adam Pash
bf13b38a9b feat: some basic error handling for bad urls 2016-09-15 17:41:29 -04:00
Adam Pash
9f0c075de4 Merge pull request #3 from postlight/fix-date-not-local 
fix: some improvements to date parsing. punting on localization issues
 2016-09-15 16:59:31 -04:00
Adam Pash
ffaf7db0f1 fix: some improvements to date parsing. punting on localization issues 2016-09-15 16:57:14 -04:00
Adam Pash
396313aeae feat: added twitter custom extractor 
Squashed commit of the following:

commit 8116f14364869b72a8afabfcb44b2ac154caed96
Author: Adam Pash <adam.pash@gmail.com>
Date:   Thu Sep 15 16:27:27 2016 -0400

    feat: added twitter custom extractor

commit e478eb1b0bcdcb65fdd5fa64e37be92b6defd702
Author: Adam Pash <adam.pash@gmail.com>
Date:   Thu Sep 15 16:22:54 2016 -0400

    fix: made custom extractors and cleaners adhere to underscore keys
 2016-09-15 16:27:46 -04:00
Adam Pash
d60d396c98 feat: added text direction to response 2016-09-15 15:08:04 -04:00
Adam Pash
f0f216c7b9 feat: add option to allow custom extractors to skip default cleaners 2016-09-15 14:50:51 -04:00
Adam Pash
97a0728ecf test: added sanity test for get-extractor 2016-09-15 14:33:06 -04:00
Adam Pash
7c375aded7 chore: cleanup 2016-09-15 14:29:14 -04:00
Adam Pash
4cdc4165d6 fix: encodeURI before fetching 2016-09-15 14:25:22 -04:00
Adam Pash
1343469b6c fix: explicit/better decoding of gzipped content 2016-09-15 12:39:54 -04:00
Adam Pash
7638c15077 push new build for testing 2016-09-15 12:22:38 -04:00
Adam Pash
c338098f21 refactor: renamed child to sibling for clarity 2016-09-15 12:19:33 -04:00
Adam Pash
6263e505d5 fix: handling case where node.get(0) returns null 2016-09-15 12:17:25 -04:00
Adam Pash
2bf274114f chore: disable camelcase for linting 2016-09-14 16:00:36 -04:00