Adam Pash
|
e3ee5e93bf
|
chore: small doc fixes
|
8 years ago |
Adam Pash
|
d786a7ae0c
|
Merge pull request #5 from postlight/feat-wired-extractor
feat: added wired custom extractor
AMAAAAAAZING!!!!
|
8 years ago |
Toy Vano
|
7ecc696248
|
feat: added wired custom extractor
|
8 years ago |
Adam Pash
|
20b7c5a8b6
|
chore: fix a few typos/links
|
8 years ago |
Adam Pash
|
173f885674
|
feat: custom parser + generator + detailed readme instructions
Squashed commit of the following:
commit 02563daa67712c3679258ebebac60dfa9568dffb
Author: Adam Pash <adam.pash@gmail.com>
Date: Fri Sep 30 12:25:44 2016 -0400
updated readme, added newyorker parser for readme guide
commit 0ac613ef823efbffbf4cc9a89e5cb2489d1c4f6f
Author: Adam Pash <adam.pash@gmail.com>
Date: Fri Sep 30 11:16:52 2016 -0400
feat: updated parser so the saved fixture absolutizes urls
commit 85c7a2660b21f95c2205ca4a4378a7570687fed0
Author: Adam Pash <adam.pash@gmail.com>
Date: Fri Sep 30 10:15:26 2016 -0400
refactor: attribute selectors must be an array for custom extractors
commit f60f93d5d3d9b2f2d9ec6f28d27ae9dcf16ef01e
Author: Adam Pash <adam.pash@gmail.com>
Date: Thu Sep 29 10:13:14 2016 -0400
fix: whitelisting srcset and alt attributes
commit e31cb1f4e8a9fc9c3d9b20ef9f40ca6c8d6ad51a
Author: Adam Pash <adam.pash@gmail.com>
Date: Thu Sep 29 09:44:21 2016 -0400
some housekeeping for coverage tests
commit 39eafe420c776a1fe7f9fea634fb529a3ed75a71
Author: Adam Pash <adam.pash@gmail.com>
Date: Wed Sep 28 17:52:08 2016 -0400
fix: word count for multi-page articles
commit b04e0066b52f190481b1b604c64e3d0b1226ff02
Author: Adam Pash <adam.pash@gmail.com>
Date: Thu Sep 22 10:40:23 2016 -0400
major improvements to output
commit 3f3a880b63b47fe21953485da670b6e291ac60e5
Author: Adam Pash <adam.pash@gmail.com>
Date: Wed Sep 21 17:27:53 2016 -0400
updated test command
commit 14503426557a870755453572221d95c92cff4bd2
Author: Adam Pash <adam.pash@gmail.com>
Date: Wed Sep 21 16:00:30 2016 -0400
shortened generator command
commit 5ebd8343cd4b87b3f5787dab665bff0de96846e1
Author: Adam Pash <adam.pash@gmail.com>
Date: Wed Sep 21 15:59:14 2016 -0400
feat: can disable fallback to generic parser (this will be useful for testing custom parsers)
|
8 years ago |
Adam Pash
|
39a3c0690d
|
chore: readme improvement
|
8 years ago |
Adam Pash
|
ef047107ea
|
feat: content cleaner still runs, but can disable some cleaners
|
8 years ago |
Adam Pash
|
75b1880f01
|
chore: cleaned up unused files, slight reorg
|
8 years ago |
Adam Pash
|
ad42055f8f
|
feat: switched test framework to jest
|
8 years ago |
Adam Pash
|
8f42e119e8
|
feat: generator for custom parsers and some documentation
Squashed commit of the following:
commit deaf9e60d031d9ee06e74b8c0895495b187032a5
Author: Adam Pash <adam.pash@gmail.com>
Date: Tue Sep 20 10:31:09 2016 -0400
chore: README for custom parsers
commit a8e8ad633e0d1576a52dbc90ce31b98fb2ec21ee
Author: Adam Pash <adam.pash@gmail.com>
Date: Mon Sep 19 23:36:09 2016 -0400
draft of readme
commit 4f0f463f821465c282ce006378e5d55f8f41df5f
Author: Adam Pash <adam.pash@gmail.com>
Date: Mon Sep 19 17:56:34 2016 -0400
custom extractor used to build basic parser for theatlantic
commit c5562a3cede41f56c4e723dcfa1181b49dcaae4d
Author: Adam Pash <adam.pash@gmail.com>
Date: Mon Sep 19 17:20:13 2016 -0400
pre-commit to test custom parser generator
commit 7d50d5b7ab780b79fae38afcb87a7d1da5d139b2
Author: Adam Pash <adam.pash@gmail.com>
Date: Mon Sep 19 17:19:55 2016 -0400
feat: added nytimes parser
commit 58b8d83a56927177984ddfdf70830bc4f328f200
Author: Adam Pash <adam.pash@gmail.com>
Date: Mon Sep 19 17:17:28 2016 -0400
feat: can do fuzzy search or go straight to file
commit c99add753723a8e2ac64d51d7379ac8e23125526
Author: Adam Pash <adam.pash@gmail.com>
Date: Mon Sep 19 10:52:26 2016 -0400
refactored export for custom extractors for easier renames
commit 22563413669651bb497f1bb2a92085b71f2ae324
Author: Adam Pash <adam.pash@gmail.com>
Date: Fri Sep 16 17:36:13 2016 -0400
feat: custom extractor generation in place
commit 2285a29908a7f82a5de3c81f6b2b902ddec9bdaa
Author: Adam Pash <adam.pash@gmail.com>
Date: Fri Sep 16 16:42:20 2016 -0400
good progress
|
8 years ago |
Adam Pash
|
c4f06c7ebc
|
fix: .babelrc was still referencing iris
|
8 years ago |
Adam Pash
|
f58ccec7aa
|
fix: including babel-runtime as a bandaid for polyfill error
|
8 years ago |
Adam Pash
|
59fb4c4974
|
fix: using transform-runtime to avoid babel-polyfill conflicts when used
in external code
|
8 years ago |
Adam Pash
|
b4fbc5b581
|
chore: barebones readme
|
8 years ago |
Adam Pash
|
f439f9d2cf
|
refactor: slightly better preview
|
8 years ago |
Adam Pash
|
7ade83692a
|
feat: improve wikipedia parser
|
8 years ago |
Adam Pash
|
1597fc79c2
|
feat: added preview script to test urls on-the-fly
|
8 years ago |
Adam Pash
|
2ae2dba690
|
chore: renamed iris to mercury
|
8 years ago |
Adam Pash
|
005ba47f6f
|
fix: wikpedia transform only grabs one image from .infobox
|
8 years ago |
Adam Pash
|
44d3a547b2
|
fix: added dist back to git
|
8 years ago |
Adam Pash
|
8dc6042dc9
|
build for comparisons
|
8 years ago |
Adam Pash
|
9fa502c1f0
|
feat: test runner takes args for wildcard search on individual test for easier testing
|
8 years ago |
Adam Pash
|
cbd0636dcf
|
chore: cleaned up python and other unneeded comments
|
8 years ago |
Adam Pash
|
bf13b38a9b
|
feat: some basic error handling for bad urls
|
8 years ago |
Adam Pash
|
9f0c075de4
|
Merge pull request #3 from postlight/fix-date-not-local
fix: some improvements to date parsing. punting on localization issues
|
8 years ago |
Adam Pash
|
ffaf7db0f1
|
fix: some improvements to date parsing. punting on localization issues
|
8 years ago |
Adam Pash
|
396313aeae
|
feat: added twitter custom extractor
Squashed commit of the following:
commit 8116f14364869b72a8afabfcb44b2ac154caed96
Author: Adam Pash <adam.pash@gmail.com>
Date: Thu Sep 15 16:27:27 2016 -0400
feat: added twitter custom extractor
commit e478eb1b0bcdcb65fdd5fa64e37be92b6defd702
Author: Adam Pash <adam.pash@gmail.com>
Date: Thu Sep 15 16:22:54 2016 -0400
fix: made custom extractors and cleaners adhere to underscore keys
|
8 years ago |
Adam Pash
|
d60d396c98
|
feat: added text direction to response
|
8 years ago |
Adam Pash
|
f0f216c7b9
|
feat: add option to allow custom extractors to skip default cleaners
|
8 years ago |
Adam Pash
|
97a0728ecf
|
test: added sanity test for get-extractor
|
8 years ago |
Adam Pash
|
7c375aded7
|
chore: cleanup
|
8 years ago |
Adam Pash
|
4cdc4165d6
|
fix: encodeURI before fetching
|
8 years ago |
Adam Pash
|
1343469b6c
|
fix: explicit/better decoding of gzipped content
|
8 years ago |
Adam Pash
|
7638c15077
|
push new build for testing
|
8 years ago |
Adam Pash
|
c338098f21
|
refactor: renamed child to sibling for clarity
|
8 years ago |
Adam Pash
|
6263e505d5
|
fix: handling case where node.get(0) returns null
|
8 years ago |
Adam Pash
|
2bf274114f
|
chore: disable camelcase for linting
|
8 years ago |
Adam Pash
|
3b36a33e36
|
chore: change result keys to match python api
|
8 years ago |
Adam Pash
|
cc060b794d
|
fix: wordcount calling excerpt
|
8 years ago |
Adam Pash
|
7fc1f7f6bb
|
checking in dist
|
8 years ago |
Adam Pash
|
c76435ce62
|
updated name in package.json
|
8 years ago |
Adam Pash
|
f1cff0b435
|
chore: removed TODO.md
|
8 years ago |
Adam Pash
|
daa9266182
|
feat: generic extractor for word count
Squashed commit of the following:
commit 0aba26ef9efba71a72c76fa351a9037e97fc1e9e
Author: Adam Pash <adam.pash@gmail.com>
Date: Wed Sep 14 14:56:45 2016 -0400
fix: normalizeSpaces regex fix broke a test
commit 07d60c1c8c6599d6c94d92e5a70649c28d03d6ea
Author: Adam Pash <adam.pash@gmail.com>
Date: Wed Sep 14 14:52:41 2016 -0400
feat: generic extractor for word count
|
8 years ago |
Adam Pash
|
76df30e303
|
chore: cleanup
|
8 years ago |
Adam Pash
|
b3481a2c45
|
feat: generic excerpt extraction
|
8 years ago |
Adam Pash
|
457075889d
|
fix: selection should not be empty
|
8 years ago |
Adam Pash
|
81ed4f00ed
|
feat: improve nymag.com extractor to grab deks from features
|
8 years ago |
Adam Pash
|
21f444367f
|
feat: added page counts
|
8 years ago |
Adam Pash
|
f3a5d0ecca
|
feat: added domain and url extractor (using same extractor)
commit 43ab423d575cd15cc55041fb3fe2f21ffdd7adff
Author: Adam Pash <adam.pash@gmail.com>
Date: Wed Sep 14 11:57:25 2016 -0400
|
8 years ago |
Adam Pash
|
67296691c2
|
refactor: page collection
|
8 years ago |