Commit Graph

344 Commits

Author SHA1 Message Date
Ralph Jbeily
f3f6e21fd8 fix: author and date published selectors (#189) 2019-01-25 11:28:43 -08:00
Ralph Jbeily
41efd361b5
docs: add code of conduct path (#224) 2019-01-25 09:56:56 +02:00
Toufic Mouallem
9bb0704048
fix: Create CI-specific script commands to allow for cross-platform linting (#223) 2019-01-24 18:36:28 +02:00
Jad Termsani
7deec71902
chore: remove forked packages (#214)
* chore: remove forked packages

* update dependencies
2019-01-24 13:12:49 +02:00
Jad Termsani
28cf41304c
fix: timezone comparison (#222)
* fix: use format() instead of toISOString()

* fix: timezone comparison
2019-01-24 12:16:31 +02:00
Marc Esso
5ad02b6f28
docs: add license files (#217)
* docs: add license files

* docs: license sentence in readme

* docs: change contributing section sentence in readme.md

* docs: small grammar mistake in README.md
2019-01-24 12:10:04 +02:00
Ralph Jbeily
46ce505727
feat: update package.json scripts to work on windows (#216)
* feat: add npm-run-all and fix test:web script

* fix: remove test script extra option

* fix: update lint script revert test script and remove npm-run-all

* chore: revert to linux/mac specific script

* fix: prepend node command so it works on windows
2019-01-24 11:27:01 +02:00
Ralph Jbeily
ca44ce3dd1
docs: add install build and test guide (#215)
* docs: add install build and test guide

* docs: remove install build and test guides

* docs: add installation guide
2019-01-24 11:15:23 +02:00
Ralph Jbeily
2e1e4d90c9
feat: add remarklint for md docs (#213)
* feat: add remarklint for md docs

* fix: remarkrc file and run linter on commit hook
2019-01-24 11:09:18 +02:00
Ralph Jbeily
0aa67ee3c0
docs: add contributing.md (#210)
* docs: add contributing.md

* docs: change email for answering questions and chatting

* docs: fix email md format

* docs: add markdown section

* docs: update testing and helpful links sections and cleanup others

* docs: replace lux with mercury

* docs: small adjustments on grammar, phrasing and table

* small tweaks
2019-01-24 10:27:30 +02:00
Marc Esso
1b062c9303
docs: PR and Issue templates (#211)
* feat: add pr and issue template files

* fix: add additional sections to issue template

* fix: text grammar

* docs: remove possible implementation section from issue template

* fix: prettier wrong list formatting

* small adjustments
2019-01-24 09:36:01 +02:00
Adam Pash
76d333f0be
deps: upgrade (#218) 2019-01-23 09:54:42 -08:00
Jad Termsani
438d495f3e
docs: add code of conduct (#204)
* docs: add code of conduct

* docs: modify the code of conduct
2019-01-23 10:30:39 +02:00
George Haddad
56badb51f5
dx: remove unnec comments in source (#205)
* dx: remove commented code and obvious comments that can be looked up

* dx: remove commented out eslint options

* dx: remove commented out code

* dx: remove commented out code

* dx: remove commented out code

* dx: remove test block as all its code was commented out

* dx: remove commented out code

* dx: remove commented out code

* dx: remove commented out code

* dx: remove regex example comments

* dx: remove commented out code

* dx: remove commented out code

* dx: remove commented out import

* dx: remove commented out code

* dx: remove commented out code

* dx: remove commented out code

* dx: remove commented out code

* dx: remove commented out code

* dx: remove commented out code

* dx: remove commented out code

* dx: remove commented out code

* dx: remove commented out code

* dx: remove commented out code

* dx: remove commented out code

* chore: remove empty files

* chore: re-prettier code that may have missed it

* added back nec comments
2019-01-21 11:53:50 +02:00
Adam Pash
e2dbd08ae7
fix: pre-commit hook on js (#212) 2019-01-17 09:15:31 -08:00
Adam Pash
e4b057f9ea
chore: update node and some deps (#209)
* chore: update .nvmrc

* added prettier and pre-commit hooks

* update docker image to new node

* add karma-cli to get web tests working

* explictly install karma... seems to fix problem

* remove pre-built phantomjs

* swap install order
2019-01-16 16:03:36 -08:00
Adam Pash
78adb2c2a0
fix: auto-pr (#199) 2019-01-15 15:58:17 -08:00
Adam Pash
c643666c88
dx: automate fixture updates (#197) 2019-01-15 15:41:18 -08:00
Adam Pash
bc23b8b7ea
dx: one-line comment links (#195) 2019-01-14 15:01:46 -08:00
Adam Pash
c0676423be
dx: add image to preview and link to original article (#194) 2019-01-14 11:34:34 -08:00
Adam Pash
ff144952b9
dx: test/finish bot preview 2019-01-14 11:18:32 -08:00
Adam Pash
d35f7bd5bf
dx: comment on PRs when fixtures have been added/changed (#192)
The goal here is to provide some sort of relatively easy preview for the
PR reviewer to see if the fixture looks good, if the parsing is working,
and to make suggestions easily.
2019-01-11 13:58:28 -08:00
Adam Pash
96640e3564
fix: failing fetchResource test (#187)
I think was a fixture problem
2018-12-20 10:06:16 -08:00
Adam Pash
4478338046
docs: document release process (#186) 2018-12-20 09:30:47 -08:00
Adam Pash
a7fd0e8dda
dx: add nvmrc file (#185)
The node version should not be higher than the node version we're using
on AWS with the Mercury Parser API
2018-12-20 09:13:27 -08:00
Adam Pash
d850177b68
docs: Update README.md (#184) 2018-12-20 09:04:01 -08:00
Adam Pash
fd6c9d4fa3
release: 1.0.13 (#183) 2018-10-12 15:01:42 -07:00
Adam Pash
0c15e9aad3
chore: update circle config.yml to 2.0 (#182) 2018-10-12 14:17:11 -07:00
Adam Pash
5663660f76
fix: nytimes custom parser title selector (#181)
* fix: nytimes custom parser title selector

* upgrade node version

* circle ci tweak
2018-10-12 13:39:41 -07:00
Adam Pash
7fcd9b62eb release: 1.0.12 (#173) 2017-04-10 16:10:52 -07:00
Jeremy Mack
5fcea1c5c3 fix: PARSING_NODE undefined (#172)
* fix: PARSING_NODE undefined

* chore: remove unused cleanup function/call
2017-04-10 15:55:21 -07:00
Adam Pash
a51cc81c27 release: 1.0.11 (#171) 2017-04-10 14:57:32 -07:00
Jeremy Mack
e92e798880 fix: viewport tags leaking to parent page (#170)
* fix: scrub meta viewport tags

They leak to the parent page when using the web version of Mercury
Parser.

* chore: build

* fix: keep DOM in memory to avoid conflicts
2017-04-10 14:35:23 -07:00
Adam Pash
86d6bd1dc1 release: 1.0.10 (#169) 2017-03-24 15:24:06 -07:00
Adam Pash
b8aa87c777 feat: improve wh parser (#168) 2017-03-24 14:41:40 -07:00
Adam Pash
e56e8e24cd release: 1.0.9 (#167) 2017-03-23 13:39:46 -07:00
Adam Pash
61f0f4e1af fix: kept elements being removed (#166)
Elements marked to keep were removeable under specific circumstances.
This PR fixes these edge cases.
2017-03-23 13:16:21 -07:00
Adam Pash
5741910fdc docs: update changelog (#165) 2017-03-22 14:47:20 -07:00
Adam Pash
321c087be6 release: 1.0.8 (#164) 2017-03-22 14:08:22 -07:00
Adam Pash
453419de72 feat: improve wh.gov parser (#163)
* feat: support youtube-nocookie domain

* feat: updated wh.gov parser to support speeches
2017-03-22 13:16:54 -07:00
Adam Pash
e267d57d78 release: 1.0.7 (#160) 2017-03-15 09:16:04 -07:00
Janet
f13bb721f6 feat: prospect magazine parser (#147)
* feat: prospect magazine parser

Couldn’t find a way to parse the date but I think it’s good otherwise.

* fix: pulls date

* fix: add timezone

* fix: generalize
2017-03-14 18:34:40 -04:00
Kevin Ngao
1b28713cf5 feat: fool.com parser (#158)
* feat: add fool.com custom parser
2017-03-14 18:04:19 -04:00
Janet
c18959779d feat: forward.com parser (#144)
* feat: forward.com parser

LGTM although image didn’t show up in preview

* feat: also pull imge into content

* fix: generalize selectors

* fix: generalize selector
2017-03-14 17:53:23 -04:00
Janet
50e548bac2 feat: qdaily parser (#146)
* feat: qdaily parser

Firstly — I accidentally tried to generate the parser on the master
branch, and I’m not sure where it is, maybe floating in the nether
world.

On to the parser — this one was a bit tricky because things were in
Chinese! The content appears to be parsing (as seen in preview) but
it’s not passing the test. I noticed the second “ ‘ “ mark isn’t
appearing on the parser side.

Additionally, some of the lazy loading images aren’t appearing in the
preview (I cleaned the wrong lazy load images that appeared), so
someone will probably have to work on that (I don’t know how to do
transforms yet).

* fix tests

* fix: selector generalization
2017-03-14 17:37:53 -04:00
Silas Burton
51a4d1d12f feat: newrepublic parser shows image on page (#159) 2017-03-14 14:07:45 -04:00
Silas Burton
11382ce651 Feat: Slate extractor (#153)
* feat: slate extractor

* fix: generalize selectors

* fix: add Slate timezone
2017-03-13 17:44:04 -04:00
Silas Burton
5acaa6ab56 feat: ici.radio-canada.ca extractor (#156)
* feat: ici.radio-canada.ca extractor

* fix: add timezone
2017-03-13 17:23:20 -04:00
Silas Burton
4509b341e6 feat: better cleanup of atlantic articles (#157) 2017-03-13 17:14:58 -04:00
Kevin Ngao
f2e3f055c2 Fixes an issue with encoding (#154)
* fix: fixes an issue with encoding on the fetch level
2017-03-10 17:40:31 -05:00