Mercury Parser - Extracting content from chaos #parser #url #html #extractor
Go to file
Marc Esso 5ad02b6f28
docs: add license files (#217)
* docs: add license files

* docs: license sentence in readme

* docs: change contributing section sentence in readme.md

* docs: small grammar mistake in README.md
2019-01-24 12:10:04 +02:00
.circleci deps: upgrade (#218) 2019-01-23 09:54:42 -08:00
.github docs: PR and Issue templates (#211) 2019-01-24 09:36:01 +02:00
dist deps: upgrade (#218) 2019-01-23 09:54:42 -08:00
fixtures fix: failing fetchResource test (#187) 2018-12-20 10:06:16 -08:00
scripts feat: update package.json scripts to work on windows (#216) 2019-01-24 11:27:01 +02:00
src docs: add install build and test guide (#215) 2019-01-24 11:15:23 +02:00
.agignore chore: renamed iris to mercury 2016-09-16 13:26:37 -04:00
.all-contributorsrc fix: increased avatar size 2016-10-26 15:44:49 -07:00
.babelrc deps: upgrade (#218) 2019-01-23 09:54:42 -08:00
.eslintignore Feat: browser support (#19) 2016-11-21 14:17:06 -08:00
.eslintrc deps: upgrade (#218) 2019-01-23 09:54:42 -08:00
.gitattributes fix: i put a bad comment in .gitattributes (#125) 2017-01-27 10:26:03 -08:00
.gitignore dx: comment on PRs when fixtures have been added/changed (#192) 2019-01-11 13:58:28 -08:00
.nvmrc chore: update node and some deps (#209) 2019-01-16 16:03:36 -08:00
.prettierrc chore: update node and some deps (#209) 2019-01-16 16:03:36 -08:00
.remarkrc feat: add remarklint for md docs (#213) 2019-01-24 11:09:18 +02:00
appveyor.yml Feat: improving ci (#16) 2016-10-28 09:16:21 -07:00
CHANGELOG.md release: 1.0.13 (#183) 2018-10-12 15:01:42 -07:00
CODE_OF_CONDUCT.md docs: add code of conduct (#204) 2019-01-23 10:30:39 +02:00
CONTRIBUTING.md docs: add contributing.md (#210) 2019-01-24 10:27:30 +02:00
karma.conf.js deps: upgrade (#218) 2019-01-23 09:54:42 -08:00
LICENSE-APACHE docs: add license files (#217) 2019-01-24 12:10:04 +02:00
LICENSE-MIT docs: add license files (#217) 2019-01-24 12:10:04 +02:00
NOTES.md feat: generator for custom parsers and some documentation 2016-09-20 10:37:03 -04:00
package.json feat: update package.json scripts to work on windows (#216) 2019-01-24 11:27:01 +02:00
preview feat: preview with optional rebuild (#36) 2016-11-30 16:37:42 -08:00
README.md docs: add license files (#217) 2019-01-24 12:10:04 +02:00
RELEASE.md docs: document release process (#186) 2018-12-20 09:30:47 -08:00
rollup.config.js deps: upgrade (#218) 2019-01-23 09:54:42 -08:00
rollup.config.web.js deps: upgrade (#218) 2019-01-23 09:54:42 -08:00
score-move chore: refactored and linted 2016-09-13 15:22:27 -04:00
yarn.lock feat: add remarklint for md docs (#213) 2019-01-24 11:09:18 +02:00

Mercury Parser - Extracting content from chaos

CircleCI Build status

The Mercury Parser extracts the bits that humans care about from any URL you give it. That includes article content, titles, authors, published dates, excerpts, lead images, and more.

The Mercury Parser module powers the Mercury Parser API, a free API from Postlight that puts all of this information one API request away..

How? Like this.

Installation

yarn add mercury-parser

Usage

import Mercury from 'mercury-parser';

Mercury.parse(url).then(result => console.log(result););

The result looks like this:

{
  "title": "Thunder (mascot)",
  "content": "<div><div><p>This is the content of the page!</div></div>",
  "author": "Wikipedia Contributors",
  "date_published": "2016-09-16T20:56:00.000Z",
  "lead_image_url": null,
  "dek": null,
  "next_page_url": null,
  "url": "https://en.wikipedia.org/wiki/Thunder_(mascot)",
  "domain": "en.wikipedia.org",
  "excerpt": "Thunder Thunder is the stage name for the horse who is the official live animal mascot for the Denver Broncos",
  "word_count": 4677,
  "direction": "ltr",
  "total_pages": 1,
  "rendered_pages": 1
}

If Mercury is unable to find a field, that field will return null.

License

Licensed under either of the below, at your preference:

Contributing

Unless it is explicitly stated otherwise, any contribution intentionally submitted for inclusion in the work, as defined in the Apache-2.0 license, shall be dual licensed as above without any additional terms or conditions.

Contributors

All Contributors


Adam Pash

📝 💻 📖 💡

Toy Vano

💻

Drew Bell

💻

Jeremy Mack

💻