mirror of
https://github.com/postlight/mercury-parser
synced 2024-10-31 03:20:40 +00:00
Mercury Parser - Extracting content from chaos #parser #url #html #extractor
3297ab079d
Bloomberg has several templates. I'm supporting three different templates here, but I'm not sure that this is complete by any means. It's also worth noting that SVGs don't make it through the parser terribly well for many reasons. One, for example, is that a lot of SVGs require custom CSS in order for them to make sense. I'm not sure this is something we can expect to address in the parser. |
||
|---|---|---|
| dist | ||
| fixtures | ||
| scripts | ||
| src | ||
| .agignore | ||
| .all-contributorsrc | ||
| .babelrc | ||
| .eslintignore | ||
| .eslintrc | ||
| .gitignore | ||
| appveyor.yml | ||
| CHANGELOG.md | ||
| circle.yml | ||
| karma.conf.js | ||
| NOTES.md | ||
| package.json | ||
| preview | ||
| README.md | ||
| rollup.config.js | ||
| rollup.config.web.js | ||
| score-move | ||
| yarn.lock | ||
Mercury Parser - Extracting content from chaos
The Mercury Parser extracts the bits that humans care about from any URL you give it. That includes article content, titles, authors, published dates, excerpts, lead images, and more.
The Mercury Parser module powers the Mercury Parser API, a free API from Postlight that puts all of this information one API request away..
How? Like this.
import Mercury from 'mercury-parser';
Mercury.parse(url).then(result => console.log(result););
The result looks like this:
{
"title": "Thunder (mascot)",
"content": "<div><div><p>This is the content of the page!</div></div>",
"author": "Wikipedia Contributors",
"date_published": "2016-09-16T20:56:00.000Z",
"lead_image_url": null,
"dek": null,
"next_page_url": null,
"url": "https://en.wikipedia.org/wiki/Thunder_(mascot)",
"domain": "en.wikipedia.org",
"excerpt": "Thunder Thunder is the stage name for the horse who is the official live animal mascot for the Denver Broncos",
"word_count": 4677,
"direction": "ltr",
"total_pages": 1,
"rendered_pages": 1
}
If Mercury is unable to find a field, that field will return null.
Contributing
If you'd like to write a custom parser for a site, here's how.
Contributors
 Adam Pash 📝 💻 📖 💡 |
 Toy Vano 💻 |
 Drew Bell 💻 |
 Jeremy Mack 💻 |
|---|