You cannot select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
19c7172d30
This one might have been a bit too tough for me. Notes: 1) I couldn’t find a date_published in this article 2) The dek was nested within the content. I found a selector, but I wasn’t sure how to return the content minus the dek, if that makes sense. 3) I didn’t see an image, so I didn’t bother trying to enter a selector. 4) The initial complaint on Zen desk: element labeled "Figure 1" is getting stripped out Unfortunately the custom parser doesn’t solve this issue. I am guessing I would need to do a transform… but I am not really clear on how to do transforms. Might need to sit down with someone to get a tutorial on this. :-) |
7 years ago | |
|---|---|---|
| dist | 7 years ago | |
| fixtures | 7 years ago | |
| scripts | 7 years ago | |
| src | 7 years ago | |
| .agignore | 8 years ago | |
| .all-contributorsrc | 8 years ago | |
| .babelrc | 8 years ago | |
| .eslintignore | 8 years ago | |
| .eslintrc | 8 years ago | |
| .gitattributes | 7 years ago | |
| .gitignore | 8 years ago | |
| CHANGELOG.md | 7 years ago | |
| NOTES.md | 8 years ago | |
| README.md | 8 years ago | |
| appveyor.yml | 8 years ago | |
| circle.yml | 8 years ago | |
| karma.conf.js | 8 years ago | |
| package.json | 7 years ago | |
| preview | 8 years ago | |
| rollup.config.js | 8 years ago | |
| rollup.config.web.js | 8 years ago | |
| score-move | 8 years ago | |
| yarn.lock | 8 years ago | |
README.md
Mercury Parser - Extracting content from chaos
The Mercury Parser extracts the bits that humans care about from any URL you give it. That includes article content, titles, authors, published dates, excerpts, lead images, and more.
The Mercury Parser module powers the Mercury Parser API, a free API from Postlight that puts all of this information one API request away..
How? Like this.
import Mercury from 'mercury-parser';
Mercury.parse(url).then(result => console.log(result););
The result looks like this:
{
"title": "Thunder (mascot)",
"content": "<div><div><p>This is the content of the page!</div></div>",
"author": "Wikipedia Contributors",
"date_published": "2016-09-16T20:56:00.000Z",
"lead_image_url": null,
"dek": null,
"next_page_url": null,
"url": "https://en.wikipedia.org/wiki/Thunder_(mascot)",
"domain": "en.wikipedia.org",
"excerpt": "Thunder Thunder is the stage name for the horse who is the official live animal mascot for the Denver Broncos",
"word_count": 4677,
"direction": "ltr",
"total_pages": 1,
"rendered_pages": 1
}
If Mercury is unable to find a field, that field will return null.
Contributing
If you'd like to write a custom parser for a site, here's how.
Contributors
 Adam Pash 📝 💻 📖 💡 |
 Toy Vano 💻 |
 Drew Bell 💻 |
 Jeremy Mack 💻 |
|---|