mirror of
https://github.com/hwchase17/langchain
synced 2024-10-29 17:07:25 +00:00
2ceb807da2
# Add PDF parser implementations This PR separates the data loading from the parsing for a number of existing PDF loaders. Parser tests have been designed to help encourage developers to create a consistent interface for parsing PDFs. This interface can be made more consistent in the future by adding information into the initializer on desired behavior with respect to splitting by page etc. This code is expected to be backwards compatible -- with the exception of a bug fix with pymupdf parser which was returning `bytes` in the page content rather than strings. Also changing the lazy parser method of document loader to return an Iterator rather than Iterable over documents. ## Before submitting <!-- If you're adding a new integration, include an integration test and an example notebook showing its use! --> ## Who can review? Community members can review the PR once tests pass. Tag maintainers/contributors who might be interested: @ <!-- For a quicker response, figure out the right person to tag with @ @hwchase17 - project lead Tracing / Callbacks - @agola11 Async - @agola11 DataLoader Abstractions - @eyurtsev LLM/Chat Wrappers - @hwchase17 - @agola11 Tools / Toolkits - @vowelparrot --> |
||
---|---|---|
.. | ||
parsers | ||
__init__.py | ||
test_arxiv.py | ||
test_bigquery.py | ||
test_bilibili.py | ||
test_blockchain.py | ||
test_bshtml.py | ||
test_confluence.py | ||
test_dataframe.py | ||
test_duckdb.py | ||
test_email.py | ||
test_facebook_chat.py | ||
test_figma.py | ||
test_gitbook.py | ||
test_ifixit.py | ||
test_json_loader.py | ||
test_modern_treasury.py | ||
test_pdf.py | ||
test_python.py | ||
test_sitemap.py | ||
test_slack.py | ||
test_spreedly.py | ||
test_stripe.py | ||
test_telegram.py | ||
test_url_playwright.py | ||
test_url.py | ||
test_whatsapp_chat.py |