You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
langchain/libs/langchain/langchain/document_loaders
Eugene Yurtsev f92006de3c
multiple: langchain 0.2 in master (#21191)
0.2rc 

migrations

- [x] Move memory
- [x] Move remaining retrievers
- [x] graph_qa chains
- [x] some dependency from evaluation code potentially on math utils
- [x] Move openapi chain from `langchain.chains.api.openapi` to
`langchain_community.chains.openapi`
- [x] Migrate `langchain.chains.ernie_functions` to
`langchain_community.chains.ernie_functions`
- [x] migrate `langchain/chains/llm_requests.py` to
`langchain_community.chains.llm_requests`
- [x] Moving `langchain_community.cross_enoders.base:BaseCrossEncoder`
->
`langchain_community.retrievers.document_compressors.cross_encoder:BaseCrossEncoder`
(namespace not ideal, but it needs to be moved to `langchain` to avoid
circular deps)
- [x] unit tests langchain -- add pytest.mark.community to some unit
tests that will stay in langchain
- [x] unit tests community -- move unit tests that depend on community
to community
- [x] mv integration tests that depend on community to community
- [x] mypy checks

Other todo

- [x] Make deprecation warnings not noisy (need to use warn deprecated
and check that things are implemented properly)
- [x] Update deprecation messages with timeline for code removal (likely
we actually won't be removing things until 0.4 release) -- will give
people more time to transition their code.
- [ ] Add information to deprecation warning to show users how to
migrate their code base using langchain-cli
- [ ] Remove any unnecessary requirements in langchain (e.g., is
SQLALchemy required?)

---------

Co-authored-by: Erick Friis <erick@langchain.dev>
3 weeks ago
..
blob_loaders multiple: langchain 0.2 in master (#21191) 3 weeks ago
parsers langchain[patch]: Update more code to use langchain community as an optional dependency (#21170) 4 weeks ago
__init__.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
acreom.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
airbyte.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
airbyte_json.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
airtable.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
apify_dataset.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
arcgis_loader.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
arxiv.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
assemblyai.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
async_html.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
azlyrics.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
azure_ai_data.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
azure_blob_storage_container.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
azure_blob_storage_file.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
baiducloud_bos_directory.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
baiducloud_bos_file.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
base.py langchain[patch]: replace deprecated imports with imports from langchain_core (#21033) 4 weeks ago
base_o365.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
bibtex.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
bigquery.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
bilibili.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
blackboard.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
blockchain.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
brave_search.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
browserless.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
chatgpt.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
chromium.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
college_confidential.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
concurrent.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
confluence.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
conllu.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
couchbase.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
csv_loader.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
cube_semantic.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
datadog_logs.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
dataframe.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
diffbot.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
directory.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
discord.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
docugami.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
docusaurus.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
dropbox.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
duckdb_loader.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
email.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
epub.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
etherscan.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
evernote.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
excel.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
facebook_chat.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
fauna.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
figma.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
gcs_directory.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
gcs_file.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
generic.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
geodataframe.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
git.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
gitbook.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
github.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
google_speech_to_text.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
googledrive.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
gutenberg.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
helpers.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
hn.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
html.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
html_bs.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
hugging_face_dataset.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
ifixit.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
image.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
image_captions.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
imsdb.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
iugu.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
joplin.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
json_loader.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
lakefs.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
larksuite.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
markdown.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
mastodon.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
max_compute.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
mediawikidump.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
merge.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
mhtml.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
modern_treasury.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
mongodb.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
news.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
notebook.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
notion.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
notiondb.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
nuclia.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
obs_directory.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
obs_file.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
obsidian.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
odt.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
onedrive.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
onedrive_file.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
onenote.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
open_city_data.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
org_mode.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
pdf.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
polars_dataframe.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
powerpoint.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
psychic.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
pubmed.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
pyspark_dataframe.py langchain[patch]: Update more code to use langchain community as an optional dependency (#21170) 4 weeks ago
python.py langchain[patch]: Update more code to use langchain community as an optional dependency (#21170) 4 weeks ago
quip.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
readthedocs.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
recursive_url_loader.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
reddit.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
roam.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
rocksetdb.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
rspace.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
rss.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
rst.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
rtf.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
s3_directory.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
s3_file.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
sharepoint.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
sitemap.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
slack_directory.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
snowflake_loader.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
spreedly.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
srt.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
stripe.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
telegram.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
tencent_cos_directory.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
tencent_cos_file.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
tensorflow_datasets.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
text.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
tomarkdown.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
toml.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
trello.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
tsv.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
twitter.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
unstructured.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
url.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
url_playwright.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
url_selenium.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
weather.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
web_base.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
whatsapp_chat.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
wikipedia.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
word_document.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
xml.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
xorbits.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago
youtube.py langchain[patch]: Migrate document loaders to use optional langchain community imports (#21095) 4 weeks ago