You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
langchain/libs/community/langchain_community/document_loaders
Chip Davis 806d4ae48f
community[patch]: fixed multithreading returning List[List[Documents]] instead of List[Documents] (#20230)
Description: When multithreading is set to True and using the
DirectoryLoader, there was a bug that caused the return type to be a
double nested list. This resulted in other places upstream not being
able to utilize the from_documents method as it was no longer a
`List[Documents]` it was a `List[List[Documents]]`. The change made was
to just loop through the `future.result()` and yield every item.
Issue: #20093
Dependencies: N/A
Twitter handle: N/A
6 months ago
..
blob_loaders community[patch]: speed up import times in the community package (#18928) 7 months ago
parsers community: Add PHP language parser to document_loaders (#19850) 6 months ago
__init__.py community[minor]: added missed class to __all__ (#19888) 6 months ago
acreom.py community: better support of pathlib paths in document loaders (#18396) 6 months ago
airbyte.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
airbyte_json.py community: better support of pathlib paths in document loaders (#18396) 6 months ago
airtable.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
apify_dataset.py
arcgis_loader.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
arxiv.py community[minor]: Implement lazy_load() for ArxivLoader (#18664) 7 months ago
assemblyai.py community: better support of pathlib paths in document loaders (#18396) 6 months ago
astradb.py community[patch]: Use langchain-astradb for AstraDB doc loader (#19071) 7 months ago
async_html.py
athena.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
azlyrics.py
azure_ai_data.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
azure_blob_storage_container.py community[patch]: type ignore fixes (#18395) 7 months ago
azure_blob_storage_file.py
baiducloud_bos_directory.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
baiducloud_bos_file.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
base.py core: Move document loader interfaces to core (#17723) 7 months ago
base_o365.py
bibtex.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
bigquery.py deprecating integrations moved to langchain_google_community (#19841) 6 months ago
bilibili.py community[patch]: fix bugs for bilibili Loader (#18036) 6 months ago
blackboard.py community[patch]: type ignore fixes (#18395) 7 months ago
blockchain.py
brave_search.py
browserless.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
cassandra.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
chatgpt.py
chm.py community[patch]: docstrings (#16810) 8 months ago
chromium.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
college_confidential.py
concurrent.py
confluence.py community[patch]: expanding version in confluence loader (#19324) 6 months ago
conllu.py community: better support of pathlib paths in document loaders (#18396) 6 months ago
couchbase.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
csv_loader.py community: better support of pathlib paths in document loaders (#18396) 6 months ago
cube_semantic.py community[patch]: Implement lazy_load() for CubeSemanticLoader (#18535) 7 months ago
datadog_logs.py
dataframe.py community[patch]: support modin document loader (#18866) 7 months ago
diffbot.py
directory.py community[patch]: fixed multithreading returning List[List[Documents]] instead of List[Documents] (#20230) 6 months ago
discord.py
doc_intelligence.py community[patch]: Microsoft Azure Document Intelligence updates (#16932) 6 months ago
docugami.py deprecate community docugami loader (#19230) 7 months ago
docusaurus.py
dropbox.py infra: add print rule to ruff (#16221) 8 months ago
duckdb_loader.py
email.py community: better support of pathlib paths in document loaders (#18396) 6 months ago
epub.py
etherscan.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
evernote.py community: better support of pathlib paths in document loaders (#18396) 6 months ago
excel.py community: better support of pathlib paths in document loaders (#18396) 6 months ago
facebook_chat.py community: better support of pathlib paths in document loaders (#18396) 6 months ago
fauna.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
figma.py
gcs_directory.py community[patch]: GCSDirectoryLoader bugfix (#20005) 6 months ago
gcs_file.py deprecating integrations moved to langchain_google_community (#19841) 6 months ago
generic.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
geodataframe.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
git.py Merge pull request #18539 7 months ago
gitbook.py community[minor]: Implement lazy_load() for GitbookLoader (#18670) 7 months ago
github.py community: Implement lazy_load() for GithubFileLoader (#18584) 7 months ago
google_speech_to_text.py deprecating integrations moved to langchain_google_community (#19841) 6 months ago
googledrive.py deprecating integrations moved to langchain_google_community (#19841) 6 months ago
gutenberg.py
helpers.py community: better support of pathlib paths in document loaders (#18396) 6 months ago
hn.py
html.py
html_bs.py community: better support of pathlib paths in document loaders (#18396) 6 months ago
hugging_face_dataset.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
hugging_face_model.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
ifixit.py
image.py
image_captions.py community: better support of pathlib paths in document loaders (#18396) 6 months ago
imsdb.py
iugu.py
joplin.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
json_loader.py community: Implement lazy_load() for JSONLoader (#18643) 7 months ago
lakefs.py
larksuite.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
llmsherpa.py community[minor]: add support for llmsherpa (#19741) 6 months ago
markdown.py corrected outdated link (#15053) 9 months ago
mastodon.py Merge pull request #18671 7 months ago
max_compute.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
mediawikidump.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
merge.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
mhtml.py community: better support of pathlib paths in document loaders (#18396) 6 months ago
modern_treasury.py
mongodb.py community[minor]: added a feature to filter documents in Mongoloader (#18253) 7 months ago
news.py
notebook.py community[patch]: add NotebookLoader unit test (#17721) 6 months ago
notion.py community: better support of pathlib paths in document loaders (#18396) 6 months ago
notiondb.py community[patch]: Fix NotionDBLoader 400 Error by conditionally adding filter parameter (#19075) 7 months ago
nuclia.py infra: add print rule to ruff (#16221) 8 months ago
obs_directory.py
obs_file.py
obsidian.py community: better support of pathlib paths in document loaders (#18396) 6 months ago
odt.py community: better support of pathlib paths in document loaders (#18396) 6 months ago
onedrive.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
onedrive_file.py
onenote.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
open_city_data.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
oracleadb_loader.py community[minor]: add oracle autonomous database doc loader integration (#19536) 6 months ago
org_mode.py community: better support of pathlib paths in document loaders (#18396) 6 months ago
pdf.py community[patch]: Add explicit error message to Bedrock error output. (#17328) 6 months ago
pebblo.py community[minor]: Add support for Pebblo cloud_api_key in PebbloSafeLoader (#19855) 6 months ago
polars_dataframe.py
powerpoint.py
psychic.py Merge pull request #18656 7 months ago
pubmed.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
pyspark_dataframe.py
python.py community: better support of pathlib paths in document loaders (#18396) 6 months ago
quip.py
readthedocs.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
recursive_url_loader.py community[patch]: RecursiveUrlLoader: add base_url option (#19421) 6 months ago
reddit.py
roam.py community: better support of pathlib paths in document loaders (#18396) 6 months ago
rocksetdb.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
rspace.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
rss.py
rst.py community: better support of pathlib paths in document loaders (#18396) 6 months ago
rtf.py community: better support of pathlib paths in document loaders (#18396) 6 months ago
s3_directory.py community[patch]: Skip nested directories when using S3DirectoryLoader (#17829) 7 months ago
s3_file.py community[patch]: support unstructured_kwargs for s3 loader (#15473) 6 months ago
sharepoint.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
sitemap.py community[minor]: Implement lazy_load() for SitemapLoader (#18667) 7 months ago
slack_directory.py community: better support of pathlib paths in document loaders (#18396) 6 months ago
snowflake_loader.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
spreedly.py
sql_database.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
srt.py community: better support of pathlib paths in document loaders (#18396) 6 months ago
stripe.py
surrealdb.py community[patch]: SurrealDB fix for asyncio (#16092) 8 months ago
telegram.py community: better support of pathlib paths in document loaders (#18396) 6 months ago
tencent_cos_directory.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
tencent_cos_file.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
tensorflow_datasets.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
text.py community: better support of pathlib paths in document loaders (#18396) 6 months ago
tidb.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
tomarkdown.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
toml.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
trello.py community: Implement lazy_load() for TrelloLoader (#18658) 7 months ago
tsv.py community: better support of pathlib paths in document loaders (#18396) 6 months ago
twitter.py
unstructured.py community[patch]: refactor the type hint of `file_path` in `UnstructuredAPIFileLoader` class (#18839) 6 months ago
url.py
url_playwright.py community: Implement lazy_load() for PlaywrightURLLoader (#18676) 7 months ago
url_selenium.py
vsdx.py community: better support of pathlib paths in document loaders (#18396) 6 months ago
weather.py community: Use default load() implementation in doc loaders (#18385) 7 months ago
web_base.py core[minor]: Add aload to document loader (#19936) 6 months ago
whatsapp_chat.py community: Implement lazy_load() for WhatsAppChatLoader (#18677) 7 months ago
wikipedia.py community[minor]: Implement lazy_load() for WikipediaLoader (#18680) 7 months ago
word_document.py community: better support of pathlib paths in document loaders (#18396) 6 months ago
xml.py community: better support of pathlib paths in document loaders (#18396) 6 months ago
xorbits.py
youtube.py community[patch]: docstrings (#16810) 8 months ago
yuque.py community[minor]: add Yuque document loader (#17924) 7 months ago