You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
langchain/libs/community/langchain_community/document_loaders
hulitaitai 7d0a008744
community[minor]: Add audio-parser "faster-whisper" in audio.py (#20012)
faster-whisper is a reimplementation of OpenAI's Whisper model using
CTranslate2, which is up to 4 times faster than enai/whisper for the
same accuracy while using less memory. The efficiency can be further
improved with 8-bit quantization on both CPU and GPU.

It can automatically detect the following 14 languages and transcribe
the text into their respective languages: en, zh, fr, de, ja, ko, ru,
es, th, it, pt, vi, ar, tr.

The gitbub repository for faster-whisper is :
    https://github.com/SYSTRAN/faster-whisper

---------

Co-authored-by: Eugene Yurtsev <eyurtsev@gmail.com>
4 months ago
..
blob_loaders community[patch]: speed up import times in the community package (#18928) 5 months ago
parsers community[minor]: Add audio-parser "faster-whisper" in audio.py (#20012) 4 months ago
__init__.py community[minor]: Add glue catalog loader (#20220) 4 months ago
acreom.py community: better support of pathlib paths in document loaders (#18396) 5 months ago
airbyte.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
airbyte_json.py community: better support of pathlib paths in document loaders (#18396) 5 months ago
airtable.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
apify_dataset.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
arcgis_loader.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
arxiv.py community[minor]: Implement lazy_load() for ArxivLoader (#18664) 6 months ago
assemblyai.py community[patch]: docstrings update (#20301) 4 months ago
astradb.py community[patch]: Use langchain-astradb for AstraDB doc loader (#19071) 5 months ago
async_html.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
athena.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
azlyrics.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
azure_ai_data.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
azure_blob_storage_container.py community[patch]: type ignore fixes (#18395) 6 months ago
azure_blob_storage_file.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
baiducloud_bos_directory.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
baiducloud_bos_file.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
base.py core: Move document loader interfaces to core (#17723) 6 months ago
base_o365.py community[patch]: Changes to base_o365 and sharepoint document loaders (#20373) 4 months ago
bibtex.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
bigquery.py deprecating integrations moved to langchain_google_community (#19841) 5 months ago
bilibili.py community[patch]: docstrings update (#20301) 4 months ago
blackboard.py community[patch]: type ignore fixes (#18395) 6 months ago
blockchain.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
brave_search.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
browserless.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
cassandra.py community[minor]: Add async methods to CassandraLoader (#20609) 4 months ago
chatgpt.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
chm.py community[patch]: docstrings (#16810) 7 months ago
chromium.py community[patch]: exposing headless flag parameter to AsyncChromiumLoader class (#20424) 4 months ago
college_confidential.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
concurrent.py community[patch]: import flattening fix (#20110) 4 months ago
confluence.py community[patch]: expanding version in confluence loader (#19324) 5 months ago
conllu.py community: better support of pathlib paths in document loaders (#18396) 5 months ago
couchbase.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
csv_loader.py community: better support of pathlib paths in document loaders (#18396) 5 months ago
cube_semantic.py community[patch]: Implement lazy_load() for CubeSemanticLoader (#18535) 6 months ago
datadog_logs.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
dataframe.py community[patch]: support modin document loader (#18866) 5 months ago
diffbot.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
directory.py community: fix `DirectoryLoader` progress bar (#19821) 4 months ago
discord.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
doc_intelligence.py community[patch]: import flattening fix (#20110) 4 months ago
docugami.py deprecate community docugami loader (#19230) 5 months ago
docusaurus.py docs: docstrings `langchain_community` update (#14889) 8 months ago
dropbox.py infra: add print rule to ruff (#16221) 7 months ago
duckdb_loader.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
email.py community: better support of pathlib paths in document loaders (#18396) 5 months ago
epub.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
etherscan.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
evernote.py community: better support of pathlib paths in document loaders (#18396) 5 months ago
excel.py community: better support of pathlib paths in document loaders (#18396) 5 months ago
facebook_chat.py community: better support of pathlib paths in document loaders (#18396) 5 months ago
fauna.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
figma.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
firecrawl.py community[minor]: Firecrawl.dev integration (#20364) 4 months ago
gcs_directory.py community[patch]: GCSDirectoryLoader bugfix (#20005) 5 months ago
gcs_file.py deprecating integrations moved to langchain_google_community (#19841) 5 months ago
generic.py community[patch]: import flattening fix (#20110) 4 months ago
geodataframe.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
git.py Merge pull request #18539 6 months ago
gitbook.py community[minor]: Implement lazy_load() for GitbookLoader (#18670) 6 months ago
github.py community: Implement lazy_load() for GithubFileLoader (#18584) 6 months ago
glue_catalog.py community[minor]: Add glue catalog loader (#20220) 4 months ago
google_speech_to_text.py deprecating integrations moved to langchain_google_community (#19841) 5 months ago
googledrive.py deprecating integrations moved to langchain_google_community (#19841) 5 months ago
gutenberg.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
helpers.py community: better support of pathlib paths in document loaders (#18396) 5 months ago
hn.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
html.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
html_bs.py community: better support of pathlib paths in document loaders (#18396) 5 months ago
hugging_face_dataset.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
hugging_face_model.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
ifixit.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
image.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
image_captions.py community: better support of pathlib paths in document loaders (#18396) 5 months ago
imsdb.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
iugu.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
joplin.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
json_loader.py community: Implement lazy_load() for JSONLoader (#18643) 6 months ago
lakefs.py docs: docstrings `langchain_community` update (#14889) 8 months ago
larksuite.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
llmsherpa.py community[minor]: add support for llmsherpa (#19741) 5 months ago
markdown.py corrected outdated link (#15053) 8 months ago
mastodon.py Merge pull request #18671 6 months ago
max_compute.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
mediawikidump.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
merge.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
mhtml.py community: better support of pathlib paths in document loaders (#18396) 5 months ago
modern_treasury.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
mongodb.py community[minor]: added a feature to filter documents in Mongoloader (#18253) 6 months ago
news.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
notebook.py community[patch]: add NotebookLoader unit test (#17721) 5 months ago
notion.py community: better support of pathlib paths in document loaders (#18396) 5 months ago
notiondb.py community[patch]: Fix NotionDBLoader 400 Error by conditionally adding filter parameter (#19075) 5 months ago
nuclia.py infra: add print rule to ruff (#16221) 7 months ago
obs_directory.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
obs_file.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
obsidian.py community: better support of pathlib paths in document loaders (#18396) 5 months ago
odt.py community: better support of pathlib paths in document loaders (#18396) 5 months ago
onedrive.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
onedrive_file.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
onenote.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
open_city_data.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
oracleadb_loader.py community[minor]: add oracle autonomous database doc loader integration (#19536) 5 months ago
org_mode.py community: better support of pathlib paths in document loaders (#18396) 5 months ago
pdf.py community[patch]: import flattening fix (#20110) 4 months ago
pebblo.py community[patch]: Add support for authorized identities in PebbloSafeLoader. (#20055) 4 months ago
polars_dataframe.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
powerpoint.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
psychic.py Merge pull request #18656 6 months ago
pubmed.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
pyspark_dataframe.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
python.py community: better support of pathlib paths in document loaders (#18396) 5 months ago
quip.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
readthedocs.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
recursive_url_loader.py community[patch]: RecursiveUrlLoader: add base_url option (#19421) 5 months ago
reddit.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
roam.py community: better support of pathlib paths in document loaders (#18396) 5 months ago
rocksetdb.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
rspace.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
rss.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
rst.py community: better support of pathlib paths in document loaders (#18396) 5 months ago
rtf.py community: better support of pathlib paths in document loaders (#18396) 5 months ago
s3_directory.py community[patch]: Skip nested directories when using S3DirectoryLoader (#17829) 6 months ago
s3_file.py community[patch]: support unstructured_kwargs for s3 loader (#15473) 5 months ago
sharepoint.py community[patch]: Changes to base_o365 and sharepoint document loaders (#20373) 4 months ago
sitemap.py community[minor]: Implement lazy_load() for SitemapLoader (#18667) 6 months ago
slack_directory.py community: better support of pathlib paths in document loaders (#18396) 5 months ago
snowflake_loader.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
spreedly.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
sql_database.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
srt.py community: better support of pathlib paths in document loaders (#18396) 5 months ago
stripe.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
surrealdb.py community[patch]: SurrealDB fix for asyncio (#16092) 7 months ago
telegram.py community: better support of pathlib paths in document loaders (#18396) 5 months ago
tencent_cos_directory.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
tencent_cos_file.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
tensorflow_datasets.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
text.py community: better support of pathlib paths in document loaders (#18396) 5 months ago
tidb.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
tomarkdown.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
toml.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
trello.py community: Implement lazy_load() for TrelloLoader (#18658) 6 months ago
tsv.py community: better support of pathlib paths in document loaders (#18396) 5 months ago
twitter.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
unstructured.py community[patch]: Fix not to cast to str type when `file_path` is None (#20057) 4 months ago
url.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
url_playwright.py community: Implement lazy_load() for PlaywrightURLLoader (#18676) 6 months ago
url_selenium.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
vsdx.py community[patch]: import flattening fix (#20110) 4 months ago
weather.py community: Use default load() implementation in doc loaders (#18385) 6 months ago
web_base.py core[minor]: Add aload to document loader (#19936) 5 months ago
whatsapp_chat.py community: Implement lazy_load() for WhatsAppChatLoader (#18677) 6 months ago
wikipedia.py community[minor]: Implement lazy_load() for WikipediaLoader (#18680) 6 months ago
word_document.py community: better support of pathlib paths in document loaders (#18396) 5 months ago
xml.py community: better support of pathlib paths in document loaders (#18396) 5 months ago
xorbits.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
youtube.py community[patch]: docstrings (#16810) 7 months ago
yuque.py community[minor]: add Yuque document loader (#17924) 6 months ago