You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
langchain/docs/extras/modules/data_connection/document_loaders/integrations
Yifei Song 7d29bb2c02
Add Xorbits Dataframe as a Document Loader (#7319)
- [Xorbits](https://doc.xorbits.io/en/latest/) is an open-source
computing framework that makes it easy to scale data science and machine
learning workloads in parallel. Xorbits can leverage multi cores or GPUs
to accelerate computation on a single machine, or scale out up to
thousands of machines to support processing terabytes of data.

- This PR added support for the Xorbits document loader, which allows
langchain to leverage Xorbits to parallelize and distribute the loading
of data.
- Dependencies: This change requires the Xorbits library to be installed
in order to be used.
`pip install xorbits`
- Request for review: @rlancemartin, @eyurtsev
- Twitter handle: https://twitter.com/Xorbitsio

Co-authored-by: Bagatur <baskaryan@gmail.com>
1 year ago
..
example_data feat: Add `UnstructuredTSVLoader` (#7367) 1 year ago
acreom.ipynb Doc refactor (#6300) 1 year ago
airbyte_json.ipynb Doc refactor (#6300) 1 year ago
airtable.ipynb docstrings `document_loaders` 1 (#6847) 1 year ago
alibaba_cloud_maxcompute.ipynb Doc refactor (#6300) 1 year ago
apify_dataset.ipynb docs/fix links (#6498) 1 year ago
arxiv.ipynb Doc refactor (#6300) 1 year ago
aws_s3_directory.ipynb Doc refactor (#6300) 1 year ago
aws_s3_file.ipynb Doc refactor (#6300) 1 year ago
azlyrics.ipynb Doc refactor (#6300) 1 year ago
azure_blob_storage_container.ipynb Doc refactor (#6300) 1 year ago
azure_blob_storage_file.ipynb Doc refactor (#6300) 1 year ago
bibtex.ipynb Doc refactor (#6300) 1 year ago
bilibili.ipynb Doc refactor (#6300) 1 year ago
blackboard.ipynb Doc refactor (#6300) 1 year ago
blockchain.ipynb Doc refactor (#6300) 1 year ago
brave_search.ipynb added `Brave Search` document_loader (#6989) 1 year ago
chatgpt_loader.ipynb Doc refactor (#6300) 1 year ago
college_confidential.ipynb Doc refactor (#6300) 1 year ago
confluence.ipynb fix titles in documentation 1 year ago
conll-u.ipynb Doc refactor (#6300) 1 year ago
copypaste.ipynb Doc refactor (#6300) 1 year ago
csv.ipynb Doc refactor (#6300) 1 year ago
cube_semantic.ipynb Document loader for Cube Semantic Layer (#6882) 1 year ago
diffbot.ipynb Doc refactor (#6300) 1 year ago
discord.ipynb Doc refactor (#6300) 1 year ago
docugami.ipynb docs/fix links (#6498) 1 year ago
duckdb.ipynb Doc refactor (#6300) 1 year ago
email.ipynb feat: enable `UnstructuredEmailLoader` to process attachments (#6977) 1 year ago
embaas.ipynb Doc refactor (#6300) 1 year ago
epub.ipynb Doc refactor (#6300) 1 year ago
evernote.ipynb Doc refactor (#6300) 1 year ago
excel.ipynb Doc refactor (#6300) 1 year ago
facebook_chat.ipynb Doc refactor (#6300) 1 year ago
fauna.ipynb Doc refactor (#6300) 1 year ago
figma.ipynb Doc refactor (#6300) 1 year ago
git.ipynb Doc refactor (#6300) 1 year ago
gitbook.ipynb Doc refactor (#6300) 1 year ago
github.ipynb Doc refactor (#6300) 1 year ago
google_bigquery.ipynb Doc refactor (#6300) 1 year ago
google_cloud_storage_directory.ipynb Doc refactor (#6300) 1 year ago
google_cloud_storage_file.ipynb Doc refactor (#6300) 1 year ago
google_drive.ipynb Harrison/gdrive enhancements (#6375) 1 year ago
grobid.ipynb Grobid parser for Scientific Articles from PDF (#6729) 1 year ago
gutenberg.ipynb Doc refactor (#6300) 1 year ago
hacker_news.ipynb Doc refactor (#6300) 1 year ago
hugging_face_dataset.ipynb Doc refactor (#6300) 1 year ago
ifixit.ipynb Doc refactor (#6300) 1 year ago
image.ipynb Doc refactor (#6300) 1 year ago
image_captions.ipynb Doc refactor (#6300) 1 year ago
imsdb.ipynb Doc refactor (#6300) 1 year ago
iugu.ipynb Minor Grammar Fixes in Docs and Comments (#6536) 1 year ago
joplin.ipynb Doc refactor (#6300) 1 year ago
jupyter_notebook.ipynb Doc refactor (#6300) 1 year ago
larksuite.ipynb feat (documents): add LarkSuite document loader (#6420) 1 year ago
mastodon.ipynb Doc refactor (#6300) 1 year ago
mediawikidump.ipynb Doc refactor (#6300) 1 year ago
merge_doc_loader.ipynb Create merge loader that combines documents from a set of loaders (#6659) 1 year ago
mhtml.ipynb Added a MHTML document loader (#6311) 1 year ago
microsoft_onedrive.ipynb Doc refactor (#6300) 1 year ago
microsoft_powerpoint.ipynb Doc refactor (#6300) 1 year ago
microsoft_word.ipynb Doc refactor (#6300) 1 year ago
modern_treasury.ipynb Minor Grammar Fixes in Docs and Comments (#6536) 1 year ago
notion.ipynb Doc refactor (#6300) 1 year ago
notiondb.ipynb Doc refactor (#6300) 1 year ago
obsidian.ipynb Doc refactor (#6300) 1 year ago
odt.ipynb Doc refactor (#6300) 1 year ago
open_city_data.ipynb Loader for OpenCityData and minor cleanups to Pandas, Airtable loaders (#6301) 1 year ago
org_mode.ipynb feat: Add `UnstructuredOrgModeLoader` (#6842) 1 year ago
pandas_dataframe.ipynb Loader for OpenCityData and minor cleanups to Pandas, Airtable loaders (#6301) 1 year ago
psychic.ipynb docs/fix links (#6498) 1 year ago
pyspark_dataframe.ipynb Doc refactor (#6300) 1 year ago
readthedocs_documentation.ipynb Doc refactor (#6300) 1 year ago
recursive_url_loader.ipynb `RecusiveUrlLoader` to `RecursiveUrlLoader` (#6787) 1 year ago
reddit.ipynb docs/fix links (#6498) 1 year ago
roam.ipynb Doc refactor (#6300) 1 year ago
rst.ipynb feat: Add `UnstructuredRSTLoader` (#6594) 1 year ago
sitemap.ipynb Doc refactor (#6300) 1 year ago
slack.ipynb Doc refactor (#6300) 1 year ago
snowflake.ipynb Doc refactor (#6300) 1 year ago
source_code.ipynb feat (documents): add a source code loader based on AST manipulation (#6486) 1 year ago
spreedly.ipynb Minor Grammar Fixes in Docs and Comments (#6536) 1 year ago
stripe.ipynb Minor Grammar Fixes in Docs and Comments (#6536) 1 year ago
subtitle.ipynb Doc refactor (#6300) 1 year ago
telegram.ipynb Doc refactor (#6300) 1 year ago
tencent_cos_directory.ipynb feat(document_loaders): add tencent cos directory and file loader (#6401) 1 year ago
tencent_cos_file.ipynb feat(document_loaders): add tencent cos directory and file loader (#6401) 1 year ago
tomarkdown.ipynb Doc refactor (#6300) 1 year ago
toml.ipynb Doc refactor (#6300) 1 year ago
trello.ipynb Doc refactor (#6300) 1 year ago
tsv.ipynb feat: Add `UnstructuredTSVLoader` (#7367) 1 year ago
twitter.ipynb Doc refactor (#6300) 1 year ago
unstructured_file.ipynb Docs/unstructured api key (#6781) 1 year ago
url.ipynb Add markdown to specify important arguments (#6246) 1 year ago
weather.ipynb Doc refactor (#6300) 1 year ago
web_base.ipynb Web Loader: Add proxy support (#6792) 1 year ago
whatsapp_chat.ipynb Doc refactor (#6300) 1 year ago
wikipedia.ipynb Doc refactor (#6300) 1 year ago
xml.ipynb Doc refactor (#6300) 1 year ago
xorbits.ipynb Add Xorbits Dataframe as a Document Loader (#7319) 1 year ago
youtube_audio.ipynb Doc refactor (#6300) 1 year ago
youtube_transcript.ipynb Doc refactor (#6300) 1 year ago