You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

DasDingoCodes 73eb3f8fd9 community[minor]: Implement DirectoryLoader lazy_load function (#19537) ... Thank you for contributing to LangChain! - [x] **PR title**: "community: Implement DirectoryLoader lazy_load function" - [x] **Description**: The `lazy_load` function of the `DirectoryLoader` yields each document separately. If the given `loader_cls` of the `DirectoryLoader` also implemented `lazy_load`, it will be used to yield subdocuments of the file. - [x] **Add tests and docs**: If you're adding a new integration, please include 1. a test for the integration, preferably unit tests that do not rely on network access: `libs/community/tests/unit_tests/document_loaders/test_directory_loader.py` 2. an example notebook showing its use. It lives in `docs/docs/integrations` directory: `docs/docs/integrations/document_loaders/directory.ipynb` - [x] **Lint and test**: Run `make format`, `make lint` and `make test` from the root of the package(s) you've modified. See contribution guidelines for more: https://python.langchain.com/docs/contributing/ Additional guidelines: - Make sure optional dependencies are imported within a function. - Please do not add dependencies to pyproject.toml files (even optional ones) unless they are required for unit tests. - Most PRs should not touch more than one package. - Changes should be backwards compatible. - If you are adding something to community, do not re-import it in langchain. If no one reviews your PR within a few days, please @-mention one of baskaryan, efriis, eyurtsev, hwchase17. --------- Co-authored-by: Eugene Yurtsev <eyurtsev@gmail.com>		6 months ago
..
blob_loaders	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
loaders	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
parsers	community[patch]: Microsoft Azure Document Intelligence updates (#16932)	6 months ago
sample_documents	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_docs	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
__init__.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_airbyte.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_arcgis_loader.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_assemblyai.py	Merge pull request #18421	7 months ago
test_bibtex.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_bshtml.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_confluence.py	Merge pull request #18436	7 months ago
test_couchbase.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_csv_loader.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_cube_semantic.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_detect_encoding.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_directory.py	community[minor]: Implement DirectoryLoader lazy_load function (#19537)	6 months ago
test_directory_loader.py	community[minor]: Implement DirectoryLoader lazy_load function (#19537)	6 months ago
test_evernote_loader.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_generic_loader.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_git.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_github.py	community[patch]: Change github endpoint in GithubLoader (#17622)	7 months ago
test_hugging_face.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_hugging_face_model.py	community[minor]: add hugging_face_model document loader (#17323)	7 months ago
test_imports.py	community[minor]: add oracle autonomous database doc loader integration (#19536)	6 months ago
test_json_loader.py	community[minor]: use jq schema for content_key in json_loader (#18003)	7 months ago
test_lakefs.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_mediawikidump.py	infra: add print rule to ruff (#16221)	8 months ago
test_mhtml.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_mongodb.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_notebook.py	community[patch]: add NotebookLoader unit test (#17721)	6 months ago
test_obsidian.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_onenote.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_oracleadb.py	community[minor]: add oracle autonomous database doc loader integration (#19536)	6 months ago
test_pebblo.py	community[minor]: Add pebblo safe document loader (#16862)	8 months ago
test_psychic.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_readthedoc.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_rspace_loader.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_rss.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_trello.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_web_base.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_youtube.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago