langchain/langchain
Eugene Yurtsev 2052e70664
Add lazy iteration interface to document loaders (#3659)
Adding a lazy iteration for document loaders.

Following the plan here:
https://github.com/hwchase17/langchain/pull/2833

Keeping the `load` method as is for backwards compatibility. The `load`
returns a materialized list of documents and downstream users may rely on that
fact.

A new method that returns an iterable is introduced for handling lazy
loading.

---------

Co-authored-by: Zander Chase <130414180+vowelparrot@users.noreply.github.com>
2023-04-27 14:29:01 -04:00
..
agents Some more PowerBI pydantic and import fixes (#3461) 2023-04-26 22:09:12 -07:00
callbacks Harrison/streamlit handler (#3564) 2023-04-25 17:26:30 -07:00
chains update example of ConstitutionalChain.from_llm (#3630) 2023-04-27 11:17:31 -07:00
chat_models consistently use getLogger(__name__), no root logger (#2989) 2023-04-16 12:49:35 -07:00
docstore
document_loaders Add lazy iteration interface to document loaders (#3659) 2023-04-27 14:29:01 -04:00
embeddings Sentence Transformers Aliasing (#3541) 2023-04-25 23:29:20 -07:00
evaluation Add ReAct eval chain (#3161) 2023-04-25 21:22:25 -07:00
experimental Harrison/prompt prefix (#3496) 2023-04-24 22:15:44 -07:00
graphs
indexes
llms Add PipelineAI LLM integration (#3644) 2023-04-27 08:22:26 -07:00
memory Allow clearing cache and fix gptcache (#3493) 2023-04-26 22:03:50 -07:00
output_parsers Self-query with generic query constructor (#3607) 2023-04-27 08:36:00 -07:00
prompts Validate input_variables when using jinja2 templates (#3140) 2023-04-19 16:18:32 -07:00
retrievers Self-query with generic query constructor (#3607) 2023-04-27 08:36:00 -07:00
tools Some more PowerBI pydantic and import fixes (#3461) 2023-04-26 22:09:12 -07:00
utilities bump version to 151 (#3658) 2023-04-27 09:02:39 -07:00
vectorstores Self-query with generic query constructor (#3607) 2023-04-27 08:36:00 -07:00
__init__.py Add PipelineAI LLM integration (#3644) 2023-04-27 08:22:26 -07:00
cache.py Allow clearing cache and fix gptcache (#3493) 2023-04-26 22:03:50 -07:00
docker-compose.yaml Update docker-compose.yaml (#3582) 2023-04-26 15:11:59 -07:00
document_transformers.py Contextual compression retriever (#2915) 2023-04-20 17:01:14 -07:00
example_generator.py
formatting.py Validate input_variables when using jinja2 templates (#3140) 2023-04-19 16:18:32 -07:00
input.py
math_utils.py fix #3884 (#3475) 2023-04-24 19:54:15 -07:00
model_laboratory.py
py.typed
python.py Move PythonRepl -> langchain.utilities (#2917) 2023-04-15 10:50:25 -07:00
requests.py
schema.py Contextual compression retriever (#2915) 2023-04-20 17:01:14 -07:00
serpapi.py
server.py Fix missing docker-compose (#2899) 2023-04-15 16:05:11 -07:00
sql_database.py Support SQLAlchemy 2.0 (#3310) 2023-04-24 21:10:56 -07:00
text_splitter.py Contextual compression retriever (#2915) 2023-04-20 17:01:14 -07:00
utils.py Add retry logic for ChromaDB (#3372) 2023-04-24 21:48:29 -07:00