langchain

Commit Graph

Author	SHA1	Message	Date
Christophe Bornet	33fa8cfcd0	core[minor]: Add async methods to MaxMarginalRelevanceExampleSelector (#19639 )	6 months ago
Jan Nissen	2e0ddd6fb8	core[minor]: support pydantic v2 models in PydanticOutputParser (#18811 ) As mentioned in #18322, the current PydanticOutputParser won't work for anyone trying to parse to pydantic v2 models. This PR adds a separate `PydanticV2OutputParser`, as well as a `langchain_core.pydantic_v2` namespace that will fail on import to any projects using pydantic<2. Happy to update the docs for output parsers if this is something we're interesting in adding. On a separate note, I also updated `check_pydantic.sh` to detect pydantic imports with leading whitespace and excluded the internal namespaces. That change can be separated into its own PR if needed. --------- Co-authored-by: Jan Nissen <jan23@gmail.com>	6 months ago
jhicks2306	bcb8ab5216	docs: Improve docstring for Runnable bind method (#19659 ) Added example to the docstring of the "bind" method of Runnable. This makes it easier to understand the purpose of the method when reviewing in code editors. E.g. VS Code below. <img width="833" alt="Screenshot 2024-03-27 at 16 24 18" src="https://github.com/langchain-ai/langchain/assets/45722942/ad022d4e-7bc0-4f4b-aa7a-838f1816cc52"> --------- Co-authored-by: Chester Curme <chester.curme@gmail.com>	6 months ago
Christophe Bornet	409c6eeb0b	core: Add async methods to LengthBasedExampleSelector (#19640 )	6 months ago
Bagatur	c7f1962f73	core[patch]: Release 0.1.35 (#19660 )	6 months ago
Eugene Yurtsev	e8339b1d83	core[patch]: Patch XML vulnerability in XMLOutputParser (CVE-2024-1455) (#19653 ) Patch potential XML vulnerability CVE-2024-1455 This patches a potential XML vulnerability in the XMLOutputParser in langchain-core. The vulnerability in some situations could lead to a denial of service attack. At risk are users that: 1) Running older distributions of python that have older version of libexpat 2) Are using XMLOutputParser with an agent 3) Accept inputs from untrusted sources with this agent (e.g., endpoint on the web that allows an untrusted user to interact wiith the parser)	6 months ago
Eugene Yurtsev	8ab7bb3166	core[patch]: XMLOutputParser fix to handle changes to xml standard library (#19612 ) Newest python micro releases broke streaming in the XMLOutputParser. This fixes the parsing code to work with trailing junk after the XML content.	6 months ago
jhicks2306	087823aefa	docs: Update docstring for MessagesPlaceholder (#19601 ) Update to docstring for MessagesPlaceholder so that it shows helpful information in code editors. E.g. VS Code as shown below. <img width="587" alt="Screenshot 2024-03-26 at 17 18 58" src="https://github.com/langchain-ai/langchain/assets/45722942/8f49d09f-ed8d-4f61-a9d4-3611dbe9c9c5"> --------- Co-authored-by: Bagatur <baskaryan@gmail.com>	6 months ago
Bagatur	241774012a	core[patch]: Release 0.1.34 (#19609 ) Co-authored-by: Eugene Yurtsev <eyurtsev@gmail.com>	6 months ago
Nuno Campos	c78eb55859	load: Optionally disable reading secrets from env (#19596 ) Thank you for contributing to LangChain! - [ ] PR title: "package: description" - Where "package" is whichever of langchain, community, core, experimental, etc. is being modified. Use "docs: ..." for purely docs changes, "templates: ..." for template changes, "infra: ..." for CI changes. - Example: "community: add foobar LLM" - [ ] PR message: *Delete this entire checklist* and replace with - Description: a description of the change - Issue: the issue # it fixes, if applicable - Dependencies: any dependencies required for this change - Twitter handle: if your PR gets announced, and you'd like a mention, we'll gladly shout you out! - [ ] Add tests and docs: If you're adding a new integration, please include 1. a test for the integration, preferably unit tests that do not rely on network access, 2. an example notebook showing its use. It lives in `docs/docs/integrations` directory. - [ ] Lint and test: Run `make format`, `make lint` and `make test` from the root of the package(s) you've modified. See contribution guidelines for more: https://python.langchain.com/docs/contributing/ Additional guidelines: - Make sure optional dependencies are imported within a function. - Please do not add dependencies to pyproject.toml files (even optional ones) unless they are required for unit tests. - Most PRs should not touch more than one package. - Changes should be backwards compatible. - If you are adding something to community, do not re-import it in langchain. If no one reviews your PR within a few days, please @-mention one of baskaryan, efriis, eyurtsev, hwchase17.	6 months ago
Eugene Yurtsev	d3c9974da2	core[patch]: Temporarily disable test for streaming xml parser (#19610 ) Test is failing due to micro version bump in python interpreter which changed something about how std xml parser works	6 months ago
Eugene Yurtsev	8bc5cdccee	core[patch]: Reverting changes with defusedXML (#19604 ) DefusedXML is causing parsing errors on previously functional code with the 0.7.x versions. These do not seem to support newer version of python well. 0.8.x has only been released as rc, so we're not going to to use it in the core package	6 months ago
Eugene Yurtsev	9c7e860cf6	core[patch]: Remove anyio dependency (#19583 ) The dependency isn't used anymore	6 months ago
Christophe Bornet	1f422318b7	core[minor]: Use BaseChatMessageHistory async methods in RunnableWithMessageHistory (#19565 ) Co-authored-by: Eugene Yurtsev <eyurtsev@gmail.com>	6 months ago
Christophe Bornet	a9457d269e	core: Add async methods to BaseExampleSelector and SemanticSimilarityExampleSelector (#19399 ) Few-Shot prompt template may use a `SemanticSimilarityExampleSelector` that in turn uses a `VectorStore` that does I/O operations. So to work correctly on the event loop, we need: * async methods for the `VectorStore` (OK) * async methods for the `SemanticSimilarityExampleSelector` (this PR) * async methods for `BasePromptTemplate` and `BaseChatPromptTemplate` (future work)	6 months ago
Christophe Bornet	29c58528c7	core[minor]: Add default implementations to amax_marginal_relevance_search_by_vector and adelete (#19269 )	6 months ago
Guangdong Liu	c93d4ea91c	docs: Add in code documentation to core Runnable map methods (docs only) (#19517 ) - Issue: #18804 - @baskaryan, @eyurtsev	6 months ago
Eugene Yurtsev	56f4c5459b	core[patch]: fix xml output parser transform (#19530 ) Previous PR passed _parser attribute which apparently is not meant to be used by user code and causes non deterministic failures on CI when testing the transform and a transform methods. Reverting this change temporarily.	6 months ago
aditya thomas	aa68fd7e91	core[runnables]: docstring for class runnable, method with_listeners() (#19515 ) Description: Docstring for method with_listerners() of class Runnable Issue: [Add in code documentation to core Runnable methods #18804](https://github.com/langchain-ai/langchain/issues/18804) Dependencies: None	6 months ago
Eugene Yurtsev	727d5023ce	core[patch]: Use defusedxml in XMLOutputParser (#19526 ) This mitigates a security concern for users still using older versions of libexpat that causes an attacker to compromise the availability of the system if an attacker manages to surface malicious payload to this XMLParser.	6 months ago
Guangdong Liu	560e2182d8	docs: docstring Runnable `pipe` and `pick` methods (docs only) (#19395 ) - Issue: #18804 - @eyurtsev @ccurme PTAL --------- Co-authored-by: Bagatur <baskaryan@gmail.com> Co-authored-by: Bagatur <22008038+baskaryan@users.noreply.github.com>	6 months ago
Harrison Chase	b40c80007f	core[minor]: Add utility code to create tool examples (#18602 ) Co-authored-by: Chester Curme <chester.curme@gmail.com>	6 months ago
William FH	e980c14d6a	core[patch]: allow "placeholder" type in from_messages tuples (#19152 ) Co-authored-by: Erick Friis <erick@langchain.dev>	6 months ago
Bagatur	5d220975fc	core[patch]: Release 0.1.33 (#19348 )	6 months ago
William FH	68298cdc82	[Feat] Accept non-dict if only 1 prompt input variable (#19156 ) For prompt templates with only 1 variable (common in e.g., MessageGraph), it's convenient to wrap the incoming object in the variable before formatting. The downside of this, of course, would be that some number of invocations will successfully format when the user may have intended to format it properly before	6 months ago
Devesh Rahatekar	3c4529ac69	core: Updated docstring for RunnablePick (#18832 ) Description: : Updated the docstring for RunnablePick. Added Overview and an Example for RunnablePick class. Issue: : #18803	6 months ago
Leonid Ganeline	8609afbd10	core[patch]: Update `messages` namespace to fix API reference docs (#19161 ) Classes and functions defined in __init__.py are not parsed into the API Reference. For example: - libs/core/langchain_core/messages/__init__.py : AnyMessage, MessageLikeRepresentation, get_buffer_string(), messages_from_dict(), ... Opinionated: __init__.py is not a typical place to define artifacts. Moved artifacts from __init__ into utils.py. Added `MessageLikeRepresentation` to __all__ since it is used outside of `messages`, for example, in `libs/core/langchain_core/language_models/base.py` Added `_message_from_dict` to __all__ since it is used outside of `messages`(???) I would add `message_from_dict` (without underscore) as an alias. Please, advise.	6 months ago
Christophe Bornet	4c2e887276	core: Simplify astream logic in BaseChatModel and BaseLLM (#19332 ) Covered by tests in `libs/core/tests/unit_tests/language_models/chat_models/test_base.py`, `libs/core/tests/unit_tests/language_models/llms/test_base.py` and `libs/core/tests/unit_tests/runnables/test_runnable_events.py`	6 months ago
Chris Papademetrious	305d74c67a	core: implement a batch_size parameter for CacheBackedEmbeddings (#18070 ) Description: Currently, `CacheBackedEmbeddings` computes vectors for all uncached documents before updating the store. This pull request updates the embedding computation loop to compute embeddings in batches, updating the store after each batch. I noticed this when I tried `CacheBackedEmbeddings` on our 30k document set and the cache directory hadn't appeared on disk after 30 minutes. The motivation is to minimize compute/data loss when problems occur: * If there is a transient embedding failure (e.g. a network outage at the embedding endpoint triggers an exception), at least the completed vectors are written to the store instead of being discarded. * If there is an issue with the store (e.g. no write permissions), the condition is detected early without computing (and discarding!) all the vectors. Issue: Implements enhancement #18026. Testing: I was unable to run unit tests; details in [this post](https://github.com/langchain-ai/langchain/discussions/15019#discussioncomment-8576684). --------- Signed-off-by: chrispy <chrispy@synopsys.com> Co-authored-by: Eugene Yurtsev <eyurtsev@gmail.com>	6 months ago
Guangdong Liu	2c835baae4	code[patch]: Add in code documentation to core Runnable with_retry method (docs only) (#19192 ) - Description: Add in code documentation to core Runnable with_retry method (docs only) - Issue: #18804 @baskaryan @eyurtsev PTAL --------- Co-authored-by: ccurme <chester.curme@gmail.com>	6 months ago
Eugene Yurtsev	4b3dd34544	core[patch]: Pass sync run manager for sync stream fallback in astream (#19280 ) This PR patches the fallback in chat models and language models to pass in the appropriate version of the run manager (sync vs. async)	6 months ago
Leonid Ganeline	d314acb2d5	core[patch]: Move `globals` to a module instead of a package (non breaking change) (#19159 ) Classes and functions defined in __init__.py are not parsed into the API Reference. For example: libs/core/langchain_core/globals/__init__.py : `set_verbose` `get_llm_cache`, `set_llm_cache`, ... And the whole `langchain_core.globals` namespace is not visible in the API Reference. The refactoring is just file renaming.	6 months ago
Al-Ekram Elahee Hridoy	50f93d86ec	core[minor]: Enhance cache flexibility in BaseChatModel (#17386 ) - Description: Enhanced the `BaseChatModel` to support an `Optional[Union[bool, BaseCache]]` type for the `cache` attribute, allowing for both boolean flags and custom cache implementations. Implemented logic within chat model methods to utilize the provided custom cache implementation effectively. This change aims to provide more flexibility in caching strategies for chat models. - Issue: Implements enhancement request #17242. - Dependencies: No additional dependencies required for this change. --------- Co-authored-by: Eugene Yurtsev <eyurtsev@gmail.com>	6 months ago
Roshan Santhosh	7afecec280	core: update _rm_titles to account for title argument name bug (#19036 ) Issue : For functions which have an argument with the name 'title', the convert_pydantic_to_openai_function generates an incorrect output and omits the argument all together. This is because the _rm_titles function removes all instances of the the key 'title' from the output. Description : Updates the _rm_titles function to check the presence of the 'type' key as well before removing the 'title' key. As the title key that we wish to omit always has a type key along with it. Potential gap if there is a function defined which has both title and key as argument names, in which case this would fail. Maybe we could set a filter on the function argument names and reject those with keyword argument names. No dependencies. Passed all tests. - [x] PR title: "package: description" - Where "package" is whichever of langchain, community, core, experimental, etc. is being modified. Use "docs: ..." for purely docs changes, "templates: ..." for template changes, "infra: ..." for CI changes. - Example: "community: add foobar LLM" - [x] PR message: *Delete this entire checklist* and replace with - Description: a description of the change - Issue: the issue # it fixes, if applicable - Dependencies: any dependencies required for this change - Twitter handle: if your PR gets announced, and you'd like a mention, we'll gladly shout you out! - [x] Add tests and docs: If you're adding a new integration, please include 1. a test for the integration, preferably unit tests that do not rely on network access, 2. an example notebook showing its use. It lives in `docs/docs/integrations` directory. - [x] Lint and test: Run `make format`, `make lint` and `make test` from the root of the package(s) you've modified. See contribution guidelines for more: https://python.langchain.com/docs/contributing/ Additional guidelines: - Make sure optional dependencies are imported within a function. - Please do not add dependencies to pyproject.toml files (even optional ones) unless they are required for unit tests. - Most PRs should not touch more than one package. - Changes should be backwards compatible. - If you are adding something to community, do not re-import it in langchain. If no one reviews your PR within a few days, please @-mention one of baskaryan, efriis, eyurtsev, hwchase17. --------- Co-authored-by: Eugene Yurtsev <eyurtsev@gmail.com>	6 months ago
Aaron Jimenez	bc648f6cfc	core: Updated docstring for Context class (#19079 ) - Description: Improves the docstring for `class Context` by providing an overview and an example. - Issue: #18803	6 months ago
Kangmoon Seo	07de4abe70	core: Fix Exception handling in XMLOutputParser (#19126 ) - Description: - Exception handling in `XMLOutputParser` 1. Add Exception handling at `root = ET.fromstring(text)` // raises `ET.ParseError` 2. Fix Exception class (commonly uses in `BaseOutputParser` class) - AS-IS: raise `ValueError`, `ET.ParserError` without handling ```python # langchain_core/output_parsers/xml.py text = text.strip() if (text.startswith("<") or text.startswith("\n<")) and ( text.endswith(">") or text.endswith(">\n") ): root = ET.fromstring(text) return self._root_to_dict(root) else: raise ValueError(f"Could not parse output: {text}") ``` - TO-BE: raise `OutputParserException` ```python # langchain_core/output_parsers/xml.py text = text.strip() if (text.startswith("<") or text.startswith("\n<")) and ( text.endswith(">") or text.endswith(">\n") ): try: root = ET.fromstring(text) return self._root_to_dict(root) except ET.ParseError: raise OutputParserException(f"Could not parse output: {text}") else: raise OutputParserException(f"Could not parse output: {text}") ``` - Issue: #19107 - Dependencies: None	6 months ago
William FH	780337488e	[Enhancement] Add support for directly providing a run_id (#18990 ) The root run id (~trace id's) is useful for assigning feedback, but the current recommended approach is to use callbacks to retrieve it, which has some drawbacks: 1. Doesn't work for streaming until after the first event 2. Doesn't let you call other endpoints with the same trace ID in parallel (since you have to wait until the call is completed/started to use This PR lets you provide = "run_id" in the runnable config. Couple considerations: 1. For batch calls, we split the trace up into separate trees (to permit better rendering). We keep the provided run ID for the first one and generate a unique one for other elements of the batch. 2. For nested calls, the provided ID is ONLY used on the top root/trace. ### Example Usage ``` chain.invoke("foo", {"run_id": uuid.uuid4()}) ```	6 months ago
Jacob Lee	bd329e9aad	core[patch]: Add LLM output to message response_metadata (#19158 ) This will more easily expose token usage information. CC @baskaryan --------- Co-authored-by: Bagatur <baskaryan@gmail.com>	6 months ago
Leonid Kuligin	366ba77459	core[minor]: moved fake llms and embeddings to core (#19226 ) - [ ] PR title: "core: moved fake llms and embeddings to core" - [ ] PR message: - Description: moved fake llms and embeddings to core"	6 months ago
Nikhil Kumar	a1b26dd9b6	docs: Add docs for RouterRunnable (#19191 ) - [x] Docs for `RouterRunnable`: core: Add docs for `RouterRunnable` - [x] Add docs for `RouterRunnable`: - Description: Add docs for `RouterRunnable`, which was previously missing documentation - Issue: #18803 - Dependencies: N/A - Twitter handle: None	6 months ago
Guangdong Liu	4468e5bdbe	docs: Add in code documentation to core Runnable with_fallbacks method (docs only) (#19104 ) - Description: [a description of the change] Add in code documentation to core Runnable with_fallbacks method (docs only) - Issue: the issue #18804 @eyurtsev PTAL	6 months ago
Maxime Perrin	aa785fa6ec	core[minor]: allow LLMs async streaming to fallback on sync streaming (#18960 ) - Description: Handling fallbacks when calling async streaming for a LLM that doesn't support it. - Issue: #18920 - Twitter handle:@maximeperrin_ --------- Co-authored-by: Maxime Perrin <mperrin@doing.fr>	6 months ago
Erick Friis	781aee0068	community, langchain, infra: revert store extended test deps outside of poetry (#19153 ) Reverts langchain-ai/langchain#18995 Because it makes installing dependencies in python 3.11 extended testing take 80 minutes	6 months ago
Erick Friis	9e569d85a4	community, langchain, infra: store extended test deps outside of poetry (#18995 ) poetry can't reliably handle resolving the number of optional "extended test" dependencies we have. If we instead just rely on pip to install extended test deps in CI, this isn't an issue.	6 months ago
Bagatur	191ddbc77e	core[patch]: rc release 0.1.33-rc.1 (#19103 )	6 months ago
Nuno Campos	508f75853c	core[patch]: Change structured prompt lc id to match js (#19099 )	6 months ago
Eugene Yurtsev	06165efb5b	core[patch]: RunnablePassthrough transform to autoupgrade to AddableDict (#19051 ) Follow up on https://github.com/langchain-ai/langchain/pull/18743 which missed RunnablePassthrough Issues: https://github.com/langchain-ai/langchain/issues/18741 https://github.com/langchain-ai/langgraph/issues/136 https://github.com/langchain-ai/langserve/issues/504	6 months ago
Guangdong Liu	d4b025c812	code[patch]: Add in code documentation to core Runnable assign method (docs only) (#18951 ) PR message: *Delete this entire checklist* and replace with - Description: [a description of the change](docs: Add in code documentation to core Runnable assign method) - Issue: the issue #18804	6 months ago
Bagatur	573f48e34d	core[patch]: Release 0.1.32 (#19088 )	6 months ago
YHW	69a8ef2693	core: Runnable pass kwargs to _astream_log_implementation in astream_log (#19055 ) - Description: When calling the `_stream_log_implementation` from the `astream_log` method in the `Runnable` class, it is not handing over the `kwargs` argument. Therefore, even if i want to customize APIHandler and implement additional features with additional arguments, it is not possible. Conversely, the `astream_events` method normally handing over the `kwargs` argument. - Issue: https://github.com/langchain-ai/langchain/issues/19054 - Dependencies: - Twitter handle: if your PR gets announced, and you'd like a mention, we'll gladly shout you out! Co-authored-by: hyungwookyang <hyungwookyang@worksmobile.com>	6 months ago

1 2 3 4 5 ...

346 Commits (2fceec37715256d0ce88a171f8482a938f2cd127)