9699 Commits (148088a58877e0f2acd91c79ec43aeb6146d112d)

 

All Branches   

Search

Author	SHA1	Message	Date
Jan Soubusta	cccc8fbe2f	community[patch]: DuckDB VS - expose similarity, improve performance of from_texts (#20971) ... 3 fixes of DuckDB vector store: - unify defaults in constructor and from_texts (users no longer have to specify `vector_key`). - include search similarity into output metadata (fixes #20969) - significantly improve performance of `from_documents` Dependencies: added Pandas to speed up `from_documents`. I was thinking about CSV and JSON options, but I expect trouble loading JSON values this way and also CSV and JSON options require storing data to disk. Anyway, the poetry file for langchain-community already contains a dependency on Pandas. --------- Co-authored-by: Bagatur <baskaryan@gmail.com> Co-authored-by: Harrison Chase <hw.chase.17@gmail.com> Co-authored-by: ccurme <chester.curme@gmail.com>	2 months ago
Surya Pratap Singh Shekhawat	42207f5bef	Update agent_executor.ipynb (#22104) ... fixed typos in the doc. --------- Co-authored-by: ccurme <chester.curme@gmail.com>	2 months ago
Erick Friis	8acadc34f5	docs: edit links, direct for notebooks (#22051)	2 months ago
Erick Friis	42ffcb2ff1	anthropic: release 0.1.14rc2, test release note gen (#22147)	2 months ago
Erick Friis	6ee8de62c0	infra: auto-generated release notes based on git log (#22141) ... Generates release notes based on a `git log` command with title names Aiming to improve to splitting out features vs. bugfixes using conventional commits in the coming weeks. Will work for any monorepo packages	2 months ago
Ameya Shenoy	8ba492ed6a	community[minor]: clickhouse -- ability to use secure connection (#22108) ... - **Description:** this PR gives clickhouse client the ability to use a secure connection to the clickhosue server - **Issue:** fixes #22082 - **Dependencies:** - - **Twitter handle:** `_codingcoffee_` Signed-off-by: Ameya Shenoy <shenoy.ameya@gmail.com> Co-authored-by: Shresth Rana <shresth@grapevine.in>	2 months ago
ccurme	9a010fb761	openai: read stream_options (#21548) ... OpenAI recently added a `stream_options` parameter to its chat completions API (see [release notes](https://platform.openai.com/docs/changelog/added-chat-completions-stream-usage)). When this parameter is set to `{"usage": True}`, an extra "empty" message is added to the end of a stream containing token usage. Here we propagate token usage to `AIMessage.usage_metadata`. We enable this feature by default. Streams would now include an extra chunk at the end, **after** the chunk with `response_metadata={'finish_reason': 'stop'}`. New behavior: ``` [AIMessageChunk(content='', id='run-4b20dbe0-3817-4f62-b89d-03ef76f25bde'), AIMessageChunk(content='Hello', id='run-4b20dbe0-3817-4f62-b89d-03ef76f25bde'), AIMessageChunk(content='!', id='run-4b20dbe0-3817-4f62-b89d-03ef76f25bde'), AIMessageChunk(content='', response_metadata={'finish_reason': 'stop'}, id='run-4b20dbe0-3817-4f62-b89d-03ef76f25bde'), AIMessageChunk(content='', id='run-4b20dbe0-3817-4f62-b89d-03ef76f25bde', usage_metadata={'input_tokens': 8, 'output_tokens': 9, 'total_tokens': 17})] ``` Old behavior (accessible by passing `stream_options={"include_usage": False}` into (a)stream: ``` [AIMessageChunk(content='', id='run-1312b971-c5ea-4d92-9015-e6604535f339'), AIMessageChunk(content='Hello', id='run-1312b971-c5ea-4d92-9015-e6604535f339'), AIMessageChunk(content='!', id='run-1312b971-c5ea-4d92-9015-e6604535f339'), AIMessageChunk(content='', response_metadata={'finish_reason': 'stop'}, id='run-1312b971-c5ea-4d92-9015-e6604535f339')] ``` From what I can tell this is not yet implemented in Azure, so we enable only for ChatOpenAI.	2 months ago
Patrick Zhang	eb7c767e5b	docs: update the name of the tool passio_nutrition_ai (#22116) ... Updating the name of the Passion Nutrition AI tool so that the name of the tool is correctly displayed in the sidebar menu. Currently the name of the tool says "Quickstart" in the side bar. The patch fixed the name to be Passio Nutrition AI. <img width="681" alt="image" src="https://github.com/langchain-ai/langchain/assets/4603110/9609975e-78ea-4032-9024-10c4f838170a">	2 months ago
Leonid Ganeline	fd4ee08167	docs: `integrations/platforms/microsoft` update (#22100) ... Added the `Azure Container Apps dynamic sessions` tool reference	2 months ago
Rahul Triptahi	1a485f59b9	community[patch]: Put authorized identities behind a feature flag in SharepointLoader (#22125) ... Description: Put authorised identities behind a feature flag, load_auth. Documentation: N/A Unit tests: N/A --------- Signed-off-by: Rahul Tripathi <rauhl.psit.ec@gmail.com> Co-authored-by: Rahul Tripathi <rauhl.psit.ec@gmail.com>	2 months ago
Anindyadeep	ee689412ab	docs: Update PremAI Docs (#22114) ... Thank you for contributing to LangChain! - [X] **PR title**: community: Updated langchain-community PremAI documentation - [X] **Lint and test**: Run `make format`, `make lint` and `make test` from the root of the package(s) you've modified. See contribution guidelines for more: https://python.langchain.com/docs/contributing/	2 months ago
sasha	1c9ceff503	community: add metadata to chain logging; (#22122) ... Hey, I'm Sasha. The SDK engineer from [Comet](https://comet.com). This PR updates the CometTracer class. Added metadata to CometTracerr. From now on, both chains and spans will send it.	2 months ago
Jirka Lhotka	7c0459faf2	community: Update costs of openai finetuned models (#22124) ... - **Description:** Update costs of finetuned models and add gpt-3-turbo-0125. Source: https://openai.com/api/pricing/ - **Issue:** N/A - **Dependencies:** None	2 months ago
Eugene Yurtsev	d3db83abe3	community[major]: lint for usage of xml library (#22132) ... * Lint for usage of standard xml library * Add forced opt-in for quip client * Actual security issue is with underlying QuipClient not LangChain integration (since the client is doing the parsing), but adding enforcement at the LangChain level.	2 months ago
Tom Aarsen	5b5ea2af30	docs: Add explanation on how to use Hugging Face embeddings (#22118) ... - **Description:** I've added a tab on embedding text with LangChain using Hugging Face models to here: https://python.langchain.com/v0.2/docs/how_to/embed_text/. HF was mentioned in the running text, but not in the tabs, which I thought was odd. - **Issue:** N/A - **Dependencies:** N/A - **Twitter handle:** No need, this is tiny :) Also, I had a ton of issues with the poetry docs/lint install, so I haven't linted this. Apologies for that. cc @Jofthomas - Tom Aarsen	2 months ago
Bagatur	baa3c975cb	anthropic[patch]: allow tool call mutation (#22130) ... If tool_use blocks and tool_calls with overlapping IDs are present, prefer the values of the tool_calls. Allows for mutating AIMessages just via tool_calls.	2 months ago
Christophe Bornet	c838de5027	doc: Add doc for CassandraByteStore (#22126) ... Preview: https://langchain-git-fork-cbornet-doc-cassandrabytestore-langchain.vercel.app/v0.2/docs/integrations/stores/cassandra/	2 months ago
Vadym Barda	2edb512282	docs: improve how-to docs for message history (#22072) ... Co-authored-by: Bagatur <22008038+baskaryan@users.noreply.github.com>	2 months ago
Artem	eb7c453b98	docs: update `hub.pull("rlm/map-prompt")` to `hub.pull("rlm/reduce-prompt")` for reduce prompt (#22088) ... **PR message**: Update `hub.pull("rlm/map-prompt")` to `hub.pull("rlm/reduce-prompt")` in summarization.ipynb **Description:** Fix typo in prompt hub link from `reduce_prompt = hub.pull("rlm/map-prompt")` to `reduce_prompt = hub.pull("rlm/reduce-prompt")` following next issue **Issue:** #22014 Co-authored-by: Bagatur <22008038+baskaryan@users.noreply.github.com>	2 months ago
Leonid Ganeline	2416737c5f	docs: compact the API Reference links (#21285) ... This PR is opinionated. Issue: the `API Reference` sections in the examples hold too much vertical space and make us scroll the page too much. See an [example](https://python.langchain.com/docs/get_started/quickstart/#conversation-retrieval-chain). These sections are **important**. So, the compacting should not make these sections less noticeable. Change: compacting the `API Reference` sections. See the [same example after change applied](https://langchain-j6nya46lf-langchain.vercel.app/docs/get_started/quickstart/#conversation-retrieval-chain). It is more compact and now looks like references (footnotes). Note: I would also change the section style, so it would be more noticeable (maybe to look like the footnotes. Smaller wider font?) --------- Co-authored-by: Bagatur <22008038+baskaryan@users.noreply.github.com> Co-authored-by: Bagatur <baskaryan@gmail.com>	2 months ago
ccurme	0ea1e89b2c	groq: read tool calls from .tool_calls attribute (#22096)	2 months ago
Bagatur	96c21dfe56	docs: hf feat table tool calling (#22091)	2 months ago
Eugene Yurtsev	63004a0945	codespell ignore remaining issues (#22097)	2 months ago
Eugene Yurtsev	2d693c484e	docs: fix some spelling mistakes caught by newest version of code spell (#22090) ... Going to merge this even though it doesn't pass all tests, and open a separate PR for the remaining spelling mistakes.	2 months ago
Bagatur	38783d07c9	infra: api docs quick preview (#22093)	2 months ago
Pavel Zloi	fe26f937e4	community[minor]: ManticoreSearch engine added to vectorstore (#19117) ... **Description:** ManticoreSearch engine added to vectorstores **Issue:** no issue, just a new feature **Dependencies:** https://pypi.org/project/manticoresearch-dev/ **Twitter handle:** @EvilFreelancer - Example notebook with test integration: https://github.com/EvilFreelancer/langchain/blob/manticore-search-vectorstore/docs/docs/integrations/vectorstores/manticore_search.ipynb --------- Co-authored-by: Bagatur <22008038+baskaryan@users.noreply.github.com> Co-authored-by: Harrison Chase <hw.chase.17@gmail.com> Co-authored-by: Chester Curme <chester.curme@gmail.com> Co-authored-by: Bagatur <baskaryan@gmail.com>	2 months ago
Erick Friis	95c3e5f85f	cli: model name substitution fix, release 0.0.23 (#22089)	2 months ago
Kartheek Yakkala	18b8c8628a	docs : Added integrations for tools with langchain_community (#22056) ... - **PR title**: Docs enhancement - **Description:** Adding installation instructions for integrations requiring `langchain-community` package since 0.2 - **Issue:** https://github.com/langchain-ai/langchain/issues/22005	2 months ago
ccurme	152c8cac33	anthropic, openai: cut pre-releases (#22083)	2 months ago
ccurme	cd07521170	core: bump to 0.2.1rc (#22080)	2 months ago
Harrison Chase	170cc8aec3	docs: add multi-modal-docs (#21734) ... We dont really have any abstractions around multi-modal... so add a section explaining we dont have any abstrations and then how to guides for openai and anthropic (probably need to add for more) --------- Co-authored-by: Chester Curme <chester.curme@gmail.com> Co-authored-by: Tomaz Bratanic <bratanic.tomaz@gmail.com> Co-authored-by: Eugene Yurtsev <eyurtsev@gmail.com> Co-authored-by: junefish <junefish@users.noreply.github.com> Co-authored-by: William Fu-Hinthorn <13333726+hinthornw@users.noreply.github.com> Co-authored-by: Bagatur <baskaryan@gmail.com>	2 months ago
ccurme	fbfed65fb1	core, partners: add token usage attribute to AIMessage (#21944) ... ```python class UsageMetadata(TypedDict): """Usage metadata for a message, such as token counts. Attributes: input_tokens: (int) count of input (or prompt) tokens output_tokens: (int) count of output (or completion) tokens total_tokens: (int) total token count """ input_tokens: int output_tokens: int total_tokens: int ``` ```python class AIMessage(BaseMessage): ... usage_metadata: Optional[UsageMetadata] = None """If provided, token usage information associated with the message.""" ... ```	2 months ago
Bagatur	3d26807b92	community[patch]: Release. 0.2.1 (#22073)	2 months ago
Bagatur	2d968213d7	langchain[patch]: Release 0.2.1 (#22074)	2 months ago
maang-h	9aba9e3e33	community[patch]: Update the default “API URL” and “MODEL” of sparkllm (#22070) ... - **Description:** When I was running the sparkllm, I found that the default parameters currently used could no longer run correctly. - original parameters & values: - spark_api_url: "wss://spark-api.xf-yun.com/v3.1/chat" - spark_llm_domain: "generalv3" ```python # example from langchain_community.chat_models import ChatSparkLLM spark = ChatSparkLLM(spark_app_id="my_app_id", spark_api_key="my_api_key", spark_api_secret="my_api_secret") spark.invoke("hello") ```  So I updated them to 3.5 (same as sparkllm official website). After the update, they can be used normally. - new parameters & values: - spark_api_url: "wss://spark-api.xf-yun.com/v3.5/chat" - spark_llm_domain: "generalv3.5"	2 months ago
junkeon	4fda7bf4f2	upstage[patch] : fix error handling in Layout Analysis parser (#22054) ... This pull request addresses and fixes exception handling in the UpstageLayoutAnalysisParser and enhances the test coverage by adding error exception tests for the document loader. These improvements ensure robust error handling and increase the reliability of the system when dealing with external API calls and JSON responses. ### Changes Made 1. Fix Request Exception Handling: - Issue: The existing implementation of UpstageLayoutAnalysisParser did not properly handle exceptions thrown by the requests library, which could lead to unhandled exceptions and potential crashes. - Solution: Added comprehensive exception handling for requests.RequestException to catch any request-related errors. This includes logging the error details and raising a ValueError with a meaningful error message. 2. Add Error Exception Tests for Document Loader: - New Tests: Introduced new test cases to verify the robustness of the UpstageLayoutAnalysisLoader against various error scenarios. The tests ensure that the loader gracefully handles: - RequestException: Simulates network issues or invalid API requests to ensure appropriate error handling and user feedback. - JSONDecodeError: Simulates scenarios where the API response is not a valid JSON, ensuring the system does not crash and provides clear error messaging.	2 months ago
JuHyung Son	d9eff44400	partner-upstage[patch]: embeddings empty list bug (#22057) ... Fixed an error in `embed_documents` when the input was given as an empty list. And I have revised the document.	2 months ago
Martin Triska	2df8ac402a	community[minor]: Added propagation of document metadata from O365BaseLoader (#20663) ... **Description:** - Added propagation of document metadata from O365BaseLoader to FileSystemBlobLoader (O365BaseLoader uses FileSystemBlobLoader under the hood). - This is done by passing dictionary `metadata_dict`: key=filename and value=dictionary containing document's metadata - Modified `FileSystemBlobLoader` to accept the `metadata_dict`, use `mimetype` from it (if available) and pass metadata further into blob loader. **Issue:** - `O365BaseLoader` under the hood downloads documents to temp folder and then uses `FileSystemBlobLoader` on it. - However metadata about the document in question is lost in this process. In particular: - `mime_type`: `FileSystemBlobLoader` guesses `mime_type` from the file extension, but that does not work 100% of the time. - `web_url`: this is useful to keep around since in RAG LLM we might want to provide link to the source document. In order to work well with document parsers, we pass the `web_url` as `source` (`web_url` is ignored by parsers, `source` is preserved) **Dependencies:** None **Twitter handle:** @martintriska1 Please review @baskaryan --------- Co-authored-by: Bagatur <22008038+baskaryan@users.noreply.github.com> Co-authored-by: Eugene Yurtsev <eyurtsev@gmail.com>	2 months ago
Eugene Yurtsev	e5541d1da7	community[patch]: Update doc-string in CloudBlobLoader (#22069) ... Update doc-string	2 months ago
Maxime Perrin	8ba4f77734	docs : Adding correct imports to the integrations callbacks doc (#22059) ... - **Description:** Adding correct imports to the integrations callbacks doc (langchain-community package) - **Issue:** #22005 --------- Co-authored-by: Maxime Perrin <mperrin@doing.fr>	2 months ago
Philippe PRADOS	6dd621d636	community[minor]: Add CloudBlobLoader that supports loading data from cloud buckets (#21957) ... Thank you for contributing to LangChain! - [ ] **PR title**: "Add CloudBlobLoader" - community: Add CloudBlobLoader - [ ] **PR message**: Add cloud blob loader - **Description:** Langchain provides several approaches to read different file formats: Specific loaders (`CVSLoader`) or blob-compatible loaders (`FileSystemBlobLoader`). The only implementation proposed for BlobLoader is `FileSystemBlobLoader`. Many projects retrieve files from cloud storage. We propose a new implementation of `BlobLoader` to read files from the three cloud storage systems. The interface is strictly identical to `FileSystemBlobLoader`. The only difference is the constructor, which takes a cloud "url" object such as `s3://my-bucket`, `az://my-bucket`, or `gs://my-bucket`. By streamlining the process, this novel implementation eliminates the requirement to pre-download files from cloud storage to local temporary files (which are seldom removed). The code relies on the [CloudPathLib](https://cloudpathlib.drivendata.org/stable/) library to interpret cloud URLs. This has been added as an optional dependency. ```Python loader = CloudBlobLoader("s3://mybucket/id") for blob in loader.yield_blobs(): print(blob) ``` - [X] **Dependencies:** CloudPathLib - [X] **Twitter handle:** pprados - [X] **Add tests and docs**: Add unit test, but it's easy to convert to integration test, with some files in a cloud storage (see `test_cloud_blob_loader.py`) - [X] **Lint and test**: Run `make format`, `make lint` and `make test` from the root of the package(s) you've modified. Hello from Paris @hwchase17. Can you review this PR? --------- Co-authored-by: Eugene Yurtsev <eugene@langchain.dev>	2 months ago
Christophe Bornet	74947ec894	community[minor]: Add Cassandra ByteStore (#22064)	2 months ago
Christophe Bornet	fea6b99b16	community[minor]: Add async methods to CassandraChatMessageHistory (#21975)	2 months ago
Eugene Yurtsev	37cfc00310	docs: concepts callbacks fix admonition (#22048) ... Correct the admonition text	2 months ago
Erick Friis	53293dace8	docs: version increases (#22050)	2 months ago
Sky	12d65f17ff	community[patch]: surrealdb provide functions for MMR (Maximal Marginal Relevance) (#21185) ... This PR contains 4 added functions: - max_marginal_relevance_search_by_vector - amax_marginal_relevance_search_by_vector - max_marginal_relevance_search - amax_marginal_relevance_search I'm no langchain expert, but tried do inspect other vectorstore sources like chroma, to build these functions for SurrealDB. If someone has some changes for me, please let me know. Otherwise I would be happy, if these changes are added to the repository, so that I can use the orignal repo and not my local monkey patched version. --------- Co-authored-by: Harrison Chase <hw.chase.17@gmail.com> Co-authored-by: Bagatur <baskaryan@gmail.com>	2 months ago
Erick Friis	58b6c72375	docs: add astream v2 migration guide links (#21845) ... - docs: v0.2 version sidebar - x - x	2 months ago
Bruno Alvisio	5eabe90494	community[patch]: Adding HEADER to the list of supported locations (#21946) ... **Description:** adds headers to the list of supported locations when generating the openai function schema	2 months ago
Bagatur	50186da0a1	infra: rm unused # noqa violations (#22049) ... Updating #21137	2 months ago
acho98	45ed5f3f51	community[minor]: Add Clova Embeddings for LangChain Community (#21890) ... - [ ] **PR title**: "Add Naver ClovaX embedding to LangChain community" - HyperClovaX is a large language model developed by [Naver](https://clova-x.naver.com/welcome). It's a powerful and purpose-trained LLM. - You can visit the embedding service provided by [ClovaX](https://www.ncloud.com/product/aiService/clovaStudio) - You may get CLOVA_EMB_API_KEY, CLOVA_EMB_APIGW_API_KEY, CLOVA_EMB_APP_ID From https://www.ncloud.com/product/aiService/clovaStudio --------- Co-authored-by: Bagatur <baskaryan@gmail.com>	2 months ago