1559 Commits (3fbb2f3e52f3f38014bddb7356d9081c4409ea75)

Author	SHA1	Message	Date
Tyler Hutcherson	2f0c9d8269	Fix redis vectorfield schema defaults (#12223) ... - **Description:** refactors the redis vector field schema to properly handle default values, includes a new unit test suite. - **Issue:** N/A - **Dependencies:** nothing new. - **Tag maintainer:** @baskaryan @Spartee - **Twitter handle:** this is a tiny fix/improvement :) This issue was causing some clients/cuatomers issues when building a vector index on Redis on smaller db instances (due to fault default values in index configuration). It would raise an error like: ```redis.exceptions.ResponseError: Vector index initial capacity 20000 exceeded server limit (852 with the given parameters)``` This PR will address this moving forward.	11 months ago
Jakub Novák	9544d64ad8	E2B tool - Improve description wuth uploaded files info (#12355)	11 months ago
Bagatur	c6a733802b	bump 324 and 35 (#12352)	11 months ago
Nuno Campos	683e97766d	Fix json key output parser in partial (streaming) mode (#12332) ... <!-- Thank you for contributing to LangChain! Replace this entire comment with: - **Description:** a description of the change, - **Issue:** the issue # it fixes (if applicable), - **Dependencies:** any dependencies required for this change, - **Tag maintainer:** for a quicker response, tag the relevant maintainer (see below), - **Twitter handle:** we announce bigger features on Twitter. If your PR gets announced, and you'd like a mention, we'll gladly shout you out! Please make sure your PR is passing linting and testing before submitting. Run `make format`, `make lint` and `make test` to check this locally. See contribution guidelines for more information on how to write/run tests, lint, etc: https://github.com/langchain-ai/langchain/blob/master/.github/CONTRIBUTING.md If you're adding a new integration, please include: 1. a test for the integration, preferably unit tests that do not rely on network access, 2. an example notebook showing its use. It lives in `docs/extras` directory. If no one reviews your PR within a few days, please @-mention one of @baskaryan, @eyurtsev, @hwchase17. -->	11 months ago
Nikhil Jha	dff24285ea	Comprehend Moderation 0.2 (#11730) ... This PR replaces the previous `Intent` check with the new `Prompt Safety` check. The logic and steps to enable chain moderation via the Amazon Comprehend service, allowing you to detect and redact PII, Toxic, and Prompt Safety information in the LLM prompt or answer remains unchanged. This implementation updates the code and configuration types with respect to `Prompt Safety`. ### Usage sample ```python from langchain_experimental.comprehend_moderation import (BaseModerationConfig, ModerationPromptSafetyConfig, ModerationPiiConfig, ModerationToxicityConfig ) pii_config = ModerationPiiConfig( labels=["SSN"], redact=True, mask_character="X" ) toxicity_config = ModerationToxicityConfig( threshold=0.5 ) prompt_safety_config = ModerationPromptSafetyConfig( threshold=0.5 ) moderation_config = BaseModerationConfig( filters=[pii_config, toxicity_config, prompt_safety_config] ) comp_moderation_with_config = AmazonComprehendModerationChain( moderation_config=moderation_config, #specify the configuration client=comprehend_client, #optionally pass the Boto3 Client verbose=True ) template = """Question: {question} Answer:""" prompt = PromptTemplate(template=template, input_variables=["question"]) responses = [ "Final Answer: A credit card number looks like 1289-2321-1123-2387. A fake SSN number looks like 323-22-9980. John Doe's phone number is (999)253-9876.", "Final Answer: This is a really shitty way of constructing a birdhouse. This is fucking insane to think that any birds would actually create their motherfucking nests here." ] llm = FakeListLLM(responses=responses) llm_chain = LLMChain(prompt=prompt, llm=llm) chain = ( prompt | comp_moderation_with_config | {llm_chain.input_keys[0]: lambda x: x['output'] } | llm_chain | { "input": lambda x: x['text'] } | comp_moderation_with_config ) try: response = chain.invoke({"question": "A sample SSN number looks like this 123-456-7890. Can you give me some more samples?"}) except Exception as e: print(str(e)) else: print(response['output']) ``` ### Output ```python > Entering new AmazonComprehendModerationChain chain... Running AmazonComprehendModerationChain... Running pii Validation... Running toxicity Validation... Running prompt safety Validation... > Finished chain. > Entering new AmazonComprehendModerationChain chain... Running AmazonComprehendModerationChain... Running pii Validation... Running toxicity Validation... Running prompt safety Validation... > Finished chain. Final Answer: A credit card number looks like 1289-2321-1123-2387. A fake SSN number looks like XXXXXXXXXXXX John Doe's phone number is (999)253-9876. ``` --------- Co-authored-by: Jha <nikjha@amazon.com> Co-authored-by: Anjan Biswas <anjanavb@amazon.com> Co-authored-by: Anjan Biswas <84933469+anjanvb@users.noreply.github.com>	11 months ago
Blake (Yung Cher Ho)	b9410f2b6f	Takeoff pro support (#12070) ... **Description:** This PR adds support for the [Pro version of Titan Takeoff Server](https://docs.titanml.co/docs/category/pro-features). Users of the Pro version will have to import the TitanTakeoffPro model, which is different from TitanTakeoff. **Issue:** Also minor fixes to docs for Titan Takeoff (Community version) **Dependencies:** No additional dependencies **Twitter handle:** @becoming_blake @baskaryan @hwchase17	11 months ago
Leonid Kuligin	4e47fe1dce	fixed error message and a check for processor name (#12200) ... Replace this entire comment with: - **Description:** a small fix on error description / a check for processor name - **Issue:** the issue #11407	11 months ago
Nir Kopler	9298aff783	Finetuned openai azure models cost calculation (#12267) ... **Description:** Add cost calculation for fine tuned **Azure** with relevant unit tests. see https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/fine-tuning?tabs=turbo&pivots=programming-language-studio for more information. this PR is the result of this PR: https://github.com/langchain-ai/langchain/pull/12190 Twitter handle: @nirkopler	11 months ago
gnakw	20fe515f20	Fix the exception from langchain.utilities import ArceeWrapper (#12342) ... - **Description:** Fix the exception from langchain.utilities import ArceeWrapper	11 months ago
Qihui Xie	6720458c7d	add allowed_operators property in QdrantTranslator (#12328) ... - **Description:** This PR adds `allowd_operators` property to `QdrantTranslator` to fix the `TypeError: can only join an iterable` bug. This property is required in `get_query_constructor_prompt` in `query_constructor\base.py`: ``` allowed_operators=" | ".join(allowed_operators), ``` - **Issue:** #12061 --------- Co-authored-by: XIE Qihui <qihui.xie@bopufund.com>	11 months ago
Bagatur	f5a57fc1ef	fix self query constructor (#12349)	11 months ago
Vasek Mlejnsky	cdd75b687e	e2b tool - fix initialization and improve tool description (#12345)	11 months ago
Harrison Chase	8ec7aade9f	add docs for templates (#12346)	11 months ago
Erick Friis	ebf998acb6	Templates (#12294) ... Co-authored-by: Harrison Chase <hw.chase.17@gmail.com> Co-authored-by: Lance Martin <lance@langchain.dev> Co-authored-by: Jacob Lee <jacoblee93@gmail.com>	11 months ago
Erick Friis	43257a295c	CLI Git Improvements (#12311) ... - delete repo sources like pip - git dep fixes - error messaging	11 months ago
William FH	1d568e1add	Better wrap traceable (#12303) ... If user function is wrapped as a traceable function, this will help hand off the trace between the two. Also update handling fields to reflect optional values	11 months ago
Eugene Yurtsev	5a71b81609	Relax type annotation for custom input/output types (#12300) ... This is needed to be able to do stuff like: ```python runnable.with_types(input_type=List[str]) ```	11 months ago
William FH	988f6d9912	Rm langchain server (#12305)	11 months ago
wemysschen	3f16acc538	Add baidu cloud vector search in vectorstore and fix some unit test in vectorstores (#11605) ... **Description:** Add baidu cloud vector search in vectorstore --------- Co-authored-by: root <root@icoding-cwx.bcc-szzj.baidu.com> Co-authored-by: Bagatur <baskaryan@gmail.com>	11 months ago
mrbean	b7e559c7e1	use snippet search optionally (#12236) ... Add an additional flag which allows for hitting our new endpoint.	11 months ago
felixocker	cce132d146	fix sparql queries for relations in schema description (#9136) ... - **Description**: Fix for the SPARQL QA chain: fixed SPARQL queries for retrieving information about relations in the graph to create a textual description of the schema for the language model. This should resolve #8907 - **Issue**: #8907 - **Dependencies**: None - **Tag maintainer**: @baskaryan, @hwchase17	11 months ago
Donato Azevedo	d9f1bcf366	Strips leading/trailing whitespace before parsing xml (#12297) ... **Description:** When llms output leading or trailing whitespace for xml (when using XMLOutputParser) the parser would raise a `ValueError: Could not parse output: ...`. However, leading or trailing whitespace are "ignorable" in the sense of XML standard. **Issue:** I did not find an issue related. **Dependencies:** None **Tag maintainer:** **Twitter handle:** donatoaz Please make sure your PR is passing linting and testing before submitting. Run `make format`, `make lint` and `make test` to check this locally. Done, updated unit test and ran `make docker_test`.	11 months ago
Erick Friis	47070b8314	CLI (#12284) ... Co-authored-by: Harrison Chase <hw.chase.17@gmail.com>	11 months ago
Shwu Ku	07c2649753	response parser for ArceeRetriever (#12270) ... - **Description:** Response parser for arcee retriever, - **Issue:** follow-up pr on #11578 and [discussion](https://github.com/arcee-ai/arcee-python/issues/15#issuecomment-1759874053), - **Dependencies:** NA This pr implements a parser for the response from ArceeRetreiver to convert to langchain `Document`. This closes the loop of generation and retrieval for Arcee DALMs in langchain. The reference for the response parser is [api-docs:retrieve](https://api.arcee.ai/docs#/v2/retrieve_model) Attaching screenshot of working implementation: <img width="1984" alt="Screenshot 2023-10-25 at 7 42 34 PM" src="https://github.com/langchain-ai/langchain/assets/65639964/026987b9-34b2-4e4b-b87d-69fcd0c6641a"> \*api key deleted --- Successful tests, lints, etc. ```shell Re-run pytest with --snapshot-update to delete unused snapshots. ==================================================================================================================== slowest 5 durations ===================================================================================================================== 1.56s call tests/unit_tests/schema/runnable/test_runnable.py::test_retrying 0.63s call tests/unit_tests/schema/runnable/test_runnable.py::test_map_astream 0.33s call tests/unit_tests/schema/runnable/test_runnable.py::test_map_stream_iterator_input 0.30s call tests/unit_tests/schema/runnable/test_runnable.py::test_map_astream_iterator_input 0.20s call tests/unit_tests/indexes/test_indexing.py::test_cleanup_with_different_batchsize ======================================================================================================= 1265 passed, 270 skipped, 32 warnings in 6.55s ======================================================================================================= [ "." = "" ] || poetry run black . All done! ✨ 🍰 ✨ 1871 files left unchanged. [ "." = "" ] || poetry run ruff --select I --fix . ./scripts/check_pydantic.sh . ./scripts/check_imports.sh poetry run ruff . [ "." = "" ] || poetry run black . --check All done! ✨ 🍰 ✨ 1871 files would be left unchanged. [ "." = "" ] || poetry run mypy . Success: no issues found in 1868 source files poetry run codespell --toml pyproject.toml poetry run codespell --toml pyproject.toml -w ``` Co-authored-by: Shubham Kushwaha <shwu@Shubhams-MacBook-Pro.local>	11 months ago
Johanna Appel	c26ec7789f	CohereEmbeddings: Add max_retries and request_timeout (#12275) ... Add max_retries and request_timeout to CohereEmbeddings, akin to how it works in OpenAIEmbeddings. Since the Cohere client already implements these parameters, we can simply pass them down. Uses parameters from these two cohere client objects: https://github.com/cohere-ai/cohere-python/blob/main/cohere/client.py https://github.com/cohere-ai/cohere-python/blob/main/cohere/client_async.py	11 months ago
Nuno Campos	7108084947	Remove CLI (#12283) ... <!-- Thank you for contributing to LangChain! Replace this entire comment with: - **Description:** a description of the change, - **Issue:** the issue # it fixes (if applicable), - **Dependencies:** any dependencies required for this change, - **Tag maintainer:** for a quicker response, tag the relevant maintainer (see below), - **Twitter handle:** we announce bigger features on Twitter. If your PR gets announced, and you'd like a mention, we'll gladly shout you out! Please make sure your PR is passing linting and testing before submitting. Run `make format`, `make lint` and `make test` to check this locally. See contribution guidelines for more information on how to write/run tests, lint, etc: https://github.com/langchain-ai/langchain/blob/master/.github/CONTRIBUTING.md If you're adding a new integration, please include: 1. a test for the integration, preferably unit tests that do not rely on network access, 2. an example notebook showing its use. It lives in `docs/extras` directory. If no one reviews your PR within a few days, please @-mention one of @baskaryan, @eyurtsev, @hwchase17. -->	11 months ago
Nuno Campos	b5b2d07681	Pop max concurrency when recursing (#12281) ... <!-- Thank you for contributing to LangChain! Replace this entire comment with: - **Description:** a description of the change, - **Issue:** the issue # it fixes (if applicable), - **Dependencies:** any dependencies required for this change, - **Tag maintainer:** for a quicker response, tag the relevant maintainer (see below), - **Twitter handle:** we announce bigger features on Twitter. If your PR gets announced, and you'd like a mention, we'll gladly shout you out! Please make sure your PR is passing linting and testing before submitting. Run `make format`, `make lint` and `make test` to check this locally. See contribution guidelines for more information on how to write/run tests, lint, etc: https://github.com/langchain-ai/langchain/blob/master/.github/CONTRIBUTING.md If you're adding a new integration, please include: 1. a test for the integration, preferably unit tests that do not rely on network access, 2. an example notebook showing its use. It lives in `docs/extras` directory. If no one reviews your PR within a few days, please @-mention one of @baskaryan, @eyurtsev, @hwchase17. -->	11 months ago
Bagatur	69f4e402e4	bump 323 (#12278)	11 months ago
David Duong	c25b174db5	Add serialisation props to Fireworks and ChatFireworks (#12255)	11 months ago
Richard Adams	fd5f549a9e	demonstrate use of RetrievalQAWithSourcesChain.from_chain (#12235) ... **Description:** Documents further usage of RetrievalQAWithSourcesChain in an existing test. I'd not found much documented usage of RetrievalQAWithSourcesChain and how to get the sources out. This additional code will hopefully be useful to other potential users of this retriever. **Issue:** No raised issue **Dependencies:** No new dependencies needed to run the test (it already needs `open-ai`, `faiss-cpu` and `unstructured`). Note - `make lint` showed 8 linting errors in unrelated files --------- Co-authored-by: richarda23 <richard.c.adams@infinityworks.com>	11 months ago
James Braza	53f35c5f5c	Adding `STRUCTURED_FORMAT_SIMPLE_INSTRUCTIONS` missing backticks (#12238) ... This PR fixes the fact that `STRUCTURED_FORMAT_SIMPLE_INSTRUCTIONS` was missing backticks at the end	11 months ago
William FH	276c6ba115	Check for ls project in run tree context (#12242) ... If I go traceable -> runnable when the project is manually specified, the runnable wont be logged. This makes sure the session/project is threaded through appropriately.	11 months ago
Vasek Mlejnsky	1f8094938f	Integrate E2B's data analysis/code interpreter (#12011) ... This PR adds a data [E2B's](https://e2b.dev/) analysis/code interpreter sandbox as a tool --------- Co-authored-by: Bagatur <baskaryan@gmail.com> Co-authored-by: Jakub Novak <jakub@e2b.dev>	11 months ago
Bagatur	286a29a49e	bump 322 and 34 (#12228)	11 months ago
Eugene Yurtsev	583dc49477	Add type to Generation and sub-classes, handle root validator (#12220) ... * Add a type literal for the generation and sub-classes for serialization purposes. * Fix the root validator of ChatGeneration to return ValueError instead of KeyError or Attribute error if intialized improperly. * This change is done for langserve to make sure that llm related callbacks can be serialized/deserialized properly.	11 months ago
Eugene Yurtsev	81052ee18e	Fix code block in runnable doc (#12221) ... Fix code block syntax in runnable doc-string	11 months ago
Mikelarg	46e28b9613	Added GigaChat chat model support (#12201) ... - **Description:** Added integration with [GigaChat](https://developers.sber.ru/portal/products/gigachat) language model. - **Twitter handle:** @dvoshansky	11 months ago
Anurag Wagh	d5c2ce7c2e	[fix] create redis vector index before adding docs, add prefix to doc… (#11257) ... Fix Description: For Redis Vector integration in add_texts method, there were two issues that lead to this bug. 1. Vector index is not being created leading to no such_index error 2. `doc:index` prefix was also missing for Redis Keys. resolves #11197 Maintainer: @baskaryan --------- Co-authored-by: Bagatur <baskaryan@gmail.com>	11 months ago
Eugene Yurtsev	079d1f3b8e	Expose handle_event and ahandle_events as public API (#12181) ... Expose functionality to handle generic events.	11 months ago
William FH	67c4fd0ad0	Update deprecation (#12178) ... in runner_utils	11 months ago
Nir Kopler	d3744175bf	Finetuned OpenAI models cost calculation #11715 (#12190) ... **Description:** Add cost calculation for fine tuned models (new and legacy), this is required after OpenAI added new models for fine tuning and separated the costs of I/O for fine tuned models. Also I updated the relevant unit tests see https://platform.openai.com/docs/guides/fine-tuning for more information. issue: https://github.com/langchain-ai/langchain/issues/11715 - **Issue:** 11715 - **Twitter handle:** @nirkopler	11 months ago
Spyros	a2840a2b42	fix vertexai codey models (#12173) ... **Description:** This PR fixes issue #12156 by checking for Codey models appropriately before result parsing. Maintainer: @hwchase17 , @agola11	11 months ago
Hech	d76f026d72	Fix flexible dimension and doc for DingoDB (#12187)	11 months ago
Erick Friis	95ae40ff90	Fix Anthropic Functions ainvoke (#12215) ... Removes custom `NotImplementedError` in experimental anthropic functions, allowing it to fallback on default `ainvoke` implementation.	11 months ago
Iskren Ivov Chernev	d5d7ba582a	Improvements to llm/deepinfra (#10846) ... - replace `requests` package with `langchain.requests` - add `_acall` support - add `_stream` and `_astream` - freshen up the documentation a bit - update vendor doc	11 months ago
sudranga	f09f82541b	Expose configuration options in GraphCypherQAChain (#12159) ... Allows for passing arguments into the LLM chains used by the GraphCypherQAChain. This is to address a request by a user to include memory in the Cypher creating chain. Will keep the prompt variables as-is to be backward compatible. But, would be a good idea to deprecate them and use the **kwargs variables. Added a test case. In general, I think it would be good for any chain to automatically pass in a readonlymemory(of its input) to its subchains whilist allowing for an override. But, this would be a different change.	11 months ago
Leonid Ganeline	11f13aed53	docstrings update (#12093) ... Added missed docstrings. Added missed Args:, Returns: Raises:	11 months ago
Johnny Oshika	ba20c14e28	Fix typo in stuff_prompt's system_template (#12063) ... - **Description:** Add missing apostrophe in `user's` in stuff_prompt's system_template. The first sentence in the system template went from: > Use the following pieces of context to answer the users question. to > Use the following pieces of context to answer the user's question. - **Issue:** - **Dependencies:** none - **Tag maintainer:** @baskaryan - **Twitter handle:** ojohnnyo	11 months ago
Holt Skinner	69d9eae5cd	feat: Add Client Info to available Google Cloud Clients (#12168) ... - This is used internally to gather aggregate usage metrics for the LangChain integrations - Note: This cannot be added to some of the Vertex AI integrations at this time because the SDK doesn't allow overriding the [`ClientInfo`](https://googleapis.dev/python/google-api-core/latest/client_info.html#module-google.api_core.client_info) - Added to: - BigQuery - Google Cloud Storage - Document AI - Vertex AI Model Garden - Document AI Warehouse - Vertex AI Search - Vertex AI Matching Engine (Cloud Storage Client) @baskaryan, @eyurtsev, @hwchase17 --------- Co-authored-by: Eugene Yurtsev <eyurtsev@gmail.com>	11 months ago
Lukas Wolf	69f5f82804	Update extraction.py (#12207) ... Description: Pass tags as argument to create_extraction_chain Issue: create_extraction_chain does not pass tags to chain yet @baskaryan	11 months ago