5520 Commits (60d009f75a3cab23085e53a5413d9125474a840f)

 

All Branches   

Search

Author	SHA1	Message	Date
Bagatur	3fbb2f3e52	update chains how to (#12362)	10 months ago
Tyler Hutcherson	2f0c9d8269	Fix redis vectorfield schema defaults (#12223) ... - **Description:** refactors the redis vector field schema to properly handle default values, includes a new unit test suite. - **Issue:** N/A - **Dependencies:** nothing new. - **Tag maintainer:** @baskaryan @Spartee - **Twitter handle:** this is a tiny fix/improvement :) This issue was causing some clients/cuatomers issues when building a vector index on Redis on smaller db instances (due to fault default values in index configuration). It would raise an error like: ```redis.exceptions.ResponseError: Vector index initial capacity 20000 exceeded server limit (852 with the given parameters)``` This PR will address this moving forward.	10 months ago
Jakub Novák	9544d64ad8	E2B tool - Improve description wuth uploaded files info (#12355)	10 months ago
Bagatur	dad16af711	langserve doc (#12357)	10 months ago
Lance Martin	0af6e64ad9	Update multi query template README, ntbk (#12356)	10 months ago
Bagatur	f3449ccd20	Docs: Add lcel to combine_docs chains (#12310)	10 months ago
Lance Martin	bc6f6e968e	Add template for Pinecone + Multi-Query (#12353)	10 months ago
Bagatur	c6a733802b	bump 324 and 35 (#12352)	10 months ago
Nuno Campos	683e97766d	Fix json key output parser in partial (streaming) mode (#12332) ... <!-- Thank you for contributing to LangChain! Replace this entire comment with: - **Description:** a description of the change, - **Issue:** the issue # it fixes (if applicable), - **Dependencies:** any dependencies required for this change, - **Tag maintainer:** for a quicker response, tag the relevant maintainer (see below), - **Twitter handle:** we announce bigger features on Twitter. If your PR gets announced, and you'd like a mention, we'll gladly shout you out! Please make sure your PR is passing linting and testing before submitting. Run `make format`, `make lint` and `make test` to check this locally. See contribution guidelines for more information on how to write/run tests, lint, etc: https://github.com/langchain-ai/langchain/blob/master/.github/CONTRIBUTING.md If you're adding a new integration, please include: 1. a test for the integration, preferably unit tests that do not rely on network access, 2. an example notebook showing its use. It lives in `docs/extras` directory. If no one reviews your PR within a few days, please @-mention one of @baskaryan, @eyurtsev, @hwchase17. -->	10 months ago
Nikhil Jha	dff24285ea	Comprehend Moderation 0.2 (#11730) ... This PR replaces the previous `Intent` check with the new `Prompt Safety` check. The logic and steps to enable chain moderation via the Amazon Comprehend service, allowing you to detect and redact PII, Toxic, and Prompt Safety information in the LLM prompt or answer remains unchanged. This implementation updates the code and configuration types with respect to `Prompt Safety`. ### Usage sample ```python from langchain_experimental.comprehend_moderation import (BaseModerationConfig, ModerationPromptSafetyConfig, ModerationPiiConfig, ModerationToxicityConfig ) pii_config = ModerationPiiConfig( labels=["SSN"], redact=True, mask_character="X" ) toxicity_config = ModerationToxicityConfig( threshold=0.5 ) prompt_safety_config = ModerationPromptSafetyConfig( threshold=0.5 ) moderation_config = BaseModerationConfig( filters=[pii_config, toxicity_config, prompt_safety_config] ) comp_moderation_with_config = AmazonComprehendModerationChain( moderation_config=moderation_config, #specify the configuration client=comprehend_client, #optionally pass the Boto3 Client verbose=True ) template = """Question: {question} Answer:""" prompt = PromptTemplate(template=template, input_variables=["question"]) responses = [ "Final Answer: A credit card number looks like 1289-2321-1123-2387. A fake SSN number looks like 323-22-9980. John Doe's phone number is (999)253-9876.", "Final Answer: This is a really shitty way of constructing a birdhouse. This is fucking insane to think that any birds would actually create their motherfucking nests here." ] llm = FakeListLLM(responses=responses) llm_chain = LLMChain(prompt=prompt, llm=llm) chain = ( prompt | comp_moderation_with_config | {llm_chain.input_keys[0]: lambda x: x['output'] } | llm_chain | { "input": lambda x: x['text'] } | comp_moderation_with_config ) try: response = chain.invoke({"question": "A sample SSN number looks like this 123-456-7890. Can you give me some more samples?"}) except Exception as e: print(str(e)) else: print(response['output']) ``` ### Output ```python > Entering new AmazonComprehendModerationChain chain... Running AmazonComprehendModerationChain... Running pii Validation... Running toxicity Validation... Running prompt safety Validation... > Finished chain. > Entering new AmazonComprehendModerationChain chain... Running AmazonComprehendModerationChain... Running pii Validation... Running toxicity Validation... Running prompt safety Validation... > Finished chain. Final Answer: A credit card number looks like 1289-2321-1123-2387. A fake SSN number looks like XXXXXXXXXXXX John Doe's phone number is (999)253-9876. ``` --------- Co-authored-by: Jha <nikjha@amazon.com> Co-authored-by: Anjan Biswas <anjanavb@amazon.com> Co-authored-by: Anjan Biswas <84933469+anjanvb@users.noreply.github.com>	10 months ago
Blake (Yung Cher Ho)	b9410f2b6f	Takeoff pro support (#12070) ... **Description:** This PR adds support for the [Pro version of Titan Takeoff Server](https://docs.titanml.co/docs/category/pro-features). Users of the Pro version will have to import the TitanTakeoffPro model, which is different from TitanTakeoff. **Issue:** Also minor fixes to docs for Titan Takeoff (Community version) **Dependencies:** No additional dependencies **Twitter handle:** @becoming_blake @baskaryan @hwchase17	10 months ago
Leonid Kuligin	4e47fe1dce	fixed error message and a check for processor name (#12200) ... Replace this entire comment with: - **Description:** a small fix on error description / a check for processor name - **Issue:** the issue #11407	10 months ago
Nir Kopler	9298aff783	Finetuned openai azure models cost calculation (#12267) ... **Description:** Add cost calculation for fine tuned **Azure** with relevant unit tests. see https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/fine-tuning?tabs=turbo&pivots=programming-language-studio for more information. this PR is the result of this PR: https://github.com/langchain-ai/langchain/pull/12190 Twitter handle: @nirkopler	10 months ago
Ken	3c168d4d2a	Update code_understanding.ipynb (#12309) ... - **Description:** Super simple fix for colab link on code_understanding.ipynb, - **Issue:** not applicable - **Dependencies:** none, - **Tag maintainer:** , - **Twitter handle:** @kengoodridge	10 months ago
Season Saw	4e4b8805d6	Fix a typo in the summarization use case. (#12316) ... - **Description:** Fix a tiny typo in the summarization use case Jupyter notebook. - **Issue:** N/A - **Dependencies:** N/A - **Tag maintainer:** @hwchase17 - **Twitter handle:** @seasonsaw	10 months ago
gnakw	20fe515f20	Fix the exception from langchain.utilities import ArceeWrapper (#12342) ... - **Description:** Fix the exception from langchain.utilities import ArceeWrapper	10 months ago
ZC Wong	374f4cd2bf	fix typo (#12338) ... fixed a typo in docs/docs/integrations/toolkits/github.ipynb	10 months ago
Qihui Xie	6720458c7d	add allowed_operators property in QdrantTranslator (#12328) ... - **Description:** This PR adds `allowd_operators` property to `QdrantTranslator` to fix the `TypeError: can only join an iterable` bug. This property is required in `get_query_constructor_prompt` in `query_constructor\base.py`: ``` allowed_operators=" | ".join(allowed_operators), ``` - **Issue:** #12061 --------- Co-authored-by: XIE Qihui <qihui.xie@bopufund.com>	10 months ago
Bagatur	f5a57fc1ef	fix self query constructor (#12349)	10 months ago
Laurent AJDNIK	f05c29180d	Fix typos in quickstart.mdx (#12333) ... - **Description:** Fixes a few typos in quickstart.mdx	10 months ago
Kishan Kumar Rai	cae6f611d3	Fix Typo in CONTRIBUTING.md (#12320) ... I have corrected the typos, grammar, and formatting issues.	10 months ago
Vasek Mlejnsky	cdd75b687e	e2b tool - fix initialization and improve tool description (#12345)	10 months ago
Harrison Chase	8ec7aade9f	add docs for templates (#12346)	10 months ago
Jacob Lee	28c39503eb	Allow index name customization via env var in rag-conversation (#12315)	10 months ago
Leonid Ganeline	869a49a0ab	removed CardLists for LLMs and ChatModels (#12307) ... Problem statement: In the `integrations/llms` and `integrations/chat` pages, we have a sidebar with ToC, and we also have a ToC at the end of the page. The ToC at the end of the page is not necessary, and it is confusing when we mix the index page styles; moreover, it requires manual work. So, I removed ToC at the end of the page (it was discussed with and approved by @baskaryan)	10 months ago
Erick Friis	ebf998acb6	Templates (#12294) ... Co-authored-by: Harrison Chase <hw.chase.17@gmail.com> Co-authored-by: Lance Martin <lance@langchain.dev> Co-authored-by: Jacob Lee <jacoblee93@gmail.com>	10 months ago
Erick Friis	43257a295c	CLI Git Improvements (#12311) ... - delete repo sources like pip - git dep fixes - error messaging	10 months ago
William FH	1d568e1add	Better wrap traceable (#12303) ... If user function is wrapped as a traceable function, this will help hand off the trace between the two. Also update handling fields to reflect optional values	10 months ago
Eugene Yurtsev	5a71b81609	Relax type annotation for custom input/output types (#12300) ... This is needed to be able to do stuff like: ```python runnable.with_types(input_type=List[str]) ```	10 months ago
William FH	988f6d9912	Rm langchain server (#12305)	10 months ago
wemysschen	3f16acc538	Add baidu cloud vector search in vectorstore and fix some unit test in vectorstores (#11605) ... **Description:** Add baidu cloud vector search in vectorstore --------- Co-authored-by: root <root@icoding-cwx.bcc-szzj.baidu.com> Co-authored-by: Bagatur <baskaryan@gmail.com>	10 months ago
mrbean	b7e559c7e1	use snippet search optionally (#12236) ... Add an additional flag which allows for hitting our new endpoint.	10 months ago
felixocker	cce132d146	fix sparql queries for relations in schema description (#9136) ... - **Description**: Fix for the SPARQL QA chain: fixed SPARQL queries for retrieving information about relations in the graph to create a textual description of the schema for the language model. This should resolve #8907 - **Issue**: #8907 - **Dependencies**: None - **Tag maintainer**: @baskaryan, @hwchase17	10 months ago
Donato Azevedo	d9f1bcf366	Strips leading/trailing whitespace before parsing xml (#12297) ... **Description:** When llms output leading or trailing whitespace for xml (when using XMLOutputParser) the parser would raise a `ValueError: Could not parse output: ...`. However, leading or trailing whitespace are "ignorable" in the sense of XML standard. **Issue:** I did not find an issue related. **Dependencies:** None **Tag maintainer:** **Twitter handle:** donatoaz Please make sure your PR is passing linting and testing before submitting. Run `make format`, `make lint` and `make test` to check this locally. Done, updated unit test and ran `make docker_test`.	10 months ago
Rohan Sharma	3da1a65fa0	Update README.md (#12286)	10 months ago
Bagatur	ab3c124ffb	Add dev guide to docs(#12291) ... copy CONTRIBUTING.md to docs	10 months ago
Bagatur	aa212c3d0e	rm .html from local doc links (#12293)	10 months ago
Silva	04d58018e1	Update vectorstore.mdx[Make an improvement] (#12252) ... correct some grammatical errors	10 months ago
Bagatur	3d74d5e24d	chat loader doc titles (#12289)	10 months ago
Erick Friis	47070b8314	CLI (#12284) ... Co-authored-by: Harrison Chase <hw.chase.17@gmail.com>	10 months ago
Shwu Ku	07c2649753	response parser for ArceeRetriever (#12270) ... - **Description:** Response parser for arcee retriever, - **Issue:** follow-up pr on #11578 and [discussion](https://github.com/arcee-ai/arcee-python/issues/15#issuecomment-1759874053), - **Dependencies:** NA This pr implements a parser for the response from ArceeRetreiver to convert to langchain `Document`. This closes the loop of generation and retrieval for Arcee DALMs in langchain. The reference for the response parser is [api-docs:retrieve](https://api.arcee.ai/docs#/v2/retrieve_model) Attaching screenshot of working implementation: <img width="1984" alt="Screenshot 2023-10-25 at 7 42 34 PM" src="https://github.com/langchain-ai/langchain/assets/65639964/026987b9-34b2-4e4b-b87d-69fcd0c6641a"> \*api key deleted --- Successful tests, lints, etc. ```shell Re-run pytest with --snapshot-update to delete unused snapshots. ==================================================================================================================== slowest 5 durations ===================================================================================================================== 1.56s call tests/unit_tests/schema/runnable/test_runnable.py::test_retrying 0.63s call tests/unit_tests/schema/runnable/test_runnable.py::test_map_astream 0.33s call tests/unit_tests/schema/runnable/test_runnable.py::test_map_stream_iterator_input 0.30s call tests/unit_tests/schema/runnable/test_runnable.py::test_map_astream_iterator_input 0.20s call tests/unit_tests/indexes/test_indexing.py::test_cleanup_with_different_batchsize ======================================================================================================= 1265 passed, 270 skipped, 32 warnings in 6.55s ======================================================================================================= [ "." = "" ] || poetry run black . All done! ✨ 🍰 ✨ 1871 files left unchanged. [ "." = "" ] || poetry run ruff --select I --fix . ./scripts/check_pydantic.sh . ./scripts/check_imports.sh poetry run ruff . [ "." = "" ] || poetry run black . --check All done! ✨ 🍰 ✨ 1871 files would be left unchanged. [ "." = "" ] || poetry run mypy . Success: no issues found in 1868 source files poetry run codespell --toml pyproject.toml poetry run codespell --toml pyproject.toml -w ``` Co-authored-by: Shubham Kushwaha <shwu@Shubhams-MacBook-Pro.local>	10 months ago
Johanna Appel	c26ec7789f	CohereEmbeddings: Add max_retries and request_timeout (#12275) ... Add max_retries and request_timeout to CohereEmbeddings, akin to how it works in OpenAIEmbeddings. Since the Cohere client already implements these parameters, we can simply pass them down. Uses parameters from these two cohere client objects: https://github.com/cohere-ai/cohere-python/blob/main/cohere/client.py https://github.com/cohere-ai/cohere-python/blob/main/cohere/client_async.py	10 months ago
Nuno Campos	7108084947	Remove CLI (#12283) ... <!-- Thank you for contributing to LangChain! Replace this entire comment with: - **Description:** a description of the change, - **Issue:** the issue # it fixes (if applicable), - **Dependencies:** any dependencies required for this change, - **Tag maintainer:** for a quicker response, tag the relevant maintainer (see below), - **Twitter handle:** we announce bigger features on Twitter. If your PR gets announced, and you'd like a mention, we'll gladly shout you out! Please make sure your PR is passing linting and testing before submitting. Run `make format`, `make lint` and `make test` to check this locally. See contribution guidelines for more information on how to write/run tests, lint, etc: https://github.com/langchain-ai/langchain/blob/master/.github/CONTRIBUTING.md If you're adding a new integration, please include: 1. a test for the integration, preferably unit tests that do not rely on network access, 2. an example notebook showing its use. It lives in `docs/extras` directory. If no one reviews your PR within a few days, please @-mention one of @baskaryan, @eyurtsev, @hwchase17. -->	10 months ago
Nuno Campos	b5b2d07681	Pop max concurrency when recursing (#12281) ... <!-- Thank you for contributing to LangChain! Replace this entire comment with: - **Description:** a description of the change, - **Issue:** the issue # it fixes (if applicable), - **Dependencies:** any dependencies required for this change, - **Tag maintainer:** for a quicker response, tag the relevant maintainer (see below), - **Twitter handle:** we announce bigger features on Twitter. If your PR gets announced, and you'd like a mention, we'll gladly shout you out! Please make sure your PR is passing linting and testing before submitting. Run `make format`, `make lint` and `make test` to check this locally. See contribution guidelines for more information on how to write/run tests, lint, etc: https://github.com/langchain-ai/langchain/blob/master/.github/CONTRIBUTING.md If you're adding a new integration, please include: 1. a test for the integration, preferably unit tests that do not rely on network access, 2. an example notebook showing its use. It lives in `docs/extras` directory. If no one reviews your PR within a few days, please @-mention one of @baskaryan, @eyurtsev, @hwchase17. -->	10 months ago
Bagatur	69f4e402e4	bump 323 (#12278)	10 months ago
David Duong	c25b174db5	Add serialisation props to Fireworks and ChatFireworks (#12255)	10 months ago
Richard Adams	fd5f549a9e	demonstrate use of RetrievalQAWithSourcesChain.from_chain (#12235) ... **Description:** Documents further usage of RetrievalQAWithSourcesChain in an existing test. I'd not found much documented usage of RetrievalQAWithSourcesChain and how to get the sources out. This additional code will hopefully be useful to other potential users of this retriever. **Issue:** No raised issue **Dependencies:** No new dependencies needed to run the test (it already needs `open-ai`, `faiss-cpu` and `unstructured`). Note - `make lint` showed 8 linting errors in unrelated files --------- Co-authored-by: richarda23 <richard.c.adams@infinityworks.com>	10 months ago
James Braza	53f35c5f5c	Adding `STRUCTURED_FORMAT_SIMPLE_INSTRUCTIONS` missing backticks (#12238) ... This PR fixes the fact that `STRUCTURED_FORMAT_SIMPLE_INSTRUCTIONS` was missing backticks at the end	10 months ago
Adam Ji	9fc28d50c3	fix: typo in pgvector.ipynb (#12243) ... fix: typo in docs/docs/integrations/vectorstores/pgvector.ipynb	10 months ago
William FH	276c6ba115	Check for ls project in run tree context (#12242) ... If I go traceable -> runnable when the project is manually specified, the runnable wont be logged. This makes sure the session/project is threaded through appropriately.	10 months ago