3365 Commits (be3dd62de46bff8138d66f316c20e6fdefcaf793)

Author	SHA1	Message	Date
Bagatur	209de0a561	anthropic[minor]: tool use (#20016)	3 months ago
Jacob Lee	7f0cb3bfba	docs[patch]: Make Docusaurus and Vercel add trailing slashes when navigating by default (#20014) ... Should hopefully avoid weird broken link edge cases. Relative links now trip up the Docusaurus broken link checker, so this PR also removes them. Also snuck in a small addition about asyncio	3 months ago
Christophe Bornet	02152d3909	[docs][minor]: Fix typo in Custom Document Loader doc (#20003)	3 months ago
Jacob Lee	605c3f23e1	docs: reorg and visual refresh (#19765) ... - put use cases in main sidebar - move modules to own sidebar, rename components - cleanup lcel section - cleanup guides - update font, cell highlighting --------- Co-authored-by: Chester Curme <chester.curme@gmail.com> Co-authored-by: Bagatur <baskaryan@gmail.com>	3 months ago
Graden Rea	88cf8a2905	groq: Add tool calling support (#19971) ... **Description:** Add with_structured_output to groq chat models **Issue:** **Dependencies:** N/A **Twitter handle:** N/A	3 months ago
Eugene Yurtsev	ea276d6547	docs: Custom Document Loaders (#19935) ... Add information that shows how to create custom document loaders	3 months ago
happy-go-lucky	c6432abdbe	community[patch]: Implement delete method and all async methods in opensearch_vector_search (#17321) ... - **Description:** In order to use index and aindex in libs/langchain/langchain/indexes/_api.py, I implemented delete method and all async methods in opensearch_vector_search - **Dependencies:** No changes	3 months ago
Cheng, Penghui	cc407e8a1b	community[minor]: weight only quantization with intel-extension-for-transformers. (#14504) ... Support weight only quantization with intel-extension-for-transformers. [Intel® Extension for Transformers](https://github.com/intel/intel-extension-for-transformers) is an innovative toolkit to accelerate Transformer-based models on Intel platforms, in particular effective on 4th Intel Xeon Scalable processor [Sapphire Rapids](https://www.intel.com/content/www/us/en/products/docs/processors/xeon-accelerated/4th-gen-xeon-scalable-processors.html) (codenamed Sapphire Rapids). The toolkit provides the below key features: * Seamless user experience of model compressions on Transformer-based models by extending [Hugging Face transformers](https://github.com/huggingface/transformers) APIs and leveraging [Intel® Neural Compressor](https://github.com/intel/neural-compressor) * Advanced software optimizations and unique compression-aware runtime. * Optimized Transformer-based model packages. * [NeuralChat](https://github.com/intel/intel-extension-for-transformers/blob/main/intel_extension_for_transformers/neural_chat), a customizable chatbot framework to create your own chatbot within minutes by leveraging a rich set of plugins and SOTA optimizations. * [Inference](https://github.com/intel/intel-extension-for-transformers/blob/main/intel_extension_for_transformers/llm/runtime/graph) of Large Language Model (LLM) in pure C/C++ with weight-only quantization kernels. This PR is an integration of weight only quantization feature with intel-extension-for-transformers. Unit test is in lib/langchain/tests/integration_tests/llm/test_weight_only_quantization.py The notebook is in docs/docs/integrations/llms/weight_only_quantization.ipynb. The document is in docs/docs/integrations/providers/weight_only_quantization.mdx. --------- Signed-off-by: Cheng, Penghui <penghui.cheng@intel.com> Co-authored-by: Bagatur <22008038+baskaryan@users.noreply.github.com> Co-authored-by: Bagatur <baskaryan@gmail.com>	3 months ago
aditya thomas	73ebe78249	docs: update cohere documentation (#19700) ... **Description:** Update of Cohere documentation (main provider page) **Issue:** After addition of the Cohere partner package, the documentation was out of date **Dependencies:** None --------- Co-authored-by: Chester Curme <chester.curme@gmail.com>	4 months ago
Wang Guan	8638029a37	docs: mention caveats with CacheBackedEmbeddings.embed_query (#19926) ... Thank you for contributing to LangChain! - [x] **PR title**: "package: description" - Where "package" is whichever of langchain, community, core, experimental, etc. is being modified. Use "docs: ..." for purely docs changes, "templates: ..." for template changes, "infra: ..." for CI changes. - Example: "community: add foobar LLM" - [x] **PR message**: - **Description:** mention not-caching methods in CacheBackedEmbeddings - **Issue:** n/a I almost created one until I read the code - **Dependencies:** n/a - **Twitter handle:** `tarsylia` - [ ] **Add tests and docs**: If you're adding a new integration, please include 1. a test for the integration, preferably unit tests that do not rely on network access, 2. an example notebook showing its use. It lives in `docs/docs/integrations` directory. - [ ] **Lint and test**: Run `make format`, `make lint` and `make test` from the root of the package(s) you've modified. See contribution guidelines for more: https://python.langchain.com/docs/contributing/ Additional guidelines: - Make sure optional dependencies are imported within a function. - Please do not add dependencies to pyproject.toml files (even optional ones) unless they are required for unit tests. - Most PRs should not touch more than one package. - Changes should be backwards compatible. - If you are adding something to community, do not re-import it in langchain. If no one reviews your PR within a few days, please @-mention one of baskaryan, efriis, eyurtsev, hwchase17.	4 months ago
billytrend-cohere	de6c0cf248	cohere, docs: update imports and installs to langchain_cohere (#19918) ... cohere: update imports and installs to langchain_cohere --------- Co-authored-by: Harry M <127103098+harry-cohere@users.noreply.github.com> Co-authored-by: Erick Friis <erick@langchain.dev>	4 months ago
Jamsheed Mistri	4f70bc119d	community[minor]: add Layerup Security integration (#19787) ... **Description:** adds integration with [Layerup Security](https://uselayerup.com). Docs can be found [here](https://docs.uselayerup.com). Integrates directly with our Python SDK. **Dependencies:** [LayerupSecurity](https://pypi.org/project/LayerupSecurity/) **Note**: all methods for our product require a paid API key, so I only included 1 test which checks for an invalid API key response. I have tested extensively locally. **Twitter handle**: [@layerup_](https://twitter.com/layerup_) --------- Co-authored-by: Bagatur <baskaryan@gmail.com>	4 months ago
Brace Sproul	22f78c37c8	docs[patch]: Hide google from function calling docs (#19887)	4 months ago
Mahdi Setayesh	c28efb878c	text-splitters[minor]: Adding a new section aware splitter to langchain (#16526) ... - **Description:** the layout of html pages can be variant based on the bootstrap framework or the styles of the pages. So we need to have a splitter to transform the html tags to a proper layout and then split the html content based on the provided list of tags to determine its html sections. We are using BS4 library along with xslt structure to split the html content using an section aware approach. - **Dependencies:** No new dependencies - **Twitter handle:** @m_setayesh Please make sure your PR is passing linting and testing before submitting. Run `make format`, `make lint` and `make test` from the root of the package you've modified to check this locally. See contribution guidelines for more information on how to write/run tests, lint, etc: https://python.langchain.com/docs/contributing/ If you're adding a new integration, please include: 1. a test for the integration, preferably unit tests that do not rely on network access, 2. an example notebook showing its use. It lives in `docs/docs/integrations` directory. If no one reviews your PR within a few days, please @-mention one of @baskaryan, @eyurtsev, @hwchase17. --> --------- Co-authored-by: Bagatur <baskaryan@gmail.com>	4 months ago
northern-64bit	dfbc10c943	docs: Fix link in Unstructured notebook (#19851) ... **Description:** This PR fixes the link to the Unstructured documentation in the docs.	4 months ago
Brace Sproul	7538c4de19	docs[patch]: Revert quarto update (#19880)	4 months ago
Anıl Berk Altuner	4384fa8e49	community[minor]: Add Dria retriever (#17098) ... [Dria](https://dria.co/) is a hub of public RAG models for developers to both contribute and utilize a shared embedding lake. This PR adds a retriever that can retrieve documents from Dria.	4 months ago
Ethan Yang	48f84e253e	community[minor]: Add OpenVINO rerank model support (#19791) ... @eaidova @AlexKoff88 Could you help to review, thanks --------- Co-authored-by: Bagatur <baskaryan@gmail.com>	4 months ago
Chenhui Zhang	a1f3e9f537	community[minor]: Update ChatZhipuAI to support GLM-4 model (#16695) ... Description: Update `ChatZhipuAI` to support the latest `glm-4` model. Issue: N/A Dependencies: httpx, httpx-sse, PyJWT The previous `ChatZhipuAI` implementation requires the `zhipuai` package, and cannot call the latest GLM model. This is because - The old version `zhipuai==1.*` doesn't support the latest model. - `zhipuai==2.*` requires `pydantic V2`, which is incompatible with 'langchain-community'. This re-implementation invokes the GLM model by sending HTTP requests to [open.bigmodel.cn](https://open.bigmodel.cn/dev/api) via the `httpx` package, and uses the `httpx-sse` package to handle stream events. --------- Co-authored-by: zR <2448370773@qq.com>	4 months ago
Jacob Lee	f06229bbf1	👥 Update LangChain people data (#19858) ... 👥 Update LangChain people data Co-authored-by: github-actions <github-actions@github.com>	4 months ago
Ikko Eltociear Ashimine	8711a05a51	Update cross_encoder_reranker.ipynb (#19846) ... HuggingFace -> Hugging Face	4 months ago
Vardhaman	039f314f20	docs: remove unnecessary args from the pip install (#19823) ... **Description:** An additional `U` argument was added for the instructions to install the pip packages for the MediaWiki Dump Document loader which was leading to error in installing the package. Removing the argument fixed the command to install. **Issue:** #19820 **Dependencies:** No dependency change requierd **Twitter handle:** [@vardhaman722](https://twitter.com/vardhaman722)	4 months ago
Kenneth Choe	f98d7f7494	langchain[minor], community[minor]: add CrossEncoderReranker with HuggingFaceCrossEncoder and SagemakerEndpointCrossEncoder (#13687) ... - **Description:** Support reranking based on cross encoder models available from HuggingFace. - Added `CrossEncoder` schema - Implemented `HuggingFaceCrossEncoder` and `SagemakerEndpointCrossEncoder` - Implemented `CrossEncoderReranker` that performs similar functionality to `CohereRerank` - Added `cross-encoder-reranker.ipynb` to demonstrate how to use it. Please let me know if anything else needs to be done to make it visible on the table-of-contents navigation bar on the left, or on the card list on [retrievers documentation page](https://python.langchain.com/docs/integrations/retrievers). - **Issue:** N/A - **Dependencies:** None other than the existing ones. --------- Co-authored-by: Kenny Choe <kchoe@amazon.com> Co-authored-by: Bagatur <baskaryan@gmail.com>	4 months ago
cxumol	3f7da03dd8	docs: fix a dead link (#19814) ... **Description** Google Colab returned 404 when trying to click an "Open In Colab" button from document. This PR corrected the link.	4 months ago
aditya thomas	b8271bbc4a	docs: (minor) updates to voyage ai documentation (#19819) ... **Description:** Updates to Voyage AI documentation **Issue:** Not Applicable **Dependencies:** None	4 months ago
aditya thomas	765d6762bc	docs[minor]: include tab info for togetherai (#19796) ... **Description:** Included information for the TogetherAI tab **Issue:** The tab for TogetherAI information was not correct **Dependencies:** None	4 months ago
anshaneel	0884e5de7f	community[minor]: Add Alpha Vantage API Tool (#14332) ... ### Description This implementation adds functionality from the AlphaVantage API, renowned for its comprehensive financial data. The class encapsulates various methods, each dedicated to fetching specific types of financial information from the API. ### Implemented Functions - **`search_symbols`**: - Searches the AlphaVantage API for financial symbols using the provided keywords. - **`_get_market_news_sentiment`**: - Retrieves market news sentiment for a specified stock symbol from the AlphaVantage API. - **`_get_time_series_daily`**: - Fetches daily time series data for a specific symbol from the AlphaVantage API. - **`_get_quote_endpoint`**: - Obtains the latest price and volume information for a given symbol from the AlphaVantage API. - **`_get_time_series_weekly`**: - Gathers weekly time series data for a particular symbol from the AlphaVantage API. - **`_get_top_gainers_losers`**: - Provides details on top gainers, losers, and most actively traded tickers in the US market from the AlphaVantage API. ### Issue: - #11994 ### Dependencies: - 'requests' library for HTTP requests. (import requests) - 'pytest' library for testing. (import pytest) --------- Co-authored-by: Adam Badar <94140103+adam-badar@users.noreply.github.com> Co-authored-by: Harrison Chase <hw.chase.17@gmail.com> Co-authored-by: Bagatur <baskaryan@gmail.com>	4 months ago
Snehil Kumar	b36f4147b0	docs: Google Drive Loader always set the env var (#14791) ... - **Description:** Code written by following, the official documentation of [Google Drive Loader](https://python.langchain.com/docs/integrations/document_loaders/google_drive), gives errors. I have opened an issue regarding this. See #14725. This is a pull request for modifying the documentation to use an approach that makes the code work. Basically, the change is that we need to always set the GOOGLE_APPLICATION_CREDENTIALS env var to an emtpy string, rather than only in case of RefreshError. Also, rewrote 2 paragraphs to make the instructions more clear. - **Issue:** See this related [issue # 14725](https://github.com/langchain-ai/langchain/issues/14725) - **Dependencies:** NA - **Tag maintainer:** @baskaryan - **Twitter handle:** NA Co-authored-by: Snehil <snehil@example.com> Co-authored-by: Bagatur <22008038+baskaryan@users.noreply.github.com>	4 months ago
M.Abdulrahman Alnaseer	ba54f1577f	community[minor]: add support for llmsherpa (#19741) ... Thank you for contributing to LangChain! - [x] **PR title**: "community: added support for llmsherpa library" - [x] **Add tests and docs**: 1. Integration test: 'docs/docs/integrations/document_loaders/test_llmsherpa.py'. 2. an example notebook: `docs/docs/integrations/document_loaders/llmsherpa.ipynb`. - [x] **Lint and test**: Run `make format`, `make lint` and `make test` from the root of the package(s) you've modified. See contribution guidelines for more: https://python.langchain.com/docs/contributing/ Additional guidelines: - Make sure optional dependencies are imported within a function. - Please do not add dependencies to pyproject.toml files (even optional ones) unless they are required for unit tests. - Most PRs should not touch more than one package. - Changes should be backwards compatible. - If you are adding something to community, do not re-import it in langchain. If no one reviews your PR within a few days, please @-mention one of baskaryan, efriis, eyurtsev, hwchase17. --------- Co-authored-by: Bagatur <22008038+baskaryan@users.noreply.github.com> Co-authored-by: Bagatur <baskaryan@gmail.com>	4 months ago
Naveenkhasyap	a99bd098ac	docs: fix for #16702 and #16703 (#16705) ... - **Description:** Quickstart Documentation updates for missing dependency installation steps. - **Issue:** the issue # it prompts users to install required dependency. - **Dependencies:** no, - **Twitter handle:** @naveenkashyap_ --------- Co-authored-by: Bagatur <22008038+baskaryan@users.noreply.github.com> Co-authored-by: Bagatur <baskaryan@gmail.com>	4 months ago
Brace Sproul	6d93a03bef	docs[patch]: Fix or remove broken mdx links (#19777) ... this pr also drops the community added action for checking broken links in mdx. It does not work well for our use case, throwing errors for local paths, plus the rest of the errors our in house solution had.	4 months ago
Brace Sproul	ce0a588ae6	docs[minor]: Add chat model tabs to docs pages (#19589)	4 months ago
Nisarg Trivedi	1252ccce6f	text-splitters[minor]: Added Haskell support in langchain.text_splitter module (#16191) ... - **Description:** Haskell language support added in text_splitter module - **Dependencies:** No - **Twitter handle:** @nisargtr If no one reviews your PR within a few days, please @-mention one of @baskaryan, @eyurtsev, @hwchase17. --------- Co-authored-by: Bagatur <baskaryan@gmail.com>	4 months ago
Hrvoje Milković	b7344e3347	community[minor]: Infobip tool integration (#16805) ... **Description:** Adding Tool that wraps Infobip API for sending sms or emails and email validation. **Dependencies:** None, **Twitter handle:** @hmilkovic Implementation: ``` libs/community/langchain_community/utilities/infobip.py ``` Integration tests: ``` libs/community/tests/integration_tests/utilities/test_infobip.py ``` Example notebook: ``` docs/docs/integrations/tools/infobip.ipynb ``` --------- Co-authored-by: Bagatur <baskaryan@gmail.com>	4 months ago
Jan Chorowski	b8b42ccbc5	community[minor]: Pathway vectorstore(#14859) ... - **Description:** Integration with pathway.com data processing pipeline acting as an always updated vectorstore - **Issue:** not applicable - **Dependencies:** optional dependency on [`pathway`](https://pypi.org/project/pathway/) - **Twitter handle:** pathway_com The PR provides and integration with `pathway` to provide an easy to use always updated vector store: ```python import pathway as pw from langchain.embeddings.openai import OpenAIEmbeddings from langchain.text_splitter import CharacterTextSplitter from langchain.vectorstores import PathwayVectorClient, PathwayVectorServer data_sources = [] data_sources.append( pw.io.gdrive.read(object_id="17H4YpBOAKQzEJ93xmC2z170l0bP2npMy", service_user_credentials_file="credentials.json", with_metadata=True)) text_splitter = CharacterTextSplitter(chunk_size=1000, chunk_overlap=0) embeddings_model = OpenAIEmbeddings(openai_api_key=os.environ["OPENAI_API_KEY"]) vector_server = PathwayVectorServer( *data_sources, embedder=embeddings_model, splitter=text_splitter, ) vector_server.run_server(host="127.0.0.1", port="8765", threaded=True, with_cache=False) client = PathwayVectorClient( host="127.0.0.1", port="8765", ) query = "What is Pathway?" docs = client.similarity_search(query) ``` The `PathwayVectorServer` builds a data processing pipeline which continusly scans documents in a given source connector (google drive, s3, ...) and builds a vector store. The `PathwayVectorClient` implements LangChain's `VectorStore` interface and connects to the server to retrieve documents. --------- Co-authored-by: Mateusz Lewandowski <lewymati@users.noreply.github.com> Co-authored-by: mlewandowski <mlewandowski@MacBook-Pro-mlewandowski.local> Co-authored-by: Berke <berkecanrizai1@gmail.com> Co-authored-by: Adrian Kosowski <adrian@pathway.com> Co-authored-by: mlewandowski <mlewandowski@macbook-pro-mlewandowski.home> Co-authored-by: berkecanrizai <63911408+berkecanrizai@users.noreply.github.com> Co-authored-by: Erick Friis <erick@langchain.dev> Co-authored-by: Harrison Chase <hw.chase.17@gmail.com> Co-authored-by: Bagatur <baskaryan@gmail.com> Co-authored-by: mlewandowski <mlewandowski@MBPmlewandowski.ht.home> Co-authored-by: Szymon Dudycz <szymond@pathway.com> Co-authored-by: Szymon Dudycz <szymon.dudycz@gmail.com> Co-authored-by: Bagatur <22008038+baskaryan@users.noreply.github.com>	4 months ago
ccurme	0dbd5f5012	add script to check imports (#19611)	4 months ago
高璟琦	ec7a59c96c	community[minor]: Add solar embedding (#19761) ... Solar is a large language model developed by [Upstage](https://upstage.ai/). It's a powerful and purpose-trained LLM. You can visit the embedding service provided by Solar within this pr. You may get **SOLAR_API_KEY** from https://console.upstage.ai/services/embedding You can refer to more details about accepted llm integration at https://python.langchain.com/docs/integrations/llms/solar.	4 months ago
Leonid Ganeline	5f814820f6	docs: providers pinecone fix (#19737) ... Current providers page use link to the old package. - Fixed installation instructions - Added a reference to the Pinecone retriever	4 months ago
Bob Lin	53a74ad12b	docs: use markdown cell instead of code block (#19740) ... I found that the code of async and async batch was divided into two blocks: <img width="823" alt="Screenshot 2024-03-29 at 7 45 59 AM" src="https://github.com/langchain-ai/langchain/assets/10000925/0fa59d29-a692-4309-afb8-2260f03242ec"> so I changed it to unified.	4 months ago
Ekaterina Aidova	4ce36af335	docs: fix link in openvino integration doc (#19749) ... - **Description:** fix incorrect link in docs - **Dependencies:** None	4 months ago
Jialei	f7c903e24a	community[minor]: add support for Moonshot llm and chat model (#17100)	4 months ago
Gustavo Isturiz	824dccf5e2	docs: fixed xml URL on sitemap docs exmaple, issue #17236 (#17304)	4 months ago
Ethan Yang	7164015135	community[minor]: Add Openvino embedding support (#19632) ... This PR is used to support both HF and BGE embeddings with openvino --------- Co-authored-by: Alexander Kozlov <alexander.kozlov@intel.com>	4 months ago
kYLe	124ab79c23	community[minor]: Add Anyscale embedding support (#17605) ... **Description:** Add embedding model support for Anyscale Endpoint **Dependencies:** openai --------- Co-authored-by: Bagatur <baskaryan@gmail.com>	4 months ago
Jiaming	3d3cc71287	community[patch]: fix bugs for bilibili Loader (#18036) ... - **Description:** 1. Fix the BiliBiliLoader that can receive cookie parameters, it requires 3 other parameters to run. The change is backward compatible. 2. Add test; 3. Add example in docs - **Issue:** [#14213] Co-authored-by: Bagatur <22008038+baskaryan@users.noreply.github.com>	4 months ago
Ethan Knights	1ef3fa0411	docs: improve readability of Langchain Expression Language get_started.ipynb (#18157) ... **Description:** A few grammatical changes to improve readability of the LCEL .ipynb and tidy some null characters. **Issue:** N/A Co-authored-by: Bagatur <22008038+baskaryan@users.noreply.github.com>	4 months ago
Sachin Paryani	25c9f3d1d1	community[patch]: Support Streaming in Azure Machine Learning (#18246) ... - [x] **PR title**: "community: Support streaming in Azure ML and few naming changes" - [x] **PR message**: - **Description:** Added support for streaming for azureml_endpoint. Also, renamed and AzureMLEndpointApiType.realtime to AzureMLEndpointApiType.dedicated. Also, added new classes CustomOpenAIChatContentFormatter and CustomOpenAIContentFormatter and updated the classes LlamaChatContentFormatter and LlamaContentFormatter to now show a deprecated warning message when instantiated. --------- Co-authored-by: Sachin Paryani <saparan@microsoft.com> Co-authored-by: Bagatur <baskaryan@gmail.com>	4 months ago
Isaac Francisco	f5e84c8858	docs: fixing markdown for tips (#18199) ... Previous markdown code was not working as intended, new code should add green box around the tip so it is highlighted Co-authored-by: Hershenson, Isaac (Extern) <isaac.hershenson.extern@bayer04.de> Co-authored-by: Bagatur <baskaryan@gmail.com>	4 months ago
Hayden Wolff	85deee521a	docs: Nvidia Riva Runnables Documentation (#18237) ... - **Description:** Documents how to use the Riva runnables to add streamed automatic-speech-recognition (ASR) and text-to-speech (TTS) to chains. - **Issue:** None - **Dependencies:** None - **Twitter handle:** @HaydenWolff1 --------- Co-authored-by: Hayden Wolff <hwolff@Haydens-Laptop.local> Co-authored-by: Hayden Wolff <hwolff@MacBook-Pro.local> Co-authored-by: Bagatur <baskaryan@gmail.com>	4 months ago
Bob Lin	aba4bd0d13	docs: Add async batch case (#19686)	4 months ago