langchain

Commit Graph

Author	SHA1	Message	Date
Bhanu K	3fb4997ad8	Persist database regardless of notebook or script context (#2351 ) `persist()` is required even if it's invoked in a script. Without this, an error is thrown: ``` chromadb.errors.NoIndexException: Index is not initialized ```	1 year ago
Kevin Huang	e4cfaa5680	Introduces SeleniumURLLoader for JavaScript-Dependent Web Page Data Retrieval (#2291 ) ### Summary This PR introduces a `SeleniumURLLoader` which, similar to `UnstructuredURLLoader`, loads data from URLs. However, it utilizes `selenium` to fetch page content, enabling it to work with JavaScript-rendered pages. The `unstructured` library is also employed for loading the HTML content. ### Testing ```bash pip install selenium pip install unstructured ``` ```python from langchain.document_loaders import SeleniumURLLoader urls = [ "https://www.youtube.com/watch?v=dQw4w9WgXcQ", "https://goo.gl/maps/NDSHwePEyaHMFGwh8" ] loader = SeleniumURLLoader(urls=urls) data = loader.load() ```	1 year ago
Ambuj Pawar	b4b7e8a54d	Fix typo in documentation: vectorstore-retriever.ipynb (#2306 ) There is a typo in the documentation. Fixed it!	1 year ago
Frank Liu	134fc87e48	Add Zilliz example (#2288 ) Add Zilliz example	1 year ago
Harrison Chase	e57b045402	bump version to 128 (#2236 )	1 year ago
Harrison Chase	2eeaccf01c	Harrison/apify (#2215 ) Co-authored-by: Jiří Moravčík <jiri.moravcik@gmail.com>	1 year ago
Alex Stachowiak	e6a9ee64b3	Update vectorstore-retriever.ipynb (#2210 )	1 year ago
Matt Robinson	3dfe1cf60e	feat: document loader for epublications (#2202 ) ### Summary Adds a new document loader for processing e-publications. Works with `unstructured>=0.5.4`. You need to have [`pandoc`](https://pandoc.org/installing.html) installed for this loader to work. ### Testing ```python from langchain.document_loaders import UnstructuredEPubLoader loader = UnstructuredEPubLoader("winter-sports.epub", mode="elements") data = loader.load() data[0] ```	1 year ago
Ikko Eltociear Ashimine	a4a1ee6b5d	Update huggingface_length_function.ipynb (#2203 ) HuggingFace -> Hugging Face	1 year ago
Harrison Chase	1c03205cc2	embedding docs (#2200 )	1 year ago
Max Caldwell	3dc49a04a3	[Documents] Updated Figma docs and added example (#2172 ) - Current docs are pointing to the wrong module, fixed - Added some explanation on how to find the necessary parameters - Added chat-based codegen example w/ retrievers Picture of the new page: ![Screenshot 2023-03-29 at 20-11-29 Figma — 🦜🔗 LangChain 0 0 126](https://user-images.githubusercontent.com/2172753/228719338-c7ec5b11-01c2-4378-952e-38bc809f217b.png) Please let me know if you'd like any tweaks! I wasn't sure if the example was too heavy for the page or not but decided "hey, I probably would want to see it" and so included it. Co-authored-by: maxtheman <max@maxs-mbp.lan>	1 year ago
Chase Adams	b5449a866d	docs: tiny fix on docs verbiage (#2124 ) Changed `RecursiveCharaterTextSplitter` => `RecursiveCharacterTextSplitter`. GH's diff doesn't handle the long string well.	2 years ago
Harrison Chase	a5bf8c9b9d	Harrison/aleph alpha embeddings (#2117 ) Co-authored-by: Piotr Mazurek <piotr635@gmail.com> Co-authored-by: PiotrMazurek <piotr.mazurek@aleph-alpha.com>	2 years ago
Harrison Chase	410bf37fb8	Harrison/big query (#2100 ) Co-authored-by: lu-cashmoney <lucas.corley@gmail.com>	2 years ago
Stéphane Busso	0bee219cb3	feat: Add Notion database document loader (#2056 ) This PR adds Notion DB loader for langchain. It reads content from pages within a Notion Database. It uses the Notion API to query the database and read the pages. It also reads the metadata from the pages and stores it in the Document object.	2 years ago
Harrison Chase	d5825bd3e8	Harrison/whatsapp loader (#2085 ) Co-authored-by: Moshe <hello@moshemalka.me>	2 years ago
Harrison Chase	f74a1bebf5	Harrison/duckdb (#2064 ) Co-authored-by: Trent Hauck <trent@trenthauck.com>	2 years ago
Harrison Chase	76ecca4d53	redis retriever (#2060 )	2 years ago
Harrison Chase	30e3b31b04	Harrison/document cleanup (#2062 ) Co-authored-by: Delip Rao <delip@users.noreply.github.com>	2 years ago
Harrison Chase	a0cd6672aa	Harrison/site map (#2061 ) Co-authored-by: Tim Asp <707699+timothyasp@users.noreply.github.com>	2 years ago
Harrison Chase	705431aecc	big docs refactor (#1978 ) Co-authored-by: Ankush Gola <ankush.gola@gmail.com>	2 years ago
Harrison Chase	6ec5780547	add docs for openai retriever ingest (#1969 )	2 years ago
Harrison Chase	47d37db2d2	WIP: Harrison/base retriever (#1765 )	2 years ago
Harrison Chase	8990122d5d	retrievers interface (#1948 )	2 years ago
Harrison Chase	50626a10ee	Hx23840 feat/add redisearch vectorstore (#1909 ) Co-authored-by: Peter <peter.shi@alephf.com> Co-authored-by: Peter Shi <42536066+hx23840@users.noreply.github.com>	2 years ago
Sean Zheng	15b5a08f4b	Update how_to_guides.rst (#1893 ) Adding OpenSearch examples	2 years ago
Harrison Chase	f299bd1416	clean up sagemaker nb (#1875 )	2 years ago
Philipp Schmid	064be93edf	[Embeddings] Add SageMaker Endpoint Embedding class (#1859 ) # What does this PR do? This PR adds similar to `llms` a SageMaker-powered `embeddings` class. This is helpful if you want to leverage Hugging Face models on SageMaker for creating your indexes. I added a example into the [docs/modules/indexes/examples/embeddings.ipynb](https://github.com/hwchase17/langchain/compare/master...philschmid:add-sm-embeddings?expand=1#diff-e82629e2894974ec87856aedd769d4bdfe400314b03734f32bee5990bc7e8062) document. The example currently includes some `_### TEMPORARY: Showing how to deploy a SageMaker Endpoint from a Hugging Face model ###_ ` code showing how you can deploy a sentence-transformers to SageMaker and then run the methods of the embeddings class. @hwchase17 please let me know if/when i should remove the `_### TEMPORARY: Showing how to deploy a SageMaker Endpoint from a Hugging Face model ###_` in the description i linked to a detail blog on how to deploy a Sentence Transformers so i think we don't need to include those steps here. I also reused the `ContentHandlerBase` from `langchain.llms.sagemaker_endpoint` and changed the output type to `any` since it is depending on the implementation.	2 years ago
anupam-tiwari	86822d1cc2	Fixes the import typo in the vector db text generator notebook (#1874 ) Fixes the import typo in the vector db text generator notebook for the chroma library Co-authored-by: Anupam <anupam@10-16-252-145.dynapool.wireless.nyu.edu>	2 years ago
Tomoko Uchida	b706966ebc	Add setup instruction in Getting Started for Indexing (#1847 ) `VectorstoreIndexCreator` [uses Chroma as the vectorstore by default](`1c22657256/langchain/indexes/vectorstore.py (L49)`). It may be helpful to add a short note for the setup. You can see how the notebook looks here. https://github.com/mocobeta/langchain/blob/feat/add-setup-instruction-to-index-getting-started/docs/modules/indexes/getting_started.ipynb	2 years ago
Harrison Chase	1c22657256	Harrison/faiss merge (#1843 ) Co-authored-by: Ting Su <ting.su.1995@outlook.com>	2 years ago
Harrison Chase	d5d50c39e6	Harrison/azure embeddings (#1787 ) Co-authored-by: Hemant <4627288+ghaccount@users.noreply.github.com>	2 years ago
Harrison Chase	96ebe98dc2	Harrison/latex splitter (#1738 ) Co-authored-by: Aidan Holland <thehappydinoa@gmail.com> Co-authored-by: Jan de Boer <44832123+Janldeboer@users.noreply.github.com>	2 years ago
Piyush Jain	1279c8de39	Fixed typo, clarified language (#1682 )	2 years ago
Jithin James	6f4f771897	docs: add path to state_of_the_union.txt in indexes/getting_started page (#1691 ) add the state_of_the_union.txt file so that its easier to follow through with the example. --------- Co-authored-by: Jithin James <jjmachan@pop-os.localdomain>	2 years ago
Harrison Chase	0b29e68c17	Harrison/pgvector (#1679 ) Co-authored-by: Aman Kumar <krsingh.aman@gmail.com>	2 years ago
Harrison Chase	4d7fdb8957	Harrison/gml save (#1676 ) Co-authored-by: Satoru Sakamoto <51464932+satoru814@users.noreply.github.com>	2 years ago
Xin Qiu	4e13cef05a	feat: add redisearch vectorstore (#1307 ) # Description Add `RediSearch` vectorstore for LangChain RediSearch: [RediSearch quick start](https://redis.io/docs/stack/search/quick_start/) # How to use ``` from langchain.vectorstores.redisearch import RediSearch rds = RediSearch.from_documents(docs, embeddings,redisearch_url="redis://localhost:6379") ```	2 years ago
Harrison Chase	c9b5a30b37	move output parsing (#1605 )	2 years ago
Andriy Mulyar	c9189d354a	AtlasDB vector store documentation updates. (#1572 ) - Updated errors in the AtlasDB vector store documentation - Removed extraneous output logs in example notebook.	2 years ago
Brenton Wheeler	99fe023496	docs: fix typo in modules/indexes/chain_examples/question_answering (#1551 ) docs: fix typo in modules/indexes/chain_examples/question_answering ![image](https://user-images.githubusercontent.com/11394076/224007874-3a52adf6-ff7a-4f22-9dbf-18c83d08167f.png)	2 years ago
Harrison Chase	523ad8d2e2	Harrison/chat history formatter1 (#1538 ) Co-authored-by: Youssef A. Abukwaik <yousseb@users.noreply.github.com>	2 years ago
Harrison Chase	3610ef2830	add fake embeddings class (#1503 )	2 years ago
Harrison Chase	0e21463f07	(rfc) chat models (#1424 ) Co-authored-by: Ankush Gola <ankush.gola@gmail.com>	2 years ago
Harrison Chase	a1b9dfc099	Harrison/similarity search chroma (#1434 ) Co-authored-by: shibuiwilliam <shibuiyusuke@gmail.com>	2 years ago
Tim Asp	bca0935d90	[docs] fix minor import error (#1425 )	2 years ago
Kacper Łukawski	9ac442624c	Add Qdrant named arguments (#1386 ) This PR: - Increases `qdrant-client` version to 1.0.4 - Introduces custom content and metadata keys (as requested in #1087) - Moves all the `QdrantClient` parameters into the method parameters to simplify code completion	2 years ago
Lakshya Agarwal	cfed0497ac	Minor grammatical fixes (#1325 ) Fixed typos and links in a few places across documents	2 years ago
Harrison Chase	f61858163d	bump version to 0.0.95 (#1324 )	2 years ago
Harrison Chase	0824d65a5c	Harrison/indexing pipeline (#1317 )	2 years ago

1 2

60 Commits (9cceb4a02a417ca565f180bf7deb50fa02cb7b3d)