langchain

Commit Graph

Author	SHA1	Message	Date
vowelparrot	709f26b69e	Added bilibili loader (#2673 ) (#2724 ) I've added a bilibili loader, bilibili is a very active video site in China and I think we need this loader. Example: ```python from langchain.document_loaders.bilibili import BiliBiliLoader loader = BiliBiliLoader( ["https://www.bilibili.com/video/BV1xt411o7Xu/", "https://www.bilibili.com/video/av330407025/"] ) docs = loader.load() ``` Co-authored-by: 了空 <568250549@qq.com>	1 year ago
David Wu	d42deff402	fixed typo (#2720 ) changed "to" to "too" in the memory notebook	1 year ago
David Wu	263ce40844	added a missing word (typo) (#2719 ) Changed from "You may often to" to "You may often have to" to fix the sentence.	1 year ago
Harrison Chase	e0a13e9355	Harrison/postgres (#2691 ) Co-authored-by: Ankit Jain <ankneo@users.noreply.github.com>	1 year ago
Naveen Tatikonda	4364d3316e	Add custom vector fields and text fields for OpenSearch (#2652 ) Description Add custom vector field name and text field name while indexing and querying for OpenSearch Issues https://github.com/hwchase17/langchain/issues/2500 Signed-off-by: Naveen Tatikonda <navtat@amazon.com>	1 year ago
Nikita Zavgorodnii	1c979e320d	docs: update tokenizer notice in llms/getting_started (#2641 ) A tiny update in docs which is spotted here: https://github.com/hwchase17/langchain/issues/2439	1 year ago
Harrison Chase	ad3c5dd186	Harrison/databerry (#2688 ) Co-authored-by: Georges Petrov <georgesm.petrov@gmail.com>	1 year ago
Tommertom	bd9f095ed2	Doc - Update google_search.ipynb - more explicit reference to places where to create API keys (#2670 ) Took me a bit to find the proper places to get the API keys. The link earlier provided to setup search is still good, but why not provide direct link to the Google cloud tools that give you ability to create keys?	1 year ago
Ankush Gola	8d3b059332	Add docs for callbacks (#2643 ) Basically copy what's in the ts docs: https://js.langchain.com/docs/production/callbacks Discovered a bug wrt not awaiting callbacks in `LLMMathChain` so fixed that	1 year ago
Harrison Chase	e63f9a846b	Harrison/docs agents (#2647 )	1 year ago
Ankush Gola	b82cbd1be0	Use `run` and `arun` in place of `combine_docs` and `acombine_docs` (#2635 ) `combine_docs` does not go through the standard chain call path which means that chain callbacks won't be triggered, meaning QA chains won't be traced properly, this fixes that. Also fix several errors in the chat_vector_db notebook	1 year ago
Chetanya Rastogi	50c511d75f	Add new loader to load pdf as html content (#2607 ) Adds a new pdf loader using the existing dependency on PDFMiner. The new loader can be helpful for chunking texts semantically into sections as the output html content can be parsed via `BeautifulSoup` to get more structured and rich information about font size, page numbers, pdf headers/footers, etc. which may not be available otherwise with other pdf loaders	1 year ago
Ankush Gola	61f7bd7a3a	fix question answering nb (#2637 ) Was throwing exception bc `VectorIndexWrapper` did not have `similarity_search` -- changed to just use retriever	1 year ago
William FH	10ff1fda8e	Add Streaming for GPT4All (#2642 ) - Adds support for callback handlers in GPT4All models - Updates notebook and docs	1 year ago
William FH	e56673c7f9	BabyAGI Notebook Example (#2559 ) Create a notebook implementing [BabyAGI](https://github.com/yoheinakajima/babyagi/tree/main) by [Yohei Nakajima](https://twitter.com/yoheinakajima) as LLM Chains.	1 year ago
Harrison Chase	7aba18ea77	Harrison/docs cleanup (#2633 )	1 year ago
Nick Gibb	63175eb696	Fix typo in docs (#2601 ) Minor typo in the docs ("reccomended" -> "recommended") Co-authored-by: Nick Gibb <nick.gibb@bluedot.global>	1 year ago
Davit Buniatyan	aaac7071a3	Deep Lake retriever example analyzing Twitter the-algorithm source code (#2602 ) Improvements to Deep Lake Vector Store - much faster view loading of embeddings after filters with `fetch_chunks=True` - 2x faster ingestion - use np.float32 for embeddings to save 2x storage, LZ4 compression for text and metadata storage (saves up to 4x storage for text data) - user defined functions as filters Docs - Added retriever full example for analyzing twitter the-algorithm source code with GPT4 - Added a use case for code analysis (please let us know your thoughts how we can improve it) --------- Co-authored-by: Davit Buniatyan <d@activeloop.ai>	1 year ago
William FH	5c0c5fafb2	Multi-Hop / Multi-Spec LLM Chain (#2549 ) Add a notebook showing how to make a chain that composes multiple OpenAPI Endpoint operations to accomplish tasks.	1 year ago
ecneladis	9a49f5763d	Add missing comma in async_agent.ipynb (#2614 )	1 year ago
Girish Sharma	9aed565f13	Fix missing import in AzureOpenAI embeddings example (#2625 ) ## Why this PR? Fixes #2624 There's a missing import statement in AzureOpenAI embeddings example. ## What's new in this PR? - Import `OpenAIEmbeddings` before creating it's object. ## How it's tested? - By running notebook and creating embedding object. Signed-off-by: letmerecall <girishsharma001@gmail.com>	1 year ago
Harrison Chase	b9e5b27a99	Harrison/motorhead (#2599 ) Co-authored-by: James O'Dwyer <100361543+softboyjimbo@users.noreply.github.com>	1 year ago
Roy Xue	f5afb60116	doc: change comment with correct name (#2580 ) In this comment, it should be ConversationalRetrievalChain instead of ChatVectorDBChain	1 year ago
akmhmgc	544cc7f395	Modified doc (#2568 ) # description Remove unnecessary codes and made the output easier to check in docs :)	1 year ago
joaoareis	b4d6a425a2	Fix typo in ChatGPT plugins (#2553 ) This PR adds a `,` that was missing in the ChatGPT plugins examples.	1 year ago
Ikko Eltociear Ashimine	fc1d48814c	fix typo in summary_buffer.ipynb (#2547 ) ouput -> output	1 year ago
Harrison Chase	a32c85951e	agent docs (#2551 )	1 year ago
Harrison Chase	247a88f2f9	Harrison/move eval (#2533 )	1 year ago
akmhmgc	481de8df7f	Modify docs (#2539 ) # description Modified doc according to recently added `AgentType`.	1 year ago
Harrison Chase	a31c9511e8	Harrison/redis improvements (#2528 ) Co-authored-by: Tyler Hutcherson <tyler.hutcherson@redis.com>	1 year ago
Hamza Kyamanywa	ec489599fd	Correct typo in documentation for word 'therefore' (#2529 ) This PR corrects a typo in the langchain [documentation.](https://python.langchain.com/en/latest/modules/indexes.html#:~:text=We%20therefor%20have%20a%20concept) It corrects the word `therefor` to `therefore`	1 year ago
Harrison Chase	3d0449bb45	agent tool retrieval (#2530 )	1 year ago
William FH	632c65d64b	Add to notebook to assist in ground truth question generation (#2523 ) At the bottom of the notebook, continue to show how to generate example test cases with the assistance of an LLM	1 year ago
Harrison Chase	5c64b86ba3	Harrison/weaviate retriever (#2524 ) Co-authored-by: Erika Cardenas <110841617+erika-cardenas@users.noreply.github.com>	1 year ago
William FH	629fda3957	Use JSON rather than JSON5 (#2520 ) Evaluation so far has shown that agents do a reasonable job of emitting `json` blocks as arguments when cued (instead of typescript), and `json` permits the `strict=False` flag to permit control characters, which are likely to appear in the response in particular. This PR makes this change to the request and response synthesizer chains, and fixes the temperature to the OpenAI agent in the eval notebook. It also adds a `raise_error = False` flag in the notebook to facilitate debugging	1 year ago
William FH	f8e4048cd8	Add an Example Evaluation Notebook for the API Chain (#2516 ) Taking the Klarna API as an example, uses evaluation chain's to judge the quality of the request and response synthesizers based on a small set of curated queries. Also updates intermediate steps for chain to emit a dict so each step can be keyed for lookup ![image](https://user-images.githubusercontent.com/13333726/230505771-5cdb4de4-6fe7-4f54-b944-f29d438fa42c.png)	1 year ago
Harrison Chase	7149d33c71	max time limit for agent (#2513 )	1 year ago
William FH	f240651bd8	Add Request body (#2507 ) This still doesn't handle the following - non-JSON media types - anyOf, allOf, oneOf's And doesn't emit the typescript definitions for referred types yet, but that can be saved for a separate PR. Also, we could have better support for Swagger 2.0 specs and OpenAPI 3.0.3 (can use the same lib for the latter) recommend offline conversion for now.	1 year ago
Timon Ruban	f0926bad9f	Fix docstring in indexes/getting-started (#2452 ) Fixed a letter. That's all.	1 year ago
Davit Buniatyan	b4914888a7	Deep Lake upgrade to include attribute search, distance metrics, returning scores and MMR (#2455 ) ### Features include - Metadata based embedding search - Choice of distance metric function (`L2` for Euclidean, `L1` for Nuclear, `max` L-infinity distance, `cos` for cosine similarity, 'dot' for dot product. Defaults to `L2` - Returning scores - Max Marginal Relevance Search - Deleting samples from the dataset ### Notes - Added numerous tests, let me know if you would like to shorten them or make smarter --------- Co-authored-by: Davit Buniatyan <d@activeloop.ai>	1 year ago
Sam Weaver	2ffb90b161	Extend opensearch to better support existing instances (#2500 ) (#2509 ) Closes #2500.	1 year ago
Matt Royer	ad87584c35	Fix 'embeddings is not defined' (#2468 ) Nothing major. The docs just give an error when you try to use `embeddings` instead of `llama`.	1 year ago
Jimmy Comfort	1dfb6a2a44	Update gpt4all example with model param (#2499 ) I am pretty sure that the documentation here should point to `model` instead of `model_path` based on the documentation here: https://github.com/hwchase17/langchain/blob/master/langchain/llms/gpt4all.py#L26	1 year ago
Harrison Chase	1e19e004af	Harrison/openapi spec (#2474 ) Co-authored-by: William Fu-Hinthorn <13333726+hinthornw@users.noreply.github.com>	1 year ago
Harrison Chase	a9e637b8f5	rfc: multi action agent (#2362 )	1 year ago
Harrison Chase	00bc8df640	Harrison/tfidf retriever (#2440 )	1 year ago
researchonly	a63cfad558	fixed typo Teplate -> Template (#2433 ) fixed a typo in the documentation	1 year ago
Bill Chambers	f0d4f36219	Documentation Error - Typo in Docs - Update custom_mrkl_agent.ipynb (#2437 ) Just a small typo in the documentation.	1 year ago
Harrison Chase	af7f20fa42	Harrison/elastic search (#2419 )	1 year ago
jerwelborn	b026a62bc4	hierarchical planning agent for multi-step queries against larger openapi specs (#2170 ) The specs used in chat-gpt plugins have only a few endpoints and have unrealistically small specifications. By contrast, a spec like spotify's has 60+ endpoints and is comprised 100k+ tokens. Here are some impressive traces from gpt-4 that string together non-trivial sequences of API calls. As noted in `planner.py`, gpt-3 is not as robust but can be improved with i) better retry, self-reflect, etc. logic and ii) better few-shots iii) etc. This PR's just a first attempt probing a few different directions that eventually can be made more core. `make me a playlist with songs from kind of blue. call it machine blues.` ``` > Entering new AgentExecutor chain... Action: api_planner Action Input: I need to find the right API calls to create a playlist with songs from Kind of Blue and name it Machine Blues Observation: 1. GET /search to find the album ID for "Kind of Blue". 2. GET /albums/{id}/tracks to get the tracks from the "Kind of Blue" album. 3. GET /me to get the current user's ID. 4. POST /users/{user_id}/playlists to create a new playlist named "Machine Blues" for the current user. 5. POST /playlists/{playlist_id}/tracks to add the tracks from "Kind of Blue" to the newly created "Machine Blues" playlist. Thought:I have a plan to create the playlist. Now, I will execute the API calls. Action: api_controller Action Input: 1. GET /search to find the album ID for "Kind of Blue". 2. GET /albums/{id}/tracks to get the tracks from the "Kind of Blue" album. 3. GET /me to get the current user's ID. 4. POST /users/{user_id}/playlists to create a new playlist named "Machine Blues" for the current user. 5. POST /playlists/{playlist_id}/tracks to add the tracks from "Kind of Blue" to the newly created "Machine Blues" playlist. > Entering new AgentExecutor chain... Action: requests_get Action Input: {"url": "https://api.spotify.com/v1/search?q=Kind%20of%20Blue&type=album", "output_instructions": "Extract the id of the first album in the search results"} Observation: 1weenld61qoidwYuZ1GESA Thought:Action: requests_get Action Input: {"url": "https://api.spotify.com/v1/albums/1weenld61qoidwYuZ1GESA/tracks", "output_instructions": "Extract the ids of all the tracks in the album"} Observation: ["7q3kkfAVpmcZ8g6JUThi3o"] Thought:Action: requests_get Action Input: {"url": "https://api.spotify.com/v1/me", "output_instructions": "Extract the id of the current user"} Observation: 22rhrz4m4kvpxlsb5hezokzwi Thought:Action: requests_post Action Input: {"url": "https://api.spotify.com/v1/users/22rhrz4m4kvpxlsb5hezokzwi/playlists", "data": {"name": "Machine Blues"}, "output_instructions": "Extract the id of the newly created playlist"} Observation: 48YP9TMcEtFu9aGN8n10lg Thought:Action: requests_post Action Input: {"url": "https://api.spotify.com/v1/playlists/48YP9TMcEtFu9aGN8n10lg/tracks", "data": {"uris": ["spotify:track:7q3kkfAVpmcZ8g6JUThi3o"]}, "output_instructions": "Confirm that the tracks were added to the playlist"} Observation: The tracks were added to the playlist. The snapshot_id is "Miw4NTdmMWUxOGU5YWMxMzVmYmE3ZWE5MWZlYWNkMTc2NGVmNTI1ZjY5". Thought:I am finished executing the plan. Final Answer: The tracks from the "Kind of Blue" album have been added to the newly created "Machine Blues" playlist. The playlist ID is 48YP9TMcEtFu9aGN8n10lg. > Finished chain. Observation: The tracks from the "Kind of Blue" album have been added to the newly created "Machine Blues" playlist. The playlist ID is 48YP9TMcEtFu9aGN8n10lg. Thought:I am finished executing the plan and have created the playlist with songs from Kind of Blue, named Machine Blues. Final Answer: I have created a playlist called "Machine Blues" with songs from the "Kind of Blue" album. The playlist ID is 48YP9TMcEtFu9aGN8n10lg. > Finished chain. ``` or `give me a song in the style of tobe nwige` ``` > Entering new AgentExecutor chain... Action: api_planner Action Input: I need to find the right API calls to get a song in the style of Tobe Nwigwe Observation: 1. GET /search to find the artist ID for Tobe Nwigwe. 2. GET /artists/{id}/related-artists to find similar artists to Tobe Nwigwe. 3. Pick one of the related artists and use their artist ID in the next step. 4. GET /artists/{id}/top-tracks to get the top tracks of the chosen related artist. Thought: I'm ready to execute the API calls. Action: api_controller Action Input: 1. GET /search to find the artist ID for Tobe Nwigwe. 2. GET /artists/{id}/related-artists to find similar artists to Tobe Nwigwe. 3. Pick one of the related artists and use their artist ID in the next step. 4. GET /artists/{id}/top-tracks to get the top tracks of the chosen related artist. > Entering new AgentExecutor chain... Action: requests_get Action Input: {"url": "https://api.spotify.com/v1/search?q=Tobe%20Nwigwe&type=artist", "output_instructions": "Extract the artist id for Tobe Nwigwe"} Observation: 3Qh89pgJeZq6d8uM1bTot3 Thought:Action: requests_get Action Input: {"url": "https://api.spotify.com/v1/artists/3Qh89pgJeZq6d8uM1bTot3/related-artists", "output_instructions": "Extract the ids and names of the related artists"} Observation: [ { "id": "75WcpJKWXBV3o3cfluWapK", "name": "Lute" }, { "id": "5REHfa3YDopGOzrxwTsPvH", "name": "Deante' Hitchcock" }, { "id": "6NL31G53xThQXkFs7lDpL5", "name": "Rapsody" }, { "id": "5MbNzCW3qokGyoo9giHA3V", "name": "EARTHGANG" }, { "id": "7Hjbimq43OgxaBRpFXic4x", "name": "Saba" }, { "id": "1ewyVtTZBqFYWIcepopRhp", "name": "Mick Jenkins" } ] Thought:Action: requests_get Action Input: {"url": "https://api.spotify.com/v1/artists/75WcpJKWXBV3o3cfluWapK/top-tracks?country=US", "output_instructions": "Extract the ids and names of the top tracks"} Observation: [ { "id": "6MF4tRr5lU8qok8IKaFOBE", "name": "Under The Sun (with J. Cole & Lute feat. DaBaby)" } ] Thought:I am finished executing the plan. Final Answer: The top track of the related artist Lute is "Under The Sun (with J. Cole & Lute feat. DaBaby)" with the track ID "6MF4tRr5lU8qok8IKaFOBE". > Finished chain. Observation: The top track of the related artist Lute is "Under The Sun (with J. Cole & Lute feat. DaBaby)" with the track ID "6MF4tRr5lU8qok8IKaFOBE". Thought:I am finished executing the plan and have the information the user asked for. Final Answer: The song "Under The Sun (with J. Cole & Lute feat. DaBaby)" by Lute is in the style of Tobe Nwigwe. > Finished chain. ``` --------- Co-authored-by: Harrison Chase <hw.chase.17@gmail.com>	1 year ago

1 2 3 4 5 ...

403 Commits (186ca9d3e485f3209aa6b465377a46c23fb98c87)