273 Commits (1e4927a1d23108c4a9374952f2f5661df76387f0)

Author	SHA1	Message	Date
Harrison Chase	1511606799	Harrison/fix splitting (#563) ... fix issue where text splitting could possibly create empty docs	1 year ago
Harrison Chase	1192cc0767	smart text splitter (#530) ... smart text splitter that iteratively tries different separators until it works!	1 year ago
Harrison Chase	8dfad874a2	map rerank chain (#516) ... add a chain that applies a prompt to all inputs and then returns not only an answer but scores it add examples for question answering and question answering with sources	1 year ago
Harrison Chase	823a44ef80	bump to 0058 (#556)	1 year ago
Benjamin	42d5d988fa	add openai logit bias (#553) ... Add [`logit_bias`](https://beta.openai.com/docs/api-reference/completions/create#completions/create-logit_bias) params to OpenAI See [here](https://beta.openai.com/tokenizer) for the tokenizer. NB: I see that others (like Cohere) have the same parameter, but since I don't have an access to it, I don't want to make a mistake. --- Just to make sure the default "{}" works for openai: ``` from langchain.llms import OpenAI OPENAI_API_KEY="XXX" llm = OpenAI(openai_api_key=OPENAI_API_KEY) llm.generate('Write "test":') llm = OpenAI(openai_api_key=OPENAI_API_KEY, logit_bias={'9288': -100, '1332': -100, '14402': -100, '6208': -100}) llm.generate('Write "test":') ```	1 year ago
Harrison Chase	9833fcfe32	fix caching (#555)	1 year ago
Harrison Chase	74932f2516	RFC: conversational agent (#464) ... Co-authored-by: Bruno Bornsztein <bruno.bornsztein@gmail.com>	1 year ago
Harrison Chase	330a5b42d4	fix map reduce chain (#550)	1 year ago
Diwank Singh Tomer	ba0cbb4a41	Add finish reason to Generation for usage downstream (#526) ... Add `finish_reason` to `Generation` as well as extend `BaseOpenAI._generate` to include it in the output. This can be useful for usage in downstream tasks when we need to filter for only generations that finished because of `"stop"` for example. Maybe we should add this to `LLMChain` as well? For more details, see https://beta.openai.com/docs/guides/completion/best-practices Signed-off-by: Diwank Singh Tomer <diwank.singh@gmail.com>	1 year ago
Harrison Chase	4974f49bb7	add return_direct flag to tool (#537) ... adds a return_direct flag to tools, which just returns the tool output as the final output	1 year ago
Harrison Chase	0c2f7d8da1	changes to qa chain (#543)	1 year ago
Harrison Chase	5aefc2b7ce	add handling on error (#541)	1 year ago
Harrison Chase	1631981f84	Harrison/fix and test caching (#538)	1 year ago
Harrison Chase	73f7ebd9d1	Harrison/sqlalchemy cache store (#536) ... Co-authored-by: Jason Gill <jasongill@gmail.com>	1 year ago
Yongtae723	f48ab642be	replace forbid into ignore (#539) ... this is the second PR of #519. in #519 I suggested deleting Extra.forbid. I was very confused but I replaced Extra.forbid to Extra.ignore, which is the default of pydantic. Since the [BaseLLM](4b7b8229de/langchain/llms/base.py (L20)) from which it is inherited is set in Extra.forbid, I wanted to avoid having the Extra.forbid settings inherited by simply deleting it.	1 year ago
Yongtae723	4b7b8229de	add logger (#529) ... As talking #519, I made 2 PRs. this is the first PR for adding a logger. I am concerned about the following two points and would appreciate your opinion. 1. Since the logger is not formatted, the statement itself is output like a print statement, and I thought it was difficult to understand that it was a warning, so I put WARNING! at the beginning of the warning statement. After the logger formatting is done properly, the word WARNING can be repeated. 2. Statement `Please confirm that {field_name} is what you intended.` can be replaced like `If {field_name} is intended parameters, enter it to model_kwargs` thank you! Yongtae	1 year ago
Harrison Chase	9e04c34e20	Add BaseCallbackHandler and CallbackManager (#478) ... Co-authored-by: Ankush Gola <9536492+agola11@users.noreply.github.com>	1 year ago
Harrison Chase	0db05b6725	Harrison/add human prefix (#520) ... Co-authored-by: Andrew Huang <jhuang16888@gmail.com>	1 year ago
Harrison Chase	03f185bcd5	more robust handling for max iterations (#514) ... add a `generate` method which makes one final forward pass through the llm	1 year ago
Harrison Chase	40326c698c	unify argument name (#513) ... unify names in map reduce and refine chains to just be return_intermediate_steps also unify the return key	1 year ago
Harrison Chase	985496f4be	Docs refactor (#480) ... Big docs refactor! Motivation is to make it easier for people to find resources they are looking for. To accomplish this, there are now three main sections: - Getting Started: steps for getting started, walking through most core functionality - Modules: these are different modules of functionality that langchain provides. Each part here has a "getting started", "how to", "key concepts" and "reference" section (except in a few select cases where it didnt easily fit). - Use Cases: this is to separate use cases (like summarization, question answering, evaluation, etc) from the modules, and provide a different entry point to the code base. There is also a full reference section, as well as extra resources (glossary, gallery, etc) Co-authored-by: Shreya Rajpal <ShreyaR@users.noreply.github.com>	1 year ago
Keiji Kanazawa	c5f0af9398	Minor docstring update (#507) ... Update `model=` to `model_name=`. No need to credit me for this 😄	1 year ago
Harrison Chase	0072686aab	Harrison/new search engine (#477) ... Co-authored-by: Nicolas <nicolascamara29@gmail.com>	1 year ago
Harrison Chase	3e41ab7bff	check keys before using (#475)	1 year ago
Harrison Chase	0f1df0dc2c	bump to version 0.0.52 (#470)	1 year ago
Parth Chadha	e88e66f982	Pass verbose argument to LLMChains when using *DocumentsChain (#458) ... When using chains such as Summarization chain (`load_summarize_chain`), the verbose flag wasn't propagated to the `LLMChain`.	1 year ago
Harrison Chase	d0f194de73	add logic for agent stopping (#420)	1 year ago
Harrison Chase	c65efd2986	fix llm math prompt (#466) ... basically, it didnt realize that the question was over after the input and would some times hallucinate more input	1 year ago
Harrison Chase	95157d0aad	Add schema property to sql database utility class (#448) (#462) ... Co-authored-by: Harrison Chase <hw.chase.17@gmail.com> Signed-off-by: Diwank Singh Tomer <diwank.singh@gmail.com> Co-authored-by: Nuno Campos <nuno@boringbits.io> Co-authored-by: Diwank Singh Tomer <diwank.singh@gmail.com>	1 year ago
Harrison Chase	2b84e5cda3	Harrison/fix memory and serp (#457) ... Co-authored-by: Bruno Bornsztein <bruno.bornsztein@gmail.com>	1 year ago
Harrison Chase	55007e71be	add output key for memory (#443) ... this allows chains that return multiple values to use memory	2 years ago
Harrison Chase	5208bb8c36	make tools editable (#445) ... use dataclass instead of namedtuple, which makes it editable add example in notebook	2 years ago
Harrison Chase	5cc6bf1a9c	fix regex parser (#446)	2 years ago
Ikko Ashimine	f3c3288761	chore: fix typo in prompt.py (#447) ... seperator -> separator	2 years ago
Harrison Chase	9ec01dfc16	regex output parser (#435)	2 years ago
Harrison Chase	c994ce6b7f	Harrison/serp api imp (#444) ... improve serp api Co-authored-by: Bruno Bornsztein <bruno.bornsztein@gmail.com>	2 years ago
Harrison Chase	ffe35c396c	unify return types across map-reduce and refine (#442)	2 years ago
Harrison Chase	0c5d3fd894	version 0.0.49 (#436)	2 years ago
Harrison Chase	f8b605293f	Harrison/improve memory (#432) ... add AI prefix add new type of memory Co-authored-by: Jason <chisanch@usc.edu>	2 years ago
Harrison Chase	150b67de10	Harrison/weaviate improvements (#433) ... Co-authored-by: Connor Shorten <connorshorten300@gmail.com>	2 years ago
Harrison Chase	b7566b5ec3	Harrison/return intermediate steps (#428)	2 years ago
Harrison Chase	b50a56830d	Harrison/evaluation notebook (#426)	2 years ago
Harrison Chase	97f4000d3a	fix react docstore (#427)	2 years ago
Harrison Chase	ee3b8e89b3	better parsing of agent output (#418)	2 years ago
Harrison Chase	0d7aa1ee99	Harrison/docs to index (#419) ... Add method for going directly from documents to VectorStores Update notebook to showcase this functionality	2 years ago
Harrison Chase	20959d8c36	check memory variables (#411) ... can have multiple input keys, if some come from memory	2 years ago
altryne	f990395211	Readme typos (#409) ... I was honored by the twitter mention, so used PyCharm to try and... help docs even a little bit. Mostly typo-s and correct spellings. PyCharm really complains about "really good" being used all the time and recommended alternative wordings haha	2 years ago
Shreya Rajpal	f40b3ce347	Updated VectorDBQA docs to updated argument name (#405)	2 years ago
Samantha Whitmore	6bc8ae63ef	Add Redis cache implementation (#397) ... I'm using a hash function for the key just to make sure its length doesn't get out of hand, otherwise the implementation is quite similar.	2 years ago
mrbean	136f759492	Mrbean/support timeout (#398) ... Add support for passing in a request timeout to the API	2 years ago
Harrison Chase	6b60c509ac	(WIP) add HyDE (#393) ... Co-authored-by: cameronccohen <cameron.c.cohen@gmail.com> Co-authored-by: Cameron Cohen <cameron.cohen@quantco.com>	2 years ago
Keiji Kanazawa	543db9c2df	Add Azure OpenAI LLM (#395) ... Hi! This PR adds support for the Azure OpenAI service to LangChain. I've tried to follow the contributing guidelines. Co-authored-by: Keiji Kanazawa <{ID}+{username}@users.noreply.github.com>	2 years ago
Harrison Chase	c104d507bf	Harrison/improve data augmented generation docs (#390) ... Co-authored-by: cameronccohen <cameron.c.cohen@gmail.com> Co-authored-by: Cameron Cohen <cameron.cohen@quantco.com>	2 years ago
Harrison Chase	6be5747466	RFC: add cache override to LLM class (#379)	2 years ago
Harrison Chase	46c428234f	MMR example selector (#377) ... implement max marginal relevance example selector	2 years ago
Harrison Chase	ffed5e0056	Harrison/jinja formatter (#385) ... Co-authored-by: Benjamin <BenderV@users.noreply.github.com>	2 years ago
mrbean	fc66a32c6f	fix docstring (#383) ... 	2 years ago
Harrison Chase	cf98f219f9	Harrison/tools exp (#372)	2 years ago
Harrison Chase	e7b625fe03	fix text splitter (#375)	2 years ago
Harrison Chase	3474f39e21	Harrison/improve cache (#368) ... make it so everything goes through generate, which removes the need for two types of caches	2 years ago
Ankush Gola	8d0869c6d3	change run to use args and kwargs (#367) ... Before, `run` was not able to be called with multiple arguments. This expands the functionality.	2 years ago
Harrison Chase	a7084ad6e4	Harrison/version 0040 (#366)	2 years ago
mrbean	50257fce59	Support Streaming Tokens from OpenAI (#364) ... https://github.com/hwchase17/langchain/issues/363 @hwchase17 how much does this make you want to cry?	2 years ago
mrbean	fe6695b9e7	Add HuggingFacePipeline LLM (#353) ... https://github.com/hwchase17/langchain/issues/354 Add support for running your own HF pipeline locally. This would allow you to get a lot more dynamic with what HF features and models you support since you wouldn't be beholden to what is hosted in HF hub. You could also do stuff with HF Optimum to quantize your models and stuff to get pretty fast inference even running on a laptop.	2 years ago
Benjamin	85c1bd2cd0	add sqlalchemy generic cache (#361) ... Created a generic SQLAlchemyCache class to plug any database supported by SQAlchemy. (I am using Postgres). I also based the class SQLiteCache class on this class SQLAlchemyCache. As a side note, I'm questioning the need for two distinct class LLMCache, FullLLMCache. Shouldn't we merge both ?	2 years ago
Harrison Chase	809a9f485f	Harrison/new version (#362)	2 years ago
Harrison Chase	750edfb440	add optional collapse prompt (#358)	2 years ago
Harrison Chase	2dd895d98c	add openai tokenizer (#355)	2 years ago
Harrison Chase	c1b50b7b13	Harrison/map reduce merge (#344) ... Co-authored-by: John Nay <JohnNay@users.noreply.github.com>	2 years ago
Harrison Chase	ed143b598f	improve openai embeddings (#351) ... add more formal support for explicitly specifying each model, but in a backwards compatible way	2 years ago
Harrison Chase	78b31e5966	Harrison/cache (#343)	2 years ago
Harrison Chase	8cf62ce06e	Harrison/single input (#347) ... allow passing of single input into chain Co-authored-by: thepok <richterthepok@yahoo.de>	2 years ago
Harrison Chase	e26b6f9c89	fix batching (#339)	2 years ago
Harrison Chase	996b5a3dfb	Harrison/llm final stuff (#332)	2 years ago
Harrison Chase	9bb7195085	Harrison/llm saving (#331) ... Co-authored-by: Akash Samant <70665700+asamant21@users.noreply.github.com>	2 years ago
Harrison Chase	595cc1ae1a	RFC: more complete return (#313) ... Co-authored-by: Andrew Williamson <awilliamson10@indstate.edu> Co-authored-by: awilliamson10 <aw.williamson10@gmail.com>	2 years ago
Harrison Chase	8861770bd0	expose get_num_tokens method (#327)	2 years ago
thepok	137356dbec	-1 max token description for openai (#330)	2 years ago
Harrison Chase	a7c8e37e77	Harrison/token counts (#311) ... Co-authored-by: thepok <richterthepok@yahoo.de>	2 years ago
Shobith Alva	19a9fa16a9	Add `clear()` method for `Memory` (#305) ... a simple helper to clear the buffer in `Conversation*Memory` classes	2 years ago
Harrison Chase	e02d6b2288	beta: logger (#307)	2 years ago
Harrison Chase	36b4c58acf	expose more stuff (#306)	2 years ago
Harrison Chase	7827f0a844	fix typing (int -> float) (#308)	2 years ago
Harrison Chase	853894dd47	add moderation chain (#299)	2 years ago
andersenchen	5267ebce2d	Add LLMCheckerChain (#281) ... Implementation of https://github.com/jagilley/fact-checker. Works pretty well. <img width="993" alt="Screenshot 2022-12-07 at 4 41 47 PM" src="https://user-images.githubusercontent.com/101075607/206302751-356a19ff-d000-4798-9aee-9c38b7f532b9.png"> Verifying this manually: 1. "Only two kinds of egg-laying mammals are left on the planet today—the duck-billed platypus and the echidna, or spiny anteater." https://www.scientificamerican.com/article/extreme-monotremes/ 2. "An [Echidna] egg weighs 1.5 to 2 grams (0.05 to 0.07 oz)[[19]](https://en.wikipedia.org/wiki/Echidna#cite_note-19) and is about 1.4 centimetres (0.55 in) long." https://en.wikipedia.org/wiki/Echidna#:~:text=sleep%20is%20suppressed.-,Reproduction,a%20reptile%2Dlike%20egg%20tooth. 3. "A [platypus] lays one to three (usually two) small, leathery eggs (similar to those of reptiles), about 11 mm (7⁄16 in) in diameter and slightly rounder than bird eggs." https://en.wikipedia.org/wiki/Platypus#:~:text=It%20lays%20one%20to%20three,slightly%20rounder%20than%20bird%20eggs. 4. Therefore, an Echidna is the mammal that lays the biggest eggs. cc @hwchase17	2 years ago
Samantha Whitmore	b10be842f6	ChatGPT Clone: adding ConversationBufferWindowMemory to replicate vir… (#288) ... …tual env example	2 years ago
Harrison Chase	e2e501aa06	Harrison/version 0032 (#283)	2 years ago
Harrison Chase	e9b1c8cdfa	Harrison/base combine doc chain (#264)	2 years ago
Harrison Chase	834b391792	update notebooks (#275)	2 years ago
Harrison Chase	3c1c7ba672	update branch name in gha (#274)	2 years ago
Akash Samant	48b093823e	Add a Transformation Chain (#257) ... Arbitrary transformation chains that can be used to add dictionary extractions from llms/other chains	2 years ago
coyotespike	b7bef36ee1	BashChain (#260) ... Love the project, a ton of fun! I think the PR is pretty self-explanatory, happy to make any changes! I am working on using it in an `LLMBashChain` and may update as that progresses. Co-authored-by: Harrison Chase <hw.chase.17@gmail.com>	2 years ago
Harrison Chase	28be37f470	LLMRequestsChain (#267)	2 years ago
John McDonnell	68666d6a22	Gracefully degrade when model asks for nonexistent tool (#268) ... Not yet tested, but very simple change, assumption is that we're cool with just producing a generic output when tool is not found	2 years ago
Harrison Chase	2163d064f3	add return of ids (#254) ... not actually sure the desired return in add_example to example selector is actually general/good - whats the use case?	2 years ago
Harrison Chase	8cba5b791a	hotfix for api logging (#262)	2 years ago
Harrison Chase	5cd6956d58	Harrison/version 0028 (#259)	2 years ago
Harrison Chase	f5c665a544	combine python files (#256)	2 years ago
Harrison Chase	988cb51a7c	fix out of date docs (#255)	2 years ago
Harrison Chase	9481a23314	stop using chained input except in agent (#249)	2 years ago