15 Commits (1f11f806413837b2f41046c46b8963b8e0ae6b5f)

Author	SHA1	Message	Date
Nuno Campos	f3ec6d2449	Replace remaining usage of basellm with baselangmodel (#3981)	1 year ago
Ankush Gola	d3ec00b566	Callbacks Refactor [base] (#3256) ... Co-authored-by: Nuno Campos <nuno@boringbits.io> Co-authored-by: Davis Chase <130488702+dev2049@users.noreply.github.com> Co-authored-by: Zander Chase <130414180+vowelparrot@users.noreply.github.com> Co-authored-by: Harrison Chase <hw.chase.17@gmail.com>	1 year ago
CG80499	cfd34e268e	Add ReAct eval chain (#3161) ... - Adds GPT-4 eval chain for arbitrary agents using any set of tools - Adds notebook --------- Co-authored-by: Harrison Chase <hw.chase.17@gmail.com>	1 year ago
dev2049	a094b7f807	Improve eval chain prompt (#2798) ... Eval chain is currently very sensitive to differences in phrasing, punctuation, and tangential information. This prompt has worked better for me on my examples. More general q: Do we have any framework for evaluating default prompt changes? Could maybe start doing some regression testing?	1 year ago
dev2049	0e763677e4	Fix typo in qa eval chain prompt (#2797)	1 year ago
Vashisht Madhavan	aa439ac2ff	Adding an in-context QA evaluation chain + chain of thought reasoning chain for improved accuracy (#2444) ... Right now, eval chains require an answer for every question. It's cumbersome to collect this ground truth so getting around this issue with 2 things: * Adding a context param in `ContextQAEvalChain` and simply evaluating if the question is answered accurately from context * Adding chain of though explanation prompting to improve the accuracy of this w/o GT. This also gets to feature parity with openai/evals which has the same contextual eval w/o GT. TODO in follow-up: * Better prompt inheritance. No need for seperate prompt for CoT reasoning. How can we merge them together --------- Co-authored-by: Vashisht Madhavan <vashishtmadhavan@Vashs-MacBook-Pro.local>	1 year ago
leo-gan	fd69cc7e42	Removed duplicate BaseModel dependencies (#2471) ... Removed duplicate BaseModel dependencies in class inheritances. Also, sorted imports by `isort`.	1 year ago
Harrison Chase	2d098e8869	Harrison/agent eval (#1620) ... Co-authored-by: jerwelborn <jeremy.welborn@gmail.com>	2 years ago
Harrison Chase	c9b5a30b37	move output parsing (#1605)	2 years ago
Zach Schillaci	159c560c95	Refactor some loops into list comprehensions (#1185)	2 years ago
Harrison Chase	2a54e73fec	bump version to 0063 (#616)	2 years ago
Nicolas	91d7fd20ae	feat: add custom prompt for QAEvalChain chain (#610) ... I originally had only modified the `from_llm` to include the prompt but I realized that if the prompt keys used on the custom prompt didn't match the default prompt, it wouldn't work because of how `apply` works. So I made some changes to the evaluate method to check if the prompt is the default and if not, it will check if the input keys are the same as the prompt key and update the inputs appropriately. Let me know if there is a better way to do this. Also added the custom prompt to the QA eval notebook.	2 years ago
Harrison Chase	985496f4be	Docs refactor (#480) ... Big docs refactor! Motivation is to make it easier for people to find resources they are looking for. To accomplish this, there are now three main sections: - Getting Started: steps for getting started, walking through most core functionality - Modules: these are different modules of functionality that langchain provides. Each part here has a "getting started", "how to", "key concepts" and "reference" section (except in a few select cases where it didnt easily fit). - Use Cases: this is to separate use cases (like summarization, question answering, evaluation, etc) from the modules, and provide a different entry point to the code base. There is also a full reference section, as well as extra resources (glossary, gallery, etc) Co-authored-by: Shreya Rajpal <ShreyaR@users.noreply.github.com>	2 years ago
Harrison Chase	9ec01dfc16	regex output parser (#435)	2 years ago
Harrison Chase	b50a56830d	Harrison/evaluation notebook (#426)	2 years ago