ce7b14b843
from https://arxiv.org/abs/2210.03629 still need to think if docstore abstraction makes sense |
||
---|---|---|
.github/workflows | ||
docs | ||
examples | ||
langchain | ||
tests | ||
.flake8 | ||
.gitignore | ||
Makefile | ||
MANIFEST.in | ||
pyproject.toml | ||
README.md | ||
readthedocs.yml | ||
requirements.txt | ||
setup.py | ||
test_requirements.txt |
🦜️🔗 LangChain
⚡ Building applications with LLMs through composability ⚡
Quick Install
pip install langchain
🤔 What is this?
Large language models (LLMs) are emerging as a transformative technology, enabling developers to build applications that they previously could not. But using these LLMs in isolation is often not enough to create a truly powerful app - the real power comes when you are able to combine them with other sources of computation or knowledge.
This library is aimed at assisting in the development of those types of applications. It aims to create:
- a comprehensive collection of pieces you would ever want to combine
- a flexible interface for combining pieces into a single comprehensive "chain"
- a schema for easily saving and sharing those chains
🔧 Setting up your environment
Besides the installation of this python package, you will also need to install packages and set environment variables depending on which chains you want to use.
Note: the reason these packages are not included in the dependencies by default is that as we imagine scaling this package, we do not want to force dependencies that are not needed.
The following use cases require specific installs and environment variables:
- OpenAI:
- Install requirements with
pip install openai
- Set the following environment variable:
OPENAI_API_KEY
- Install requirements with
- Cohere:
- Install requirements with
pip install cohere
- Set the following environment variable:
COHERE_API_KEY
- Install requirements with
- HuggingFace Hub
- Install requirements with
pip install huggingface_hub
- Set the following environment variable:
HUGGINGFACEHUB_API_TOKEN
- Install requirements with
- SerpAPI:
- Install requirements with
pip install google-search-results
- Set the following environment variable:
SERPAPI_API_KEY
- Install requirements with
- NatBot:
- Install requirements with
pip install playwright
- Install requirements with
🚀 What can I do with this
This project was largely inspired by a few projects seen on Twitter for which we thought it would make sense to have more explicit tooling. A lot of the initial functionality was done in an attempt to recreate those. Those are:
To recreate this paper, use the following code snippet or checkout the example notebook.
from langchain import SelfAskWithSearchChain, OpenAI, SerpAPIChain
llm = OpenAI(temperature=0)
search = SerpAPIChain()
self_ask_with_search = SelfAskWithSearchChain(llm=llm, search_chain=search)
self_ask_with_search.run("What is the hometown of the reigning men's U.S. Open champion?")
To recreate this example, use the following code snippet or check out the example notebook.
from langchain import OpenAI, LLMMathChain
llm = OpenAI(temperature=0)
llm_math = LLMMathChain(llm=llm)
llm_math.run("How many of the integers between 0 and 99 inclusive are divisible by 8?")
Generic Prompting
You can also use this for simple prompting pipelines, as in the below example and this example notebook.
from langchain import Prompt, OpenAI, LLMChain
template = """Question: {question}
Answer: Let's think step by step."""
prompt = Prompt(template=template, input_variables=["question"])
llm_chain = LLMChain(prompt=prompt, llm=OpenAI(temperature=0))
question = "What NFL team won the Super Bowl in the year Justin Beiber was born?"
llm_chain.predict(question=question)
📖 Documentation
The above examples are probably the most user friendly documentation that exists, but full API docs can be found here.