Runnable binding how to (#10716)

pull/10718/head
Bagatur 1 year ago committed by GitHub
parent 4a7da3ce3b
commit 441a5c2b30
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23

@ -0,0 +1,188 @@
{
"cells": [
{
"cell_type": "markdown",
"id": "711752cb-4f15-42a3-9838-a0c67f397771",
"metadata": {},
"source": [
"# Bind runtime args\n",
"\n",
"Sometimes we want to invoke a Runnable within a Runnable sequence with constant arguments that are not part of the output of the preceding Runnable in the sequence, and which are not part of the user input. We can use `Runnable.bind()` to easily pass these arguments in.\n",
"\n",
"Suppose we have a simple prompt + model sequence:"
]
},
{
"cell_type": "code",
"execution_count": 11,
"id": "f3fdf86d-155f-4587-b7cd-52d363970c1d",
"metadata": {},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"EQUATION: x^3 + 7 = 12\n",
"\n",
"SOLUTION:\n",
"Subtracting 7 from both sides of the equation, we get:\n",
"x^3 = 12 - 7\n",
"x^3 = 5\n",
"\n",
"Taking the cube root of both sides, we get:\n",
"x = ∛5\n",
"\n",
"Therefore, the solution to the equation x^3 + 7 = 12 is x = ∛5.\n"
]
}
],
"source": [
"from langchain.chat_models import ChatOpenAI\n",
"from langchain.prompts import ChatPromptTemplate\n",
"from langchain.schema import StrOutputParser\n",
"from langchain.schema.runnable import RunnablePassthrough\n",
"\n",
"prompt = ChatPromptTemplate.from_messages(\n",
" [\n",
" (\"system\", \"Write out the following equation using algebraic symbols then solve it. Use the format\\n\\nEQUATION:...\\nSOLUTION:...\\n\\n\"),\n",
" (\"human\", \"{equation_statement}\")\n",
" ]\n",
")\n",
"model = ChatOpenAI(temperature=0)\n",
"runnable = {\"equation_statement\": RunnablePassthrough()} | prompt | model | StrOutputParser()\n",
"\n",
"print(runnable.invoke(\"x raised to the third plus seven equals 12\"))"
]
},
{
"cell_type": "markdown",
"id": "929c9aba-a4a0-462c-adac-2cfc2156e117",
"metadata": {},
"source": [
"and want to call the model with certain `stop` words:"
]
},
{
"cell_type": "code",
"execution_count": 12,
"id": "32e0484a-78c5-4570-a00b-20d597245a96",
"metadata": {},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"EQUATION: x^3 + 7 = 12\n",
"\n",
"\n"
]
}
],
"source": [
"runnable = {\"equation_statement\": RunnablePassthrough()} | prompt | model.bind(stop=\"SOLUTION\") | StrOutputParser()\n",
"print(runnable.invoke(\"x raised to the third plus seven equals 12\"))"
]
},
{
"cell_type": "markdown",
"id": "f4bd641f-6b58-4ca9-a544-f69095428f16",
"metadata": {},
"source": [
"## Attaching OpenAI functions\n",
"\n",
"One particularly useful application of binding is to attach OpenAI functions to a compatible OpenAI model:"
]
},
{
"cell_type": "code",
"execution_count": 14,
"id": "f66a0fe4-fde0-4706-8863-d60253f211c7",
"metadata": {},
"outputs": [],
"source": [
"functions = [\n",
" {\n",
" \"name\": \"solver\",\n",
" \"description\": \"Formulates and solves an equation\",\n",
" \"parameters\": {\n",
" \"type\": \"object\",\n",
" \"properties\": {\n",
" \"equation\": {\n",
" \"type\": \"string\",\n",
" \"description\": \"The algebraic expression of the equation\"\n",
" },\n",
" \"solution\": {\n",
" \"type\": \"string\",\n",
" \"description\": \"The solution to the equation\"\n",
" }\n",
" },\n",
" \"required\": [\"equation\", \"solution\"]\n",
" }\n",
" }\n",
" ]\n"
]
},
{
"cell_type": "code",
"execution_count": 22,
"id": "f381f969-df8e-48a3-bf5c-d0397cfecde0",
"metadata": {},
"outputs": [
{
"data": {
"text/plain": [
"AIMessage(content='', additional_kwargs={'function_call': {'name': 'solver', 'arguments': '{\\n\"equation\": \"x^3 + 7 = 12\",\\n\"solution\": \"x = ∛5\"\\n}'}}, example=False)"
]
},
"execution_count": 22,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"# Need gpt-4 to solve this one correctly\n",
"prompt = ChatPromptTemplate.from_messages(\n",
" [\n",
" (\"system\", \"Write out the following equation using algebraic symbols then solve it.\"),\n",
" (\"human\", \"{equation_statement}\")\n",
" ]\n",
")\n",
"runnable = (\n",
" {\"equation_statement\": RunnablePassthrough()} \n",
" | prompt \n",
" | ChatOpenAI(model=\"gpt-4\", temperature=0).bind(function_call={\"name\": \"solver\"}, functions=functions)\n",
")\n",
"runnable.invoke(\"x raised to the third plus seven equals 12\")"
]
},
{
"cell_type": "code",
"execution_count": null,
"id": "2cdeeb4c-0c1f-43da-bd58-4f591d9e0671",
"metadata": {},
"outputs": [],
"source": []
}
],
"metadata": {
"kernelspec": {
"display_name": "poetry-venv",
"language": "python",
"name": "poetry-venv"
},
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 3
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.9.1"
}
},
"nbformat": 4,
"nbformat_minor": 5
}
Loading…
Cancel
Save