1.5 KiB
LangServe Templates
Templates for a fully functioning app that can be hosted by LangServe.
Usage
To use, first install the LangChain CLI.
pip install -U langchain-cli
Then, install langserve
:
pip install "langserve[all]"
Next, create a new LangChain project:
langchain serve new my-app
This will create a new directory called my-app
with two folders:
app
: This is where LangServe code will livepackages
: This is where your chains or agents will live
To pull in an existing template as a package, you first need to go into your new project:
cd my-app
And you can the add a template as a project
langchain serve add $PROJECT_NAME
This will pull in the specified template into packages/$PROJECT_NAME
You then need to install this package so you can use it in the langserve app:
pip install -e packages/$PROJECT_NAME
We install it with -e
so that if we modify the template at all (which we likely will) the changes are updated.
In order to have LangServe use this project, you then need to modify app/server.py
.
Specifically, you should add something like:
from fastapi import FastAPI
from langserve import add_routes
# This depends on the structure of the package you install
from my_project import chain
app = FastAPI()
add_routes(app, chain)
You can then spin up production-ready endpoints, along with a playground, by running:
python app/server.py
Adding a template
See here