2023-10-28 23:26:52 +00:00
|
|
|
# Launching LangServe from a Package
|
|
|
|
|
|
|
|
You can also launch LangServe directly from a package, without having to pull it into a project.
|
|
|
|
This can be useful when you are developing a package and want to test it quickly.
|
|
|
|
The downside of this is that it gives you a little less control over how the LangServe APIs are configured,
|
|
|
|
which is why for proper projects we recommend creating a full project.
|
|
|
|
|
|
|
|
In order to do this, first change your working directory to the package itself.
|
|
|
|
For example, if you are currently in this `templates` module, you can go into the `pirate-speak` package with:
|
|
|
|
|
|
|
|
```shell
|
|
|
|
cd pirate-speak
|
|
|
|
```
|
|
|
|
|
|
|
|
Inside this package there is a `pyproject.toml` file.
|
|
|
|
This file contains a `tool.langchain` section that contains information on how this package should be used.
|
|
|
|
For example, in `pirate-speak` we see:
|
|
|
|
|
|
|
|
```text
|
|
|
|
[tool.langserve]
|
|
|
|
export_module = "pirate_speak.chain"
|
|
|
|
export_attr = "chain"
|
|
|
|
```
|
|
|
|
|
|
|
|
This information can be used to launch a LangServe instance automatically.
|
|
|
|
In order to do this, first make sure the CLI is installed:
|
|
|
|
|
|
|
|
```shell
|
2023-11-03 19:10:32 +00:00
|
|
|
pip install -U langchain-cli
|
2023-10-28 23:26:52 +00:00
|
|
|
```
|
|
|
|
|
|
|
|
You can then run:
|
|
|
|
|
|
|
|
```shell
|
2023-10-30 23:39:39 +00:00
|
|
|
langchain template serve
|
2023-10-28 23:26:52 +00:00
|
|
|
```
|
|
|
|
|
|
|
|
This will spin up endpoints, documentation, and playground for this chain.
|
|
|
|
For example, you can access the playground at [http://127.0.0.1:8000/playground/](http://127.0.0.1:8000/playground/)
|
|
|
|
|
2024-01-12 22:37:48 +00:00
|
|
|
![Screenshot of the LangServe Playground web interface with input and output fields.](playground.png "LangServe Playground Interface")
|