mirror of
https://github.com/hwchase17/langchain
synced 2024-11-06 03:20:49 +00:00
26 lines
748 B
Markdown
26 lines
748 B
Markdown
|
# SQL with LLaMA2 using llama.cpp
|
||
|
|
|
||
|
|
This template allows you to chat with a SQL database in natural language in private, using an open source LLM.
|
||
|
|
|
||
|
|
## Set up Ollama
|
||
|
|
|
||
|
|
Follow instructions [here](https://python.langchain.com/docs/integrations/chat/ollama) to download Ollama.
|
||
|
|
|
||
|
|
Also follow instructions to download your LLM of interest:
|
||
|
|
|
||
|
|
* This template uses `llama2:13b-chat`
|
||
|
|
* But you can pick from many LLMs [here](https://ollama.ai/library)
|
||
|
|
|
||
|
|
## Set up SQL DB
|
||
|
|
|
||
|
|
This template includes an example DB of 2023 NBA rosters.
|
||
|
|
|
||
|
|
You can see instructions to build this DB [here](https://github.com/facebookresearch/llama-recipes/blob/main/demo_apps/StructuredLlama.ipynb).
|
||
|
|
|
||
|
|
## Installation
|
||
|
|
|
||
|
|
```bash
|
||
|
|
# from inside your LangServe instance
|
||
|
|
poe add sql-ollama
|
||
|
|
```
|