mirror of https://github.com/hwchase17/langchain
parent
a4992ffada
commit
1bf84c3056
@ -0,0 +1,55 @@
|
|||||||
|
# Ollama
|
||||||
|
|
||||||
|
>[Ollama](https://ollama.ai/) is a python library. It allows you to run open-source large language models,
|
||||||
|
> such as LLaMA2, locally.
|
||||||
|
>
|
||||||
|
>`Ollama` bundles model weights, configuration, and data into a single package, defined by a Modelfile.
|
||||||
|
>It optimizes setup and configuration details, including GPU usage.
|
||||||
|
>For a complete list of supported models and model variants, see the [Ollama model library](https://ollama.ai/library).
|
||||||
|
|
||||||
|
See [this guide](https://python.langchain.com/docs/guides/local_llms#quickstart) for more details
|
||||||
|
on how to use `Ollama` with LangChain.
|
||||||
|
|
||||||
|
## Installation and Setup
|
||||||
|
|
||||||
|
Follow [these instructions](https://github.com/jmorganca/ollama?tab=readme-ov-file#ollama)
|
||||||
|
to set up and run a local Ollama instance.
|
||||||
|
To use, you should set up the environment variables `ANYSCALE_API_BASE` and
|
||||||
|
`ANYSCALE_API_KEY`.
|
||||||
|
|
||||||
|
|
||||||
|
## LLM
|
||||||
|
|
||||||
|
```python
|
||||||
|
from langchain.llms import Ollama
|
||||||
|
```
|
||||||
|
|
||||||
|
See the notebook example [here](/docs/integrations/llms/ollama).
|
||||||
|
|
||||||
|
## Chat Models
|
||||||
|
|
||||||
|
### Chat Ollama
|
||||||
|
|
||||||
|
```python
|
||||||
|
from langchain.chat_models import ChatOllama
|
||||||
|
```
|
||||||
|
|
||||||
|
See the notebook example [here](/docs/integrations/chat/ollama).
|
||||||
|
|
||||||
|
### Ollama functions
|
||||||
|
|
||||||
|
```python
|
||||||
|
from langchain_experimental.llms.ollama_functions import OllamaFunctions
|
||||||
|
```
|
||||||
|
|
||||||
|
See the notebook example [here](/docs/integrations/chat/ollama_functions).
|
||||||
|
|
||||||
|
## Embedding models
|
||||||
|
|
||||||
|
```python
|
||||||
|
from langchain.embeddings import OllamaEmbeddings
|
||||||
|
```
|
||||||
|
|
||||||
|
See the notebook example [here](/docs/integrations/text_embedding/ollama).
|
||||||
|
|
||||||
|
|
Loading…
Reference in New Issue