|
|
|
@ -1,6 +1,6 @@
|
|
|
|
|
# Ollama
|
|
|
|
|
|
|
|
|
|
>[Ollama](https://ollama.ai/) is a python library. It allows you to run open-source large language models,
|
|
|
|
|
>[Ollama](https://ollama.com/) allows you to run open-source large language models,
|
|
|
|
|
> such as LLaMA2, locally.
|
|
|
|
|
>
|
|
|
|
|
>`Ollama` bundles model weights, configuration, and data into a single package, defined by a Modelfile.
|
|
|
|
@ -12,11 +12,8 @@ on how to use `Ollama` with LangChain.
|
|
|
|
|
|
|
|
|
|
## Installation and Setup
|
|
|
|
|
|
|
|
|
|
Follow [these instructions](https://github.com/jmorganca/ollama?tab=readme-ov-file#ollama)
|
|
|
|
|
Follow [these instructions](https://github.com/ollama/ollama?tab=readme-ov-file#ollama)
|
|
|
|
|
to set up and run a local Ollama instance.
|
|
|
|
|
To use, you should set up the environment variables `ANYSCALE_API_BASE` and
|
|
|
|
|
`ANYSCALE_API_KEY`.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
## LLM
|
|
|
|
|
|
|
|
|
|