langchain/templates/rag-chroma-private
Lance Martin d6acb3ed7e
Clean-up template READMEs (#12403)
Normalize, and update notebooks.
2023-10-26 22:23:03 -07:00
..
docs Templates (#12294) 2023-10-25 18:47:42 -07:00
rag_chroma_private Format Templates (#12396) 2023-10-26 19:44:30 -07:00
tests Templates (#12294) 2023-10-25 18:47:42 -07:00
LICENSE Templates (#12294) 2023-10-25 18:47:42 -07:00
poetry.lock Templates (#12294) 2023-10-25 18:47:42 -07:00
pyproject.toml Templates (#12294) 2023-10-25 18:47:42 -07:00
rag_chroma_private.ipynb Clean-up template READMEs (#12403) 2023-10-26 22:23:03 -07:00
README.md Clean-up template READMEs (#12403) 2023-10-26 22:23:03 -07:00

Private RAG

This template performs privae RAG (no reliance on external APIs) using:

  • Ollama for the LLM
  • GPT4All for embeddings

LLM

Follow instructions here to download Ollama.

The instructions also show how to download your LLM of interest with Ollama:

  • This template uses llama2:13b-chat
  • But you can pick from many here

Set up local embeddings

This will use GPT4All embeddings.

Chroma

Chroma is an open-source vector database.

This template will create and add documents to the vector database in chain.py.

By default, this will load a popular blog post on agents.

However, you can choose from a large number of document loaders here.