Update How-to-use-different-LLM.md

pull/772/head
Alex 7 months ago committed by GitHub
parent 93dd58ec59
commit 8c114cae95
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23

@ -36,7 +36,9 @@ Note: for huggingface you can choose any model inside application/llm/huggingfac
- huggingface_hkunlp/instructor-large
- cohere_medium
If using Llama, set `EMBEDDINGS_NAME` to `huggingface_sentence-transformers/all-mpnet-base-v2`. Download the required model and place it in the `models/` folder.
If you want to be completely local, set `EMBEDDINGS_NAME` to `huggingface_sentence-transformers/all-mpnet-base-v2`.
For llama.cpp Download the required model and place it in the `models/` folder.
Alternatively, for local Llama setup, run `setup.sh` and choose option 1. The script handles the DocsGPT model addition.

Loading…
Cancel
Save