From 933ca1bf81a21da61835f86b7650458858a0ad7c Mon Sep 17 00:00:00 2001 From: digvijay shelar Date: Thu, 30 May 2024 18:51:56 +0530 Subject: [PATCH] updated the llm instructions for OS version --- docs/pages/Guides/How-to-use-different-LLM.md | 17 -------- .../pages/Guides/How-to-use-different-LLM.mdx | 41 +++++++++++++++++++ 2 files changed, 41 insertions(+), 17 deletions(-) delete mode 100644 docs/pages/Guides/How-to-use-different-LLM.md create mode 100644 docs/pages/Guides/How-to-use-different-LLM.mdx diff --git a/docs/pages/Guides/How-to-use-different-LLM.md b/docs/pages/Guides/How-to-use-different-LLM.md deleted file mode 100644 index bf885a43..00000000 --- a/docs/pages/Guides/How-to-use-different-LLM.md +++ /dev/null @@ -1,17 +0,0 @@ -# Setting Up Local Language Models for Your App - -Setting up local language models for your app can significantly enhance its capabilities, enabling it to understand and generate text in multiple languages without relying on external APIs. By integrating local language models, you can improve privacy, reduce latency, and ensure continuous functionality even in offline environments. Here's a comprehensive guide on how to set up local language models for your application: - -## Steps: - 1.Visit the chat screen and you will be to see the default LLM selected - - - 2.Click on it and you will get a drop down of various LLM's available to choose - - - 3.Choose the LLM of your choice - -### Video Demo -llms - - diff --git a/docs/pages/Guides/How-to-use-different-LLM.mdx b/docs/pages/Guides/How-to-use-different-LLM.mdx new file mode 100644 index 00000000..908ddb28 --- /dev/null +++ b/docs/pages/Guides/How-to-use-different-LLM.mdx @@ -0,0 +1,41 @@ + +import { Callout } from 'nextra/components' +import Image from 'next/image' +import { Steps } from 'nextra/components' + +# Setting Up Local Language Models for Your App + +Setting up local language models for your app can significantly enhance its capabilities, enabling it to understand and generate text in multiple languages without relying on external APIs. By integrating local language models, you can improve privacy, reduce latency, and ensure continuous functionality even in offline environments. Here's a comprehensive guide on how to set up local language models for your application: + +## Steps: +### For cloud version LLM change: + +### Step 1 +Visit the chat screen and you will be to see the default LLM selected. +### Step 2 +Click on it and you will get a drop down of various LLM's available to choose. +### Step 3 +Choose the LLM of your choice. + + + + + + +### Video Demo +prompts + +### For Open source llm change: + +### Step 1 +For open source you have to edit .env file with LLM_NAME with their desired LLM name. +### Step 2 +All the supported LLM providers are here application/llm and you can check what env variable are needed for each +List of latest supported LLMs are https://github.com/arc53/DocsGPT/blob/main/application/llm/llm_creator.py +### Step 3 +Visit application/llm and select the file of your selected llm and there you will find the speicifc requirements needed to be filled in order to use it,i.e API key of that llm. + + + + +