You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Go to file
Jared Van Bortel dfd8ef0186
backend: use ggml_new_graph for GGML backend v2 (#1719)
5 days ago
.circleci vulkan support for typescript bindings, gguf support (#1390) 1 month ago
.github issue template: remove "Related Components" section 2 months ago
gpt4all-api Refactor engines module to fetch engine details 3 weeks ago
gpt4all-backend backend: use ggml_new_graph for GGML backend v2 (#1719) 5 days ago
gpt4all-bindings Update 3 weeks ago
gpt4all-chat Do not attempt to do a blocking retrieval if we don't have any collections. 1 week ago
gpt4all-docker mono repo structure 7 months ago
gpt4all-training gpt4all-training: delete old chat executables 2 months ago
.codespellrc make codespell happy again (#1574) 2 months ago
.gitignore Update .gitignore and Dockerfile, add .env file 3 weeks ago
.gitmodules remove old llama.cpp submodules 2 months ago [DATALAD RUNCMD] run codespell throughout 7 months ago
LICENSE.txt Add MIT license. 8 months ago
LICENSE_SOM.txt Nomic vulkan backend licensed under the Software for Open Models License (SOM), version 1.0. 3 months ago Update 2 months ago
gpt4all-lora-demo.gif GIF 9 months ago Update 7 months ago


Open-source large language models that run locally on your CPU and nearly any GPU

GPT4All Website and Models

GPT4All Documentation


🦜🔗 Official Langchain Backend

GPT4All is made possible by our compute partner Paperspace.

Run on an M1 macOS Device (not sped up!)

GPT4All: An ecosystem of open-source on-edge large language models.

[!IMPORTANT] GPT4All v2.5.0 and newer only supports models in GGUF format (.gguf). Models used with a previous version of GPT4All (.bin extension) will no longer work.

GPT4All is an ecosystem to run powerful and customized large language models that work locally on consumer grade CPUs and any GPU. Note that your CPU needs to support AVX or AVX2 instructions.

Learn more in the documentation.

A GPT4All model is a 3GB - 8GB file that you can download and plug into the GPT4All open-source ecosystem software. Nomic AI supports and maintains this software ecosystem to enforce quality and security alongside spearheading the effort to allow any person or enterprise to easily train and deploy their own on-edge large language models.

What's New (Issue Tracker)

  • October 19th, 2023: GGUF Support Launches with Support for:
    • Mistral 7b base model, an updated model gallery on, several new local code models including Rift Coder v1.5
    • Nomic Vulkan support for Q4_0, Q6 quantizations in GGUF.
    • Offline build support for running old versions of the GPT4All Local LLM Chat Client.
  • September 18th, 2023: Nomic Vulkan launches supporting local LLM inference on AMD, Intel, Samsung, Qualcomm and NVIDIA GPUs.
  • August 15th, 2023: GPT4All API launches allowing inference of local LLMs from docker containers.
  • July 2023: Stable support for LocalDocs, a GPT4All Plugin that allows you to privately and locally chat with your data.

Chat Client

Run any GPT4All model natively on your home desktop with the auto-updating desktop chat client. See GPT4All Website for a full list of open-source models you can run with this powerful desktop application.

Direct Installer Links:

Find the most up-to-date information on the GPT4All Website

Chat Client building and running

  • Follow the visual instructions on the chat client build_and_run page




GPT4All welcomes contributions, involvement, and discussion from the open source community! Please see and follow the issues, bug reports, and PR markdown templates.

Check project discord, with project owners, or through existing issues/PRs to avoid duplicate work. Please make sure to tag all of the above with relevant project identifiers or your contribution could potentially get lost. Example tags: backend, bindings, python-bindings, documentation, etc.

Technical Reports

📗 Technical Report 3: GPT4All Snoozy and Groovy

📗 Technical Report 2: GPT4All-J

📗 Technical Report 1: GPT4All


If you utilize this repository, models or data in a downstream project, please consider citing it with:

  author = {Yuvanesh Anand and Zach Nussbaum and Brandon Duderstadt and Benjamin Schmidt and Andriy Mulyar},
  title = {GPT4All: Training an Assistant-style Chatbot with Large Scale Data Distillation from GPT-3.5-Turbo},
  year = {2023},
  publisher = {GitHub},
  journal = {GitHub repository},
  howpublished = {\url{}},