You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Go to file

abhisomala df510ef869 added tutorial and images for it (#2717 ) * added tutorial and images for it Signed-off-by: Max Cembalest <mbcembalest@gmail.com> * updated images Signed-off-by: abhisomala <68791501+abhisomala@users.noreply.github.com> Signed-off-by: Max Cembalest <mbcembalest@gmail.com> * Minor updates Signed-off-by: abhisomala <68791501+abhisomala@users.noreply.github.com> Signed-off-by: Max Cembalest <mbcembalest@gmail.com> * fix link & indent note callouts Signed-off-by: mcembalest <70534565+mcembalest@users.noreply.github.com> Signed-off-by: Max Cembalest <mbcembalest@gmail.com> * added obsidian tutorial to sidebar and fixed formatting of note boxes Signed-off-by: Max Cembalest <mbcembalest@gmail.com> --------- Signed-off-by: Max Cembalest <mbcembalest@gmail.com> Signed-off-by: abhisomala <68791501+abhisomala@users.noreply.github.com> Signed-off-by: mcembalest <70534565+mcembalest@users.noreply.github.com> Co-authored-by: mcembalest <70534565+mcembalest@users.noreply.github.com> Co-authored-by: Max Cembalest <mbcembalest@gmail.com>		3 months ago
.circleci	ci: upload installer repo as compressed archive (#2636 )	3 months ago
.github	ci: update checkout action to v4 in codespell workflow (#2414 )	4 months ago
gpt4all-backend	llamamodel: always print special tokens (#2701 )	3 months ago
gpt4all-bindings	added tutorial and images for it (#2717 )	3 months ago
gpt4all-chat	Show scrollbar in CollectionsDrawer as needed (#2691 )	3 months ago
gpt4all-training	typo in training log documentation (#2452 )	3 months ago
.codespellrc	Ignore translation files in codespell.	3 months ago
.gitignore	Update .gitignore and Dockerfile, add .env file	11 months ago
.gitmodules	chat: fix build on Windows and Nomic Embed path on macOS (#2467 )	4 months ago
CONTRIBUTING.md	[DATALAD RUNCMD] run codespell throughout	1 year ago
LICENSE.txt	Add MIT license.	2 years ago
MAINTAINERS.md	Update MAINTAINERS.md to add Riccardo (#2692 )	3 months ago
README.md	small edits and placeholder gif (#2513 )	4 months ago
gpt4all-lora-demo.gif	GIF	2 years ago
roadmap.md	small edits and placeholder gif (#2513 )	4 months ago

README.md

GPT4All

GPT4All runs large language models (LLMs) privately on everyday desktops & laptops.

No API calls or GPUs required - you can just download the application and get started

https://github.com/nomic-ai/gpt4all/assets/70534565/513a0f15-4964-4109-89e4-4f9a9011f311

Download for Windows

Download for MacOS

Download for Ubuntu

Website • Documentation • Discord

Subscribe to the newsletter

GPT4All is made possible by our compute partner Paperspace.

Install GPT4All Python

gpt4all gives you access to LLMs with our Python client around llama.cpp implementations.

Nomic contributes to open source software like llama.cpp to make LLMs accessible and efficient for all.

pip install gpt4all

from gpt4all import GPT4All
model = GPT4All("Meta-Llama-3-8B-Instruct.Q4_0.gguf") # downloads / loads a 4.66GB LLM
with model.chat_session():
    print(model.generate("How can I run LLMs efficiently on my laptop?", max_tokens=1024))

Integrations

🦜🔗 Langchain 🗃️ Weaviate Vector Database - module docs 🔭 OpenLIT (OTel-native Monitoring) - Docs

Release History

July 2nd, 2024: V3.0.0 Release
- Fresh redesign of the chat application UI
- Improved user workflow for LocalDocs
- Expanded access to more model architectures
October 19th, 2023: GGUF Support Launches with Support for:
- Mistral 7b base model, an updated model gallery on gpt4all.io, several new local code models including Rift Coder v1.5
- Nomic Vulkan support for Q4_0 and Q4_1 quantizations in GGUF.
- Offline build support for running old versions of the GPT4All Local LLM Chat Client.
September 18th, 2023: Nomic Vulkan launches supporting local LLM inference on NVIDIA and AMD GPUs.
July 2023: Stable support for LocalDocs, a feature that allows you to privately and locally chat with your data.
June 28th, 2023: Docker-based API server launches allowing inference of local LLMs from an OpenAI-compatible HTTP endpoint.

Contributing

GPT4All welcomes contributions, involvement, and discussion from the open source community! Please see CONTRIBUTING.md and follow the issues, bug reports, and PR markdown templates.

Check project discord, with project owners, or through existing issues/PRs to avoid duplicate work. Please make sure to tag all of the above with relevant project identifiers or your contribution could potentially get lost. Example tags: backend, bindings, python-bindings, documentation, etc.

Citation

If you utilize this repository, models or data in a downstream project, please consider citing it with:

@misc{gpt4all,
  author = {Yuvanesh Anand and Zach Nussbaum and Brandon Duderstadt and Benjamin Schmidt and Andriy Mulyar},
  title = {GPT4All: Training an Assistant-style Chatbot with Large Scale Data Distillation from GPT-3.5-Turbo},
  year = {2023},
  publisher = {GitHub},
  journal = {GitHub repository},
  howpublished = {\url{https://github.com/nomic-ai/gpt4all}},
}