You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

History

Andriy Mulyar fca2578a81 Documentation improvements on LocalDocs (#790 ) * Update gpt4all_chat.md Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com> * typo Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com> --------- Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>		1 year ago
..
docs	Documentation improvements on LocalDocs (#790 )	1 year ago
gpt4all	hotfix default verbose optioin	1 year ago
tests	[DATALAD RUNCMD] run codespell throughout	1 year ago
.gitignore	transfer python bindings code	1 year ago
LICENSE.txt	transfer python bindings code	1 year ago
MANIFEST.in	transfer python bindings code	1 year ago
README.md	Improvements to documentation (#606 )	1 year ago
makefile	transfer python bindings code	1 year ago
mkdocs.yml	GPT4All Updated Docs and FAQ (#632 )	1 year ago
setup.py	fixed response formatting when streaming	1 year ago

README.md

Python GPT4All

This package contains a set of Python bindings around the llmodel C-API.

Documentation

docs.gpt4all.io

Installation

pip install gpt4all

Local Build Instructions

NOTE: If you are doing this on a Windows machine, you must build the GPT4All backend using MinGW64 compiler.

Setup llmodel

git clone --recurse-submodules https://github.com/nomic-ai/gpt4all
cd gpt4all/gpt4all-backend/
mkdir build
cd build
cmake ..
cmake --build . --parallel

Confirm that libllmodel.* exists in gpt4all-backend/build.

Setup Python package

cd ../../gpt4all-bindings/python
pip3 install -e .

Test it out! In a Python script or console:


from gpt4all import GPT4All

gptj = GPT4All("ggml-gpt4all-j-v1.3-groovy")
messages = [{"role": "user", "content": "Name 3 colors"}]
gptj.chat_completion(messages)