Archives/gpt4all
2
0
Fork 0
mirror of https://github.com/nomic-ai/gpt4all synced 2024-11-18 03:25:46 +00:00
Code Issues Packages Projects Releases Wiki Activity
3668cf00cf
gpt4all/gpt4all-bindings/python
History
Richard Guo 3668cf00cf clean up and jank windows wheel build
2023-05-10 15:58:27 -04:00
..
docs transfer python bindings code 2023-05-10 13:38:32 -04:00
gpt4all clean up and jank windows wheel build 2023-05-10 15:58:27 -04:00
tests clean up and jank windows wheel build 2023-05-10 15:58:27 -04:00
.gitignore transfer python bindings code 2023-05-10 13:38:32 -04:00
LICENSE.txt transfer python bindings code 2023-05-10 13:38:32 -04:00
makefile transfer python bindings code 2023-05-10 13:38:32 -04:00
MANIFEST.in transfer python bindings code 2023-05-10 13:38:32 -04:00
mkdocs.yml transfer python bindings code 2023-05-10 13:38:32 -04:00
README.md refactor circle ci config 2023-05-10 13:57:54 -04:00
setup.py clean up and jank windows wheel build 2023-05-10 15:58:27 -04:00

README.md

Python GPT4All

This package contains a set of Python bindings that runs the llmodel C-API.

Local Installation Instructions

TODO: Right now instructions in main README still depend on Qt6 setup. To setup Python bindings, we just need llmodel to be built which is much simpler. However, in the future, the below installation instructions should be sequentially organized such that we expect the main README's instructions were followed first.

  1. Setup llmodel
git clone --recurse-submodules https://github.com/nomic-ai/gpt4all
cd gpt4all-backend/llmodel/
mkdir build
cd build
cmake ..
cmake --build . --parallel

Confirm that libllmodel.* exists in gpt4all-backend/llmodel/build.

  1. Setup Python package
cd ../../gpt4all-bindings/python
pip3 install -r requirements.txt
pip3 install -e .
  1. Test it out! In a Python script or console:

from gpt4all import GPT4All

gptj = GPT4All("ggml-gpt4all-j-v1.3-groovy")
messages = [{"role": "user", "content": "Name 3 colors"}]
gptj.chat_completion(messages)