gpt4all/gpt4all-bindings/python/README.md

43 lines
733 B
Markdown
Raw Normal View History

2023-05-10 17:38:32 +00:00
# Python GPT4All
2023-05-11 15:02:44 +00:00
This package contains a set of Python bindings around the `llmodel` C-API.
2023-05-10 17:38:32 +00:00
2023-05-11 18:29:17 +00:00
## Installation
```
pip install gpt4all
```
2023-05-10 17:38:32 +00:00
2023-05-11 15:02:44 +00:00
## Local Build Instructions
2023-05-10 17:38:32 +00:00
1. Setup `llmodel`
```
2023-05-10 17:48:36 +00:00
git clone --recurse-submodules https://github.com/nomic-ai/gpt4all
cd gpt4all-backend/llmodel/
2023-05-10 17:38:32 +00:00
mkdir build
cd build
cmake ..
cmake --build . --parallel
```
2023-05-10 17:48:36 +00:00
Confirm that `libllmodel.*` exists in `gpt4all-backend/llmodel/build`.
2023-05-10 17:38:32 +00:00
2. Setup Python package
```
2023-05-10 17:48:36 +00:00
cd ../../gpt4all-bindings/python
2023-05-10 17:38:32 +00:00
pip3 install -e .
```
3. Test it out! In a Python script or console:
```python
from gpt4all import GPT4All
gptj = GPT4All("ggml-gpt4all-j-v1.3-groovy")
messages = [{"role": "user", "content": "Name 3 colors"}]
gptj.chat_completion(messages)
```