Update README.md

This commit is contained in:
Adam Treat 2023-04-09 00:01:42 -04:00
parent 7f7b5331cb
commit 91e28ae8f4

View File

@ -13,10 +13,11 @@ GPT-J model.
* The UI is made to look and feel like you've come to expect from a chatty gpt * The UI is made to look and feel like you've come to expect from a chatty gpt
* Easy to install... The plan is to create precompiled binaries for major platforms with easy installer including model * Easy to install... The plan is to create precompiled binaries for major platforms with easy installer including model
## Building ## Building and running
* Install Qt 6.x for your platform https://doc.qt.io/qt-6/get-and-install-qt.html * Install Qt 6.x for your platform https://doc.qt.io/qt-6/get-and-install-qt.html
* Install cmake for your platform https://cmake.org/install/ * Install cmake for your platform https://cmake.org/install/
* Download https://huggingface.co/EleutherAI/gpt-j-6b
* Clone this repo and build * Clone this repo and build
``` ```
git clone --recurse-submodules https://github.com/manyoso/gpt4all-chat.git git clone --recurse-submodules https://github.com/manyoso/gpt4all-chat.git
@ -25,12 +26,11 @@ mkdir build
cd build cd build
cmake .. cmake ..
cmake --build . --parallel cmake --build . --parallel
python3 ../ggml/examples/gpt-j/convert-h5-to-ggml.py /path/to/your/local/copy/of/EleutherAI/gpt-j-6B 0
./bin/gpt-j-quantize /path/to/your/local/copy/of/EleutherAI/gpt-j-6B/ggml-model-f32.bin ./ggml-model-q4_0.bin 2
./chat
``` ```
## Running
* Simply place the appropriate model file named ```ggml-model-q4_0.bin``` in the same directory as the exe produced above and start the exe
## Contributing ## Contributing
* Pull requests welcome :) * Pull requests welcome :)