From 43a49e9590d878d345b3212a8a85ebf28ef3008c Mon Sep 17 00:00:00 2001 From: Zach Nussbaum Date: Wed, 19 Apr 2023 11:35:08 -0700 Subject: [PATCH] add model + data revisions --- README.md | 18 ++++++++++++++++++ 1 file changed, 18 insertions(+) diff --git a/README.md b/README.md index 814d8ff0..b9b85e44 100644 --- a/README.md +++ b/README.md @@ -77,6 +77,24 @@ Please see [GPT4All-J Technical Report](https://static.nomic.ai/gpt4all/2023_GPT - We are releasing the curated training data for anyone to replicate GPT4All-J here: [GPT4All-J Training Data](https://huggingface.co/datasets/nomic-ai/gpt4all-j-prompt-generations) - [Atlas Map of Prompts](https://atlas.nomic.ai/map/gpt4all-j-prompts-curated) - [Atlas Map of Responses](https://atlas.nomic.ai/map/gpt4all-j-response-curated) + +We have released updated versions of our `GPT4All-J` model and training data. + +- `v1.0`: The original model trained on the v1.0 dataset +- `v1.1-breezy`: Trained on afiltered dataset where we removed all instances of AI language model +- `v1.2-jazzy`: Trained on a filtered dataset where we also removed instances like I'm sorry, I can't answer... and AI language model + +The [models](https://huggingface.co/nomic-ai/gpt4all-j) and [data](https://huggingface.co/datasets/nomic-ai/gpt4all-j-prompt-generations) versions can be specified by passing a `revision` argument. + +For example, to load the `v1.2-jazzy` model and dataset, run: + +```python +from datasets import load_dataset +from transformers import AutoModelForCausalLM + +dataset = load_dataset("nomic-ai/gpt4all-j-prompt-generations", revision="v1.2-jazzy") +model = AutoModelForCausalLM.from_pretrained("nomic-ai/gpt4all-j-prompt-generations", revision="v1.2-jazzy") +``` ### GPT4All-J Training Instructions