From e1199b0f674da1748d8945cd9adae193333e62e4 Mon Sep 17 00:00:00 2001
From: Zach Nussbaum <zanussbaum@gmail.com>
Date: Thu, 13 Apr 2023 17:59:19 +0000
Subject: [PATCH] fix: train gpt-j command

---
 README.md | 4 +++-
 1 file changed, 3 insertions(+), 1 deletion(-)

diff --git a/README.md b/README.md
index f77b4993..254695bd 100644
--- a/README.md
+++ b/README.md
@@ -67,7 +67,9 @@ Please see [GPT4All-J Technical Report]() for details.
 
 ### GPT4All-J Training Instructions
 
-
+```bash
+accelerate launch --dynamo_backend=inductor --num_processes=8 --num_machines=1 --machine_rank=0 --deepspeed_multinode_launcher standard --mixed_precision=bf16  --use_deepspeed --deepspeed_config_file=configs/deepspeed/ds_config_gptj.json train.py --config configs/train/finetune_gptj.yaml
+```
 
 
 # Original GPT4All Model (based on GPL Licensed LLaMa)