gpt4all/gpt4all-training/GPT-J_MAP.md

# Inference on Training Data


## Run Inference

```bash
torchrun --master_port=29085 --nproc-per-node 8 inference.py --config=configs/inference/gptj.yaml
```


## Visualizations

```bash
python build_map.py
```
 
will build a map in `Atlas`, one using the internal clustering algorithm provided by Nomic and one using the embeddings generated by the finetuned model.