mirror of
https://github.com/nomic-ai/gpt4all
synced 2024-11-06 09:20:33 +00:00
17 lines
367 B
Markdown
17 lines
367 B
Markdown
# Inference on Training Data
|
|
|
|
|
|
## Run Inference
|
|
|
|
```bash
|
|
torchrun --master_port=29085 --nproc-per-node 8 inference.py --config=configs/inference/gptj.yaml
|
|
```
|
|
|
|
|
|
## Visualizations
|
|
|
|
```bash
|
|
python build_map.py
|
|
```
|
|
|
|
will build a map in `Atlas`, one using the internal clustering algorithm provided by Nomic and one using the embeddings generated by the finetuned model. |