Commit Graph

18 Commits (049fd2fd507877d538f408139b09fd9c4cdd3bd3)

Author SHA1 Message Date
Zach Nussbaum 15f7c5b68f chore: peft 1 year ago
Zach 311c818934 feat: evals on new gptj models 1 year ago
Zach Nussbaum 7807a80bbb fix: bs try one more time? 1 year ago
Zach Nussbaum 2f0eba211d fix: smaller bs for 40gb 1 year ago
Zach Nussbaum c82ee7d882 fix: add wd + min lr to config 1 year ago
Zach Nussbaum b66f127ade fix: config + ignore pkl 1 year ago
zanussbaum 147c2fd7eb feat: lora gptj 1 year ago
zanussbaum 2b001e8932 fix: batch size 1 year ago
zanussbaum 7cfda6a21f feat: update for mosaic 1 year ago
Zach 5baead45be fix: configs 1 year ago
Zach Nussbaum 0a3834d086 fix: gptj multinode 1 year ago
Zach Nussbaum 5c5f41ba36 fix: clean up data, pad at end 1 year ago
Zach Nussbaum 07798cfbd2
Update finetune_lora.yaml 1 year ago
Zach Nussbaum fdb15fc8f1
Update finetune.yaml 1 year ago
Zach Nussbaum ed08006053 feat: lora config 1 year ago
Zach Nussbaum 80227dc164 feat: full model config 1 year ago
Zach Nussbaum 2daecd6066 feat: update embeddings 1 year ago
Zach Nussbaum 723a50bdf1 feat: train and clean data 1 year ago