Commit Graph

18 Commits (fb2d36da6c6395693b4e26f48116a1b0b16f9110)

Author SHA1 Message Date
Zach Nussbaum 60155de2a6 chore: peft 1 year ago
Zach 8733576664 feat: evals on new gptj models 1 year ago
Zach Nussbaum c11ea7dc31 fix: bs try one more time? 1 year ago
Zach Nussbaum 2827693a57 fix: smaller bs for 40gb 1 year ago
Zach Nussbaum 5de765410a fix: add wd + min lr to config 1 year ago
Zach Nussbaum df29c62521 fix: config + ignore pkl 1 year ago
zanussbaum fbb788e451 feat: lora gptj 1 year ago
zanussbaum dcc5204352 fix: batch size 1 year ago
zanussbaum aa8dd7a636 feat: update for mosaic 1 year ago
Zach c2fc164779 fix: configs 1 year ago
Zach Nussbaum 98ceac34e1 fix: gptj multinode 1 year ago
Zach Nussbaum c68311810a fix: clean up data, pad at end 1 year ago
Zach Nussbaum ab4b13b2fa Update finetune_lora.yaml 2 years ago
Zach Nussbaum b0fd406ebb Update finetune.yaml 2 years ago
Zach Nussbaum ed08006053 feat: lora config 2 years ago
Zach Nussbaum 80227dc164 feat: full model config 2 years ago
Zach Nussbaum 2daecd6066 feat: update embeddings 2 years ago
Zach Nussbaum 723a50bdf1 feat: train and clean data 2 years ago