Commit Graph

13 Commits (053f2e4f245b4f86523e27b1e78e382d560383f7)

Author SHA1 Message Date
Zach Nussbaum 6e84421f3f fix: num training steps for lr decay 1 year ago
Zach Nussbaum 6de58dd1fc fix: saving name 1 year ago
Zach Nussbaum c1ca081cda fix: eos/pad token + wd 1 year ago
Zach 8f2eb1a583 fix: grad accum loss calc 1 year ago
Zach 838b19bea5 fix: try except push 1 year ago
Zach Nussbaum 9567f445b8 fix: only on first process, not once on every node 1 year ago
Zach Nussbaum ad33b83a48 fix: eval func 1 year ago
Zach Nussbaum 32357c920f feat: adamw, fix training, log gradients 1 year ago
Zach Nussbaum 812b807003 fix: log for multiple epochs 2 years ago
Zach Nussbaum b24ca03dc4 fix: append first_epoch 2 years ago
Zach Nussbaum 24765a1965 fix: add epoch train 2 years ago
Zach Nussbaum 2daecd6066 feat: update embeddings 2 years ago
Zach Nussbaum 723a50bdf1 feat: train and clean data 2 years ago