Commit Graph

170 Commits (6bcb8bab0f9f43c8ef813b01ba74f0d0845aec50)
 

Author SHA1 Message Date
Zach Nussbaum 6bcb8bab0f fix: rephrase 1 year ago
Zach Nussbaum a42a8643ad fix: typo 1 year ago
Zach Nussbaum 92823db74b Merge branch 'gptj' of github.com:nomic-ai/gpt4all into gptj 1 year ago
Zach Nussbaum 9e01944bc6 feat: wip training log 1 year ago
Zach Nussbaum f92d9e896f fix: figs 1 year ago
Andriy Mulyar 3154e6333e Compute partner 1 year ago
Zach Nussbaum e1199b0f67 fix: train gpt-j command 1 year ago
Zach Nussbaum f10f8099db fix: update config 1 year ago
Zach Nussbaum a93457199c fix: map links 1 year ago
Zach Nussbaum 855bc17b1d fix: gpt-j data link 1 year ago
Andriy Mulyar 5467ec78ea Update README.md 1 year ago
Andriy Mulyar 053f2e4f24 Update README.md 1 year ago
Zach Nussbaum d7395ee37a Merge: main into gptj 1 year ago
Zach Nussbaum b1e361882d fix: multi-turn data breaks 1 year ago
Zach Nussbaum 60155de2a6 chore: peft 1 year ago
Zach Nussbaum 3c11e68ec8 feat: commits for eval + generation 1 year ago
Zach Nussbaum 70d75951d1 chore: remove not needed 1 year ago
Zach Nussbaum 84de913baf chore: submodule ff 1 year ago
Zach Nussbaum f2cb38e65a Merge branch 'gptj' of github.com:nomic-ai/gpt4all into gptj 1 year ago
Zach Nussbaum 6e84421f3f fix: num training steps for lr decay 1 year ago
Zach 8733576664 feat: evals on new gptj models 1 year ago
Zach 5caed073ee fix: topic model for embeddings 1 year ago
Zach Nussbaum c11ea7dc31 fix: bs try one more time? 1 year ago
Zach Nussbaum 2827693a57 fix: smaller bs for 40gb 1 year ago
Zach Nussbaum f5ca8bedcf fix: config for lora gptj 1 year ago
Zach Nussbaum 6de58dd1fc fix: saving name 1 year ago
Zach Nussbaum 305fe3d444 Merge remote-tracking branch 'origin/mosaic' into gptj 1 year ago
Zach Nussbaum c1ca081cda fix: eos/pad token + wd 1 year ago
Zach Nussbaum 5de765410a fix: add wd + min lr to config 1 year ago
Zach Nussbaum c0a9065032 fix: tokenization error 1 year ago
Zach Nussbaum df29c62521 fix: config + ignore pkl 1 year ago
Zach Nussbaum f479a37818 feat: build map script 1 year ago
Zach 2034f0c479 fix: embeddings instead of logits!!! 1 year ago
zanussbaum fbb788e451 feat: lora gptj 1 year ago
zanussbaum dcc5204352 fix: batch size 1 year ago
zanussbaum aa8dd7a636 feat: update for mosaic 1 year ago
Zach Nussbaum 1b5e660476 fix: pyarrow filter 1 year ago
Zach Nussbaum f974ca651c fix: inference save shards 1 year ago
Zach 573272ad69 fix: drop uneven batch size 1 year ago
Zach d93f6c2ced fix: concat 1 year ago
Zach 57eb786756 fix: data for inference 1 year ago
Zach 3f9fea47d7 feat: inference for embedding plots 1 year ago
Zach 8f2eb1a583 fix: grad accum loss calc 1 year ago
Zach e4e88dff33 fix: data processing 1 year ago
Zach c2fc164779 fix: configs 1 year ago
Zach 838b19bea5 fix: try except push 1 year ago
Zach Nussbaum 885b7f1a3a feat: multinode setup 1 year ago
Zach Nussbaum 98ceac34e1 fix: gptj multinode 1 year ago
Zach Nussbaum 0c8666f635 fix: ignore env 1 year ago
Zach Nussbaum 9567f445b8 fix: only on first process, not once on every node 1 year ago