Commit Graph

156 Commits (60155de2a69630e0f8536d32c6d5d7481005d00a)
 

Author SHA1 Message Date
Zach Nussbaum 60155de2a6 chore: peft 1 year ago
Zach Nussbaum 3c11e68ec8 feat: commits for eval + generation 1 year ago
Zach Nussbaum 70d75951d1 chore: remove not needed 1 year ago
Zach Nussbaum 84de913baf chore: submodule ff 1 year ago
Zach Nussbaum f2cb38e65a Merge branch 'gptj' of github.com:nomic-ai/gpt4all into gptj 1 year ago
Zach Nussbaum 6e84421f3f fix: num training steps for lr decay 1 year ago
Zach 8733576664 feat: evals on new gptj models 1 year ago
Zach 5caed073ee fix: topic model for embeddings 1 year ago
Zach Nussbaum c11ea7dc31 fix: bs try one more time? 1 year ago
Zach Nussbaum 2827693a57 fix: smaller bs for 40gb 1 year ago
Zach Nussbaum f5ca8bedcf fix: config for lora gptj 1 year ago
Zach Nussbaum 6de58dd1fc fix: saving name 1 year ago
Zach Nussbaum 305fe3d444 Merge remote-tracking branch 'origin/mosaic' into gptj 1 year ago
Zach Nussbaum c1ca081cda fix: eos/pad token + wd 1 year ago
Zach Nussbaum 5de765410a fix: add wd + min lr to config 1 year ago
Zach Nussbaum c0a9065032 fix: tokenization error 1 year ago
Zach Nussbaum df29c62521 fix: config + ignore pkl 1 year ago
Zach Nussbaum f479a37818 feat: build map script 1 year ago
Zach 2034f0c479 fix: embeddings instead of logits!!! 1 year ago
zanussbaum fbb788e451 feat: lora gptj 1 year ago
zanussbaum dcc5204352 fix: batch size 1 year ago
zanussbaum aa8dd7a636 feat: update for mosaic 1 year ago
Zach Nussbaum 1b5e660476 fix: pyarrow filter 1 year ago
Zach Nussbaum f974ca651c fix: inference save shards 1 year ago
Zach 573272ad69 fix: drop uneven batch size 1 year ago
Zach d93f6c2ced fix: concat 1 year ago
Zach 57eb786756 fix: data for inference 1 year ago
Zach 3f9fea47d7 feat: inference for embedding plots 1 year ago
Zach 8f2eb1a583 fix: grad accum loss calc 1 year ago
Zach e4e88dff33 fix: data processing 1 year ago
Zach c2fc164779 fix: configs 1 year ago
Zach 838b19bea5 fix: try except push 1 year ago
Zach Nussbaum 885b7f1a3a feat: multinode setup 1 year ago
Zach Nussbaum 98ceac34e1 fix: gptj multinode 1 year ago
Zach Nussbaum 0c8666f635 fix: ignore env 1 year ago
Zach Nussbaum 9567f445b8 fix: only on first process, not once on every node 1 year ago
Zach Nussbaum ad33b83a48 fix: eval func 1 year ago
Zach 8dd99cc00a fix: prompt len for larger 1 year ago
Zach Nussbaum 63ff39653d feat: gpt-j config 1 year ago
Zach Nussbaum 32357c920f feat: adamw, fix training, log gradients 1 year ago
Zach Nussbaum c68311810a fix: clean up data, pad at end 1 year ago
Zach Nussbaum f45eb001a1 fix: clean where prompt is randomly 1 char 1 year ago
Zach Nussbaum c7f4ca25e4 chore: gitignore ckpts 1 year ago
Andriy Mulyar 9d30a6063e Merge pull request #3 from nomic-ai/train
log wandb multi-epoch
2 years ago
Andriy Mulyar 0eef27364d Qualified number of epochs for LoRa weights 2 years ago
Andriy Mulyar d61f0077ee Merge pull request #42 from tiendung/main
Change git clone url to https://github.com/nomic-ai/gpt4all.git to avoid `Permission denied`
2 years ago
Andriy Mulyar 4ebac17592 Added Torrent Magnet Link 2 years ago
Andriy Mulyar f1af332b22 Merge pull request #36 from Hello1024/patch-1
Update README.md to add torrent link to data
2 years ago
Andriy Mulyar 1e0eb13ce7 Merge branch 'main' into patch-1 2 years ago
Andriy Mulyar 8f5067fdca Merge pull request #31 from EliasVincent/chat-windows-binary
Add chat binary for Windows
2 years ago