Commit Graph

252 Commits

Author SHA1 Message Date
Zach Nussbaum
9ca1f2d753 Merge pull request #334 from nomic-ai/main
Update expired discord link
2023-04-13 17:39:19 -04:00
Zach Nussbaum
80dfaf9bff Update README.md 2023-04-13 14:20:19 -07:00
Zach Nussbaum
3eedaf7c99 Update README.md 2023-04-13 14:19:49 -07:00
Zach Nussbaum
593ee25435 Update README.md 2023-04-13 14:02:19 -07:00
Benjamin Schmidt
8d2e56ba6d Merge pull request #335 from nomic-ai/gptj
GPT-J
2023-04-13 16:59:09 -04:00
Zach Nussbaum
2285d21d06 fix: rename 2023-04-13 20:58:27 +00:00
Zach Nussbaum
97918169f1 fix naming 2023-04-13 20:56:45 +00:00
Zach Nussbaum
fb2d36da6c fix: readme 2023-04-13 20:55:49 +00:00
Zach Nussbaum
cc53a48d1e Merge branch 'main' into gptj 2023-04-13 20:42:46 +00:00
Andriy Mulyar
4e9f14d550 Update README.md 2023-04-13 16:34:14 -04:00
Zach Nussbaum
48347eea7c fix: format 2023-04-13 20:30:45 +00:00
Zach Nussbaum
306afe15b2 Merge branch 'gptj' of github.com:nomic-ai/gpt4all into gptj 2023-04-13 20:30:10 +00:00
Zach Nussbaum
a49576690a chore: remove transformers submodule 2023-04-13 20:30:01 +00:00
Andriy Mulyar
b49ec5b2de Update README.md 2023-04-13 16:23:26 -04:00
Andriy Mulyar
d5ba0c65d4 Update README.md 2023-04-13 16:06:12 -04:00
Andriy Mulyar
2eddacda9c GPT4All Website 2023-04-13 16:05:43 -04:00
Yuvanesh-ux
2cc8d16c76 Update README.md 2023-04-13 15:48:52 -04:00
Zach Nussbaum
6bcb8bab0f fix: rephrase 2023-04-13 19:13:37 +00:00
Zach Nussbaum
a42a8643ad fix: typo 2023-04-13 19:11:05 +00:00
Zach Nussbaum
92823db74b Merge branch 'gptj' of github.com:nomic-ai/gpt4all into gptj 2023-04-13 18:41:50 +00:00
Zach Nussbaum
9e01944bc6 feat: wip training log 2023-04-13 18:41:39 +00:00
Zach Nussbaum
f92d9e896f fix: figs 2023-04-13 18:41:22 +00:00
Andriy Mulyar
3154e6333e Compute partner 2023-04-13 14:33:52 -04:00
Zach Nussbaum
e1199b0f67 fix: train gpt-j command 2023-04-13 17:59:19 +00:00
Zach Nussbaum
f10f8099db fix: update config 2023-04-13 17:58:59 +00:00
Zach Nussbaum
a93457199c fix: map links 2023-04-13 17:52:04 +00:00
Zach Nussbaum
855bc17b1d fix: gpt-j data link 2023-04-13 17:41:07 +00:00
Andriy Mulyar
5467ec78ea Update README.md 2023-04-13 12:57:12 -04:00
Andriy Mulyar
053f2e4f24 Update README.md 2023-04-13 12:56:08 -04:00
Zach Nussbaum
d7395ee37a Merge: main into gptj 2023-04-13 15:16:31 +00:00
Zach Nussbaum
b1e361882d fix: multi-turn data breaks 2023-04-12 03:51:29 +00:00
Zach Nussbaum
60155de2a6 chore: peft 2023-04-12 03:50:54 +00:00
Zach Nussbaum
3c11e68ec8 feat: commits for eval + generation 2023-04-11 19:14:29 +00:00
Zach Nussbaum
70d75951d1 chore: remove not needed 2023-04-11 12:39:07 +00:00
Zach Nussbaum
84de913baf chore: submodule ff 2023-04-10 02:16:05 +00:00
Zach Nussbaum
f2cb38e65a Merge branch 'gptj' of github.com:nomic-ai/gpt4all into gptj 2023-04-10 02:15:47 +00:00
Zach Nussbaum
6e84421f3f fix: num training steps for lr decay 2023-04-10 02:15:31 +00:00
Zach
8733576664 feat: evals on new gptj models 2023-04-10 02:14:20 +00:00
Zach
5caed073ee fix: topic model for embeddings 2023-04-09 15:12:49 +00:00
Zach Nussbaum
c11ea7dc31 fix: bs try one more time? 2023-04-08 21:47:07 +00:00
Zach Nussbaum
2827693a57 fix: smaller bs for 40gb 2023-04-08 21:36:20 +00:00
Zach Nussbaum
f5ca8bedcf fix: config for lora gptj 2023-04-08 21:17:12 +00:00
Zach Nussbaum
6de58dd1fc fix: saving name 2023-04-08 20:56:13 +00:00
Zach Nussbaum
305fe3d444 Merge remote-tracking branch 'origin/mosaic' into gptj 2023-04-08 20:47:01 +00:00
Zach Nussbaum
c1ca081cda fix: eos/pad token + wd 2023-04-08 20:38:10 +00:00
Zach Nussbaum
5de765410a fix: add wd + min lr to config 2023-04-08 20:37:51 +00:00
Zach Nussbaum
c0a9065032 fix: tokenization error 2023-04-08 20:33:51 +00:00
Zach Nussbaum
df29c62521 fix: config + ignore pkl 2023-04-08 20:33:02 +00:00
Zach Nussbaum
f479a37818 feat: build map script 2023-04-08 19:30:53 +00:00
Zach
2034f0c479 fix: embeddings instead of logits!!! 2023-04-08 17:05:40 +00:00