Commit Graph

44 Commits

Author SHA1 Message Date
Zach Nussbaum
fd32a8021d Update finetune.yaml 2023-04-13 18:04:30 -07:00
Zach Nussbaum
cf35a2e351 Update finetune_lora.yaml 2023-04-13 18:04:02 -07:00
Zach Nussbaum
f10f8099db fix: update config 2023-04-13 17:58:59 +00:00
Zach Nussbaum
60155de2a6 chore: peft 2023-04-12 03:50:54 +00:00
Zach Nussbaum
3c11e68ec8 feat: commits for eval + generation 2023-04-11 19:14:29 +00:00
Zach
8733576664 feat: evals on new gptj models 2023-04-10 02:14:20 +00:00
Zach Nussbaum
c11ea7dc31 fix: bs try one more time? 2023-04-08 21:47:07 +00:00
Zach Nussbaum
2827693a57 fix: smaller bs for 40gb 2023-04-08 21:36:20 +00:00
Zach Nussbaum
f5ca8bedcf fix: config for lora gptj 2023-04-08 21:17:12 +00:00
Zach Nussbaum
5de765410a fix: add wd + min lr to config 2023-04-08 20:37:51 +00:00
Zach Nussbaum
df29c62521 fix: config + ignore pkl 2023-04-08 20:33:02 +00:00
zanussbaum
fbb788e451 feat: lora gptj 2023-04-07 17:53:07 -04:00
zanussbaum
dcc5204352 fix: batch size 2023-04-07 17:41:45 -04:00
zanussbaum
aa8dd7a636 feat: update for mosaic 2023-04-07 16:54:29 -04:00
Zach
3f9fea47d7 feat: inference for embedding plots 2023-04-07 01:40:39 +00:00
Zach
c2fc164779 fix: configs 2023-04-05 20:42:35 +00:00
Zach Nussbaum
98ceac34e1 fix: gptj multinode 2023-04-05 02:52:44 +00:00
Zach Nussbaum
63ff39653d feat: gpt-j config 2023-04-04 20:58:08 +00:00
Zach Nussbaum
c68311810a fix: clean up data, pad at end 2023-04-04 20:53:23 +00:00
Zach Nussbaum
e220c2f6c8 Update generate_large_2.yaml 2023-03-28 21:03:10 -07:00
Zach Nussbaum
870bd36e27 Update generate_large_3.yaml 2023-03-28 21:02:58 -07:00
Zach Nussbaum
382f35480a Update generate_full.yaml 2023-03-28 21:02:32 -07:00
Zach Nussbaum
6c418d263d Update generate_baseline.yaml 2023-03-28 21:00:57 -07:00
Zach Nussbaum
5a96e50eec Update generate.yaml 2023-03-28 21:00:36 -07:00
Zach Nussbaum
ab4b13b2fa Update finetune_lora.yaml 2023-03-28 20:58:33 -07:00
Zach Nussbaum
b0fd406ebb Update finetune.yaml 2023-03-28 20:58:03 -07:00
Zach Nussbaum
9c27e46c10 Update generate.yaml 2023-03-28 13:59:26 -07:00
bstadt
a44a98f445 Merge branch 'main' of https://github.com/nomic-ai/gpt4all into main 2023-03-28 20:23:42 +00:00
bstadt
37cc5c8c39 updated eval 2023-03-28 20:22:48 +00:00
Zach Nussbaum
b8808927bf Update generate_llama.yaml
fix: paths
2023-03-28 13:08:56 -07:00
Zach Nussbaum
c48d7290c6 Update generate.yaml
update paths
2023-03-28 13:08:29 -07:00
bstadt
6d98aef302 added eval code 2023-03-28 18:47:38 +00:00
bstadt
4e8e7e7300 metrics run on configs now 2023-03-28 00:09:47 +00:00
bstadt
d5769d7614 removed swp 2023-03-27 22:00:09 +00:00
bstadt
444871189d added eval configs 2023-03-27 21:59:40 +00:00
bstadt
b48a52d934 started eval script and added eval data 2023-03-27 21:50:08 +00:00
Zach Nussbaum
29cb9d700a Merge branch 'train' of github.com:nomic-ai/gpt4all into train 2023-03-27 17:39:39 +00:00
Zach Nussbaum
f2e122ff82 fix: add prompt 2023-03-27 17:39:29 +00:00
Zach Nussbaum
ed08006053 feat: lora config 2023-03-27 17:33:13 +00:00
Zach Nussbaum
80227dc164 feat: full model config 2023-03-27 17:30:57 +00:00
Zach Nussbaum
2daecd6066 feat: update embeddings 2023-03-26 17:45:21 +00:00
Zach Nussbaum
134d566b79 feat: base llama 2023-03-25 21:45:58 +00:00
Zach Nussbaum
b6e3ba07c4 feat: generation works 2023-03-25 16:43:27 +00:00
Zach Nussbaum
723a50bdf1 feat: train and clean data 2023-03-25 16:17:48 +00:00