18 Commits

Author	SHA1	Message	Date
Zach Nussbaum	60155de2a6	chore: peft	2023-04-12 03:50:54 +00:00
Zach	8733576664	feat: evals on new gptj models	2023-04-10 02:14:20 +00:00
Zach Nussbaum	c11ea7dc31	fix: bs try one more time?	2023-04-08 21:47:07 +00:00
Zach Nussbaum	2827693a57	fix: smaller bs for 40gb	2023-04-08 21:36:20 +00:00
Zach Nussbaum	5de765410a	fix: add wd + min lr to config	2023-04-08 20:37:51 +00:00
Zach Nussbaum	df29c62521	fix: config + ignore pkl	2023-04-08 20:33:02 +00:00
zanussbaum	fbb788e451	feat: lora gptj	2023-04-07 17:53:07 -04:00
zanussbaum	dcc5204352	fix: batch size	2023-04-07 17:41:45 -04:00
zanussbaum	aa8dd7a636	feat: update for mosaic	2023-04-07 16:54:29 -04:00
Zach	c2fc164779	fix: configs	2023-04-05 20:42:35 +00:00
Zach Nussbaum	98ceac34e1	fix: gptj multinode	2023-04-05 02:52:44 +00:00
Zach Nussbaum	c68311810a	fix: clean up data, pad at end	2023-04-04 20:53:23 +00:00
Zach Nussbaum	ab4b13b2fa	Update finetune_lora.yaml	2023-03-28 20:58:33 -07:00
Zach Nussbaum	b0fd406ebb	Update finetune.yaml	2023-03-28 20:58:03 -07:00
Zach Nussbaum	ed08006053	feat: lora config	2023-03-27 17:33:13 +00:00
Zach Nussbaum	80227dc164	feat: full model config	2023-03-27 17:30:57 +00:00
Zach Nussbaum	2daecd6066	feat: update embeddings	2023-03-26 17:45:21 +00:00
Zach Nussbaum	723a50bdf1	feat: train and clean data	2023-03-25 16:17:48 +00:00