41 Commits

Author	SHA1	Message	Date
Zach Nussbaum	60155de2a6	chore: peft	2023-04-12 03:50:54 +00:00
Zach Nussbaum	3c11e68ec8	feat: commits for eval + generation	2023-04-11 19:14:29 +00:00
Zach	8733576664	feat: evals on new gptj models	2023-04-10 02:14:20 +00:00
Zach Nussbaum	c11ea7dc31	fix: bs try one more time?	2023-04-08 21:47:07 +00:00
Zach Nussbaum	2827693a57	fix: smaller bs for 40gb	2023-04-08 21:36:20 +00:00
Zach Nussbaum	f5ca8bedcf	fix: config for lora gptj	2023-04-08 21:17:12 +00:00
Zach Nussbaum	5de765410a	fix: add wd + min lr to config	2023-04-08 20:37:51 +00:00
Zach Nussbaum	df29c62521	fix: config + ignore pkl	2023-04-08 20:33:02 +00:00
zanussbaum	fbb788e451	feat: lora gptj	2023-04-07 17:53:07 -04:00
zanussbaum	dcc5204352	fix: batch size	2023-04-07 17:41:45 -04:00
zanussbaum	aa8dd7a636	feat: update for mosaic	2023-04-07 16:54:29 -04:00
Zach	3f9fea47d7	feat: inference for embedding plots	2023-04-07 01:40:39 +00:00
Zach	c2fc164779	fix: configs	2023-04-05 20:42:35 +00:00
Zach Nussbaum	98ceac34e1	fix: gptj multinode	2023-04-05 02:52:44 +00:00
Zach Nussbaum	63ff39653d	feat: gpt-j config	2023-04-04 20:58:08 +00:00
Zach Nussbaum	c68311810a	fix: clean up data, pad at end	2023-04-04 20:53:23 +00:00
Zach Nussbaum	e220c2f6c8	Update generate_large_2.yaml	2023-03-28 21:03:10 -07:00
Zach Nussbaum	870bd36e27	Update generate_large_3.yaml	2023-03-28 21:02:58 -07:00
Zach Nussbaum	382f35480a	Update generate_full.yaml	2023-03-28 21:02:32 -07:00
Zach Nussbaum	6c418d263d	Update generate_baseline.yaml	2023-03-28 21:00:57 -07:00
Zach Nussbaum	5a96e50eec	Update generate.yaml	2023-03-28 21:00:36 -07:00
Zach Nussbaum	ab4b13b2fa	Update finetune_lora.yaml	2023-03-28 20:58:33 -07:00
Zach Nussbaum	b0fd406ebb	Update finetune.yaml	2023-03-28 20:58:03 -07:00
Zach Nussbaum	9c27e46c10	Update generate.yaml	2023-03-28 13:59:26 -07:00
bstadt	a44a98f445	Merge branch 'main' of https://github.com/nomic-ai/gpt4all into main	2023-03-28 20:23:42 +00:00
bstadt	37cc5c8c39	updated eval	2023-03-28 20:22:48 +00:00
Zach Nussbaum	b8808927bf	Update generate_llama.yaml ... fix: paths	2023-03-28 13:08:56 -07:00
Zach Nussbaum	c48d7290c6	Update generate.yaml ... update paths	2023-03-28 13:08:29 -07:00
bstadt	6d98aef302	added eval code	2023-03-28 18:47:38 +00:00
bstadt	4e8e7e7300	metrics run on configs now	2023-03-28 00:09:47 +00:00
bstadt	d5769d7614	removed swp	2023-03-27 22:00:09 +00:00
bstadt	444871189d	added eval configs	2023-03-27 21:59:40 +00:00
bstadt	b48a52d934	started eval script and added eval data	2023-03-27 21:50:08 +00:00
Zach Nussbaum	29cb9d700a	Merge branch 'train' of github.com:nomic-ai/gpt4all into train	2023-03-27 17:39:39 +00:00
Zach Nussbaum	f2e122ff82	fix: add prompt	2023-03-27 17:39:29 +00:00
Zach Nussbaum	ed08006053	feat: lora config	2023-03-27 17:33:13 +00:00
Zach Nussbaum	80227dc164	feat: full model config	2023-03-27 17:30:57 +00:00
Zach Nussbaum	2daecd6066	feat: update embeddings	2023-03-26 17:45:21 +00:00
Zach Nussbaum	134d566b79	feat: base llama	2023-03-25 21:45:58 +00:00
Zach Nussbaum	b6e3ba07c4	feat: generation works	2023-03-25 16:43:27 +00:00
Zach Nussbaum	723a50bdf1	feat: train and clean data	2023-03-25 16:17:48 +00:00