930 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
bstadt	4e8e7e7300	metrics run on configs now	2023-03-28 00:09:47 +00:00
bstadt	d5769d7614	removed swp	2023-03-27 22:00:09 +00:00
bstadt	444871189d	added eval configs	2023-03-27 21:59:40 +00:00
bstadt	b48a52d934	started eval script and added eval data	2023-03-27 21:50:08 +00:00
Zach Nussbaum	29cb9d700a	Merge branch 'train' of github.com:nomic-ai/gpt4all into train	2023-03-27 17:39:39 +00:00
Zach Nussbaum	f2e122ff82	fix: add prompt	2023-03-27 17:39:29 +00:00
Zach Nussbaum	d87af69a93	fix: add tokens	2023-03-27 17:39:20 +00:00
Zach Nussbaum	ed08006053	feat: lora config	2023-03-27 17:33:13 +00:00
Zach Nussbaum	80227dc164	feat: full model config	2023-03-27 17:30:57 +00:00
Zach Nussbaum	1a95f68494	fix: just read from watermark file	2023-03-27 17:30:44 +00:00
Zach Nussbaum	b369e5a30f	fix: naming	2023-03-27 17:30:33 +00:00
Zach Nussbaum	b24ca03dc4	fix: append first_epoch	2023-03-27 17:30:24 +00:00
Zach Nussbaum	8e22a7276f	chore: gitignore	2023-03-27 16:33:00 +00:00
Zach Nussbaum	24765a1965	fix: add epoch train	2023-03-27 16:32:35 +00:00
Zach Nussbaum	bb28929305	fix: eos conditional, watermark	2023-03-27 16:29:43 +00:00
Zach Nussbaum	10db136a88	fix: clean, print num rows	2023-03-27 16:27:11 +00:00
Zach Nussbaum	dfee6963a1	fix: don't rewrite clean file if exists!	2023-03-26 18:15:22 +00:00
Zach Nussbaum	eac7734cbf	fix: add eos	2023-03-26 17:45:31 +00:00
Zach Nussbaum	2daecd6066	feat: update embeddings	2023-03-26 17:45:21 +00:00
Zach Nussbaum	2ac939529d	fix: update to how to train	2023-03-25 21:57:01 +00:00
Zach Nussbaum	134d566b79	feat: base llama	2023-03-25 21:45:58 +00:00
Zach Nussbaum	147260097b	fix: don't print token ids of output	2023-03-25 17:18:07 +00:00
Zach Nussbaum	cb43f53f7a	fix: map eos,bos hopefully stops	2023-03-25 17:16:22 +00:00
Zach Nussbaum	f51c5c8109	fix: cutoff prompt correctly	2023-03-25 16:48:05 +00:00
Zach Nussbaum	b6e3ba07c4	feat: generation works	2023-03-25 16:43:27 +00:00
Zach Nussbaum	897d818cdb	feat: peft submodule	2023-03-25 16:23:14 +00:00
Zach Nussbaum	723a50bdf1	feat: train and clean data	2023-03-25 16:17:48 +00:00
Zach Nussbaum	2568d94e50	feat: env for conda, pip	2023-03-25 16:16:40 +00:00
Zach Nussbaum	e8d5ad9fc2	feat: transformers submodule, gitignore	2023-03-25 16:16:11 +00:00
Ubuntu	4f5c513e71	first commit	2023-03-25 16:05:45 +00:00