770 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Zach Nussbaum	b369e5a30f	fix: naming	2023-03-27 17:30:33 +00:00
Zach Nussbaum	b24ca03dc4	fix: append first_epoch	2023-03-27 17:30:24 +00:00
Zach Nussbaum	8e22a7276f	chore: gitignore	2023-03-27 16:33:00 +00:00
Zach Nussbaum	24765a1965	fix: add epoch train	2023-03-27 16:32:35 +00:00
Zach Nussbaum	bb28929305	fix: eos conditional, watermark	2023-03-27 16:29:43 +00:00
Zach Nussbaum	10db136a88	fix: clean, print num rows	2023-03-27 16:27:11 +00:00
Zach Nussbaum	dfee6963a1	fix: don't rewrite clean file if exists!	2023-03-26 18:15:22 +00:00
Zach Nussbaum	eac7734cbf	fix: add eos	2023-03-26 17:45:31 +00:00
Zach Nussbaum	2daecd6066	feat: update embeddings	2023-03-26 17:45:21 +00:00
Zach Nussbaum	2ac939529d	fix: update to how to train	2023-03-25 21:57:01 +00:00
Zach Nussbaum	134d566b79	feat: base llama	2023-03-25 21:45:58 +00:00
Zach Nussbaum	147260097b	fix: don't print token ids of output	2023-03-25 17:18:07 +00:00
Zach Nussbaum	cb43f53f7a	fix: map eos,bos hopefully stops	2023-03-25 17:16:22 +00:00
Zach Nussbaum	f51c5c8109	fix: cutoff prompt correctly	2023-03-25 16:48:05 +00:00
Zach Nussbaum	b6e3ba07c4	feat: generation works	2023-03-25 16:43:27 +00:00
Zach Nussbaum	897d818cdb	feat: peft submodule	2023-03-25 16:23:14 +00:00
Zach Nussbaum	723a50bdf1	feat: train and clean data	2023-03-25 16:17:48 +00:00
Zach Nussbaum	2568d94e50	feat: env for conda, pip	2023-03-25 16:16:40 +00:00
Zach Nussbaum	e8d5ad9fc2	feat: transformers submodule, gitignore	2023-03-25 16:16:11 +00:00
Ubuntu	4f5c513e71	first commit	2023-03-25 16:05:45 +00:00