Commit Graph

26 Commits

Author SHA1 Message Date
Andriy Mulyar
cd1f1fe1f4
Update README.md 2023-03-28 14:38:33 -04:00
Andriy Mulyar
3f08bf6727
Updated README.md 2023-03-28 12:35:39 -04:00
Zach Nussbaum
c4f96d9bec feat: training log 2023-03-28 02:49:03 +00:00
Zach Nussbaum
ed08006053 feat: lora config 2023-03-27 17:33:13 +00:00
Zach Nussbaum
80227dc164 feat: full model config 2023-03-27 17:30:57 +00:00
Zach Nussbaum
1a95f68494 fix: just read from watermark file 2023-03-27 17:30:44 +00:00
Zach Nussbaum
b369e5a30f fix: naming 2023-03-27 17:30:33 +00:00
Zach Nussbaum
b24ca03dc4 fix: append first_epoch 2023-03-27 17:30:24 +00:00
Zach Nussbaum
8e22a7276f chore: gitignore 2023-03-27 16:33:00 +00:00
Zach Nussbaum
24765a1965 fix: add epoch train 2023-03-27 16:32:35 +00:00
Zach Nussbaum
bb28929305 fix: eos conditional, watermark 2023-03-27 16:29:43 +00:00
Zach Nussbaum
10db136a88 fix: clean, print num rows 2023-03-27 16:27:11 +00:00
Zach Nussbaum
dfee6963a1 fix: don't rewrite clean file if exists! 2023-03-26 18:15:22 +00:00
Zach Nussbaum
eac7734cbf fix: add eos 2023-03-26 17:45:31 +00:00
Zach Nussbaum
2daecd6066 feat: update embeddings 2023-03-26 17:45:21 +00:00
Zach Nussbaum
2ac939529d fix: update to how to train 2023-03-25 21:57:01 +00:00
Zach Nussbaum
134d566b79 feat: base llama 2023-03-25 21:45:58 +00:00
Zach Nussbaum
147260097b fix: don't print token ids of output 2023-03-25 17:18:07 +00:00
Zach Nussbaum
cb43f53f7a fix: map eos,bos hopefully stops 2023-03-25 17:16:22 +00:00
Zach Nussbaum
f51c5c8109 fix: cutoff prompt correctly 2023-03-25 16:48:05 +00:00
Zach Nussbaum
b6e3ba07c4 feat: generation works 2023-03-25 16:43:27 +00:00
Zach Nussbaum
897d818cdb feat: peft submodule 2023-03-25 16:23:14 +00:00
Zach Nussbaum
723a50bdf1 feat: train and clean data 2023-03-25 16:17:48 +00:00
Zach Nussbaum
2568d94e50 feat: env for conda, pip 2023-03-25 16:16:40 +00:00
Zach Nussbaum
e8d5ad9fc2 feat: transformers submodule, gitignore 2023-03-25 16:16:11 +00:00
Ubuntu
4f5c513e71 first commit 2023-03-25 16:05:45 +00:00