Merge pull request #96 from eltociear/patch-1

Fix typo in TRAINING_LOG.md
1 year ago · 8e7ce1f7c7
parent 9ac9de7e0a 5556de9152
commit 8e7ce1f7c7
1 changed files with 1 additions and 1 deletions
--- a/TRAINING_LOG.md
+++ b/TRAINING_LOG.md
@ -160,7 +160,7 @@ We realized that we had two bugs however:
 - We accidentally duplicated data and effectively trained for 2 epochs instead of 1
 - We added an eos token to every sequence, even those that we truncated (e.g. long code that exceeds the 1024).

-## Conditonal EOS and 1 Epoch
+## Conditional EOS and 1 Epoch

 Using the same parameters, we then trained a model using a "conditional" eos token where we only add an `eos` when the inputs are less than the maximum sequence length for one epoch.