yhavinga
/

gpt-neo-1.3B-dutch

Text Generation

Inference Endpoints

Model card Files Files and versions Metrics Training metrics Community

yhavinga commited on Jan 7, 2022

Commit

274fbf6

·

1 Parent(s): 4a6cfc0

Update README

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -30,7 +30,7 @@ Tokenizer:
 Training details:
 * Trained for 70K steps (batch size 64) to ppl 27 on mc4 nl tiny 1 epoch
-* Trained for 420K steps (batch size 16) to ppl 19.0 on mc4 nl full
 * Training continuing
 * Block size: 512
 * Optimizer: adafactor

 Training details:
 * Trained for 70K steps (batch size 64) to ppl 27 on mc4 nl tiny 1 epoch
+* Trained for 620K steps (batch size 16) to ppl 17.5 on mc4 nl full
 * Training continuing
 * Block size: 512
 * Optimizer: adafactor