Commit
•
49d37a6
1
Parent(s):
9184c98
Update README.md
Browse filesadded full results
README.md
CHANGED
|
@@ -1,6 +1,6 @@
|
|
| 1 |
gpt2-turkish-wiki
|
| 2 |
|
| 3 |
-
Current version is demo only with
|
| 4 |
|
| 5 |
Using modified https://github.com/piegu/fastai-projects/blob/master/finetuning-English-GPT2-any-language-Portuguese-HuggingFace-fastaiv2_FAST.ipynb
|
| 6 |
|
|
@@ -11,5 +11,9 @@ Epoch train_loss valid_loss accuracy perplexity time
|
|
| 11 |
1 4.264910 5.344171 0.267870 209.384140 02:54
|
| 12 |
|
| 13 |
|
| 14 |
-
TODO: Total turkish wikipedia text is
|
|
|
|
|
|
|
|
|
|
|
|
|
| 15 |
|
|
|
|
| 1 |
gpt2-turkish-wiki
|
| 2 |
|
| 3 |
+
Current version is demo only with some trained wikipedia text in Turkish.
|
| 4 |
|
| 5 |
Using modified https://github.com/piegu/fastai-projects/blob/master/finetuning-English-GPT2-any-language-Portuguese-HuggingFace-fastaiv2_FAST.ipynb
|
| 6 |
|
|
|
|
| 11 |
1 4.264910 5.344171 0.267870 209.384140 02:54
|
| 12 |
|
| 13 |
|
| 14 |
+
TODO: Total turkish wikipedia text is 3 GB xml file
|
| 15 |
+
|
| 16 |
+
1 epoch training on full wikipedia turkish gave some good results, will update here when have full model
|
| 17 |
+
epoch train_loss valid_loss accuracy perplexity time
|
| 18 |
+
0 3.948997 4.001249 0.330571 54.666405 2:41:54
|
| 19 |
|