Update README.md
Browse files
README.md
CHANGED
|
@@ -8,7 +8,7 @@ Trained Strategy :
|
|
| 8 |
- Inverse Cloze Task : 16 Epoch, by korquad v 1.0, KLUE MRC dataset
|
| 9 |
- In-batch Negatives : 12 Epoch, by KLUE MRC dataset, random sampling between Sparse Retrieval(TF-IDF) top 100 passage per each query
|
| 10 |
|
| 11 |
-
|
| 12 |
<pre>
|
| 13 |
<code>
|
| 14 |
from Transformers import AutoTokenizer, BertPreTrainedModel, BertModel
|
|
|
|
| 8 |
- Inverse Cloze Task : 16 Epoch, by korquad v 1.0, KLUE MRC dataset
|
| 9 |
- In-batch Negatives : 12 Epoch, by KLUE MRC dataset, random sampling between Sparse Retrieval(TF-IDF) top 100 passage per each query
|
| 10 |
|
| 11 |
+
You must need to use Korean wikipedia corpus
|
| 12 |
<pre>
|
| 13 |
<code>
|
| 14 |
from Transformers import AutoTokenizer, BertPreTrainedModel, BertModel
|