Yura Kuratov
commited on
Commit
·
0ab0089
1
Parent(s):
93e5b6f
upload model with MLM and NSP heads
Browse files- README.md +1 -0
- flax_model.msgpack +2 -2
- pytorch_model.bin +2 -2
README.md
CHANGED
|
@@ -10,5 +10,6 @@ language:
|
|
| 10 |
|
| 11 |
SlavicBERT\[1\] \(Slavic \(bg, cs, pl, ru\), cased, 12‑layer, 768‑hidden, 12‑heads, 180M parameters\) was trained on Russian News and four Wikipedias: Bulgarian, Czech, Polish, and Russian. Subtoken vocabulary was built using this data. Multilingual BERT was used as an initialization for SlavicBERT.
|
| 12 |
|
|
|
|
| 13 |
|
| 14 |
\[1\]: Arkhipov M., Trofimova M., Kuratov Y., Sorokin A. \(2019\). [Tuning Multilingual Transformers for Language-Specific Named Entity Recognition](https://www.aclweb.org/anthology/W19-3712/). ACL anthology W19-3712.
|
|
|
|
| 10 |
|
| 11 |
SlavicBERT\[1\] \(Slavic \(bg, cs, pl, ru\), cased, 12‑layer, 768‑hidden, 12‑heads, 180M parameters\) was trained on Russian News and four Wikipedias: Bulgarian, Czech, Polish, and Russian. Subtoken vocabulary was built using this data. Multilingual BERT was used as an initialization for SlavicBERT.
|
| 12 |
|
| 13 |
+
08.11.2021: upload model with MLM and NSP heads
|
| 14 |
|
| 15 |
\[1\]: Arkhipov M., Trofimova M., Kuratov Y., Sorokin A. \(2019\). [Tuning Multilingual Transformers for Language-Specific Named Entity Recognition](https://www.aclweb.org/anthology/W19-3712/). ACL anthology W19-3712.
|
flax_model.msgpack
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ea6379bcd277ce6caeaa4ed7d0c3be52156ca4a6fb652da2db1990f096e839ee
|
| 3 |
+
size 714274024
|
pytorch_model.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:15c40226e26541adb2cfffb85258cf0d97480e7bece94393e303b3d4658cf142
|
| 3 |
+
size 714355318
|