Update README.md
Browse files
README.md
CHANGED
|
@@ -3,8 +3,8 @@ language:
|
|
| 3 |
- ru
|
| 4 |
- en
|
| 5 |
---
|
| 6 |
-
This is a
|
| 7 |
-
We fine-tuned it on a dataset of Russian books. For a detailed information check out our post on Habr.
|
| 8 |
|
| 9 |
Model attributes:
|
| 10 |
|
|
|
|
| 3 |
- ru
|
| 4 |
- en
|
| 5 |
---
|
| 6 |
+
This is a tiny Longformer model designed for Russian language. It was initialized from [cointegrated/rubert-tiny2](https://huggingface.co/cointegrated/rubert-tiny2) weights and has been modified to support a context length of up to 16384 tokens.
|
| 7 |
+
We fine-tuned it on a dataset of Russian books, news, wiki and habr, however it still undrestands English, thanks to the source model. For a detailed information check out our post on Habr.
|
| 8 |
|
| 9 |
Model attributes:
|
| 10 |
|