Update README.md
Browse files
README.md
CHANGED
|
@@ -8,9 +8,9 @@ We fine-tuned it on a dataset of Russian books, news, wiki and habr, however it
|
|
| 8 |
|
| 9 |
Model attributes:
|
| 10 |
|
| 11 |
-
-
|
| 12 |
-
-
|
| 13 |
-
-
|
| 14 |
|
| 15 |
The model can be used as-is to produce text embeddings or it can be further fine-tuned for a specific downstream task.
|
| 16 |
|
|
|
|
| 8 |
|
| 9 |
Model attributes:
|
| 10 |
|
| 11 |
+
- 12 attention heads
|
| 12 |
+
- 3 hidden layers
|
| 13 |
+
- 16384 tokens length of context
|
| 14 |
|
| 15 |
The model can be used as-is to produce text embeddings or it can be further fine-tuned for a specific downstream task.
|
| 16 |
|