Update README.md
Browse files
README.md
CHANGED
|
@@ -63,7 +63,7 @@ Along with the open weights, all training scripts and configuration files are ma
|
|
| 63 |
|
| 64 |
### Description
|
| 65 |
|
| 66 |
-
Transformer-based decoder-only language model that has been pre-trained from scratch on
|
| 67 |
The pre-training corpus contains text in 35 European languages and code.
|
| 68 |
|
| 69 |
### Hyperparameters
|
|
|
|
| 63 |
|
| 64 |
### Description
|
| 65 |
|
| 66 |
+
Transformer-based decoder-only language model that has been pre-trained from scratch on 6.9 trillion tokens of highly curated data.
|
| 67 |
The pre-training corpus contains text in 35 European languages and code.
|
| 68 |
|
| 69 |
### Hyperparameters
|