|
--- |
|
license: apache-2.0 |
|
language: |
|
- nb |
|
- nn |
|
- 'no' |
|
- se |
|
- sv |
|
- da |
|
- en |
|
- is |
|
- fo |
|
base_model: |
|
- mistralai/Mistral-Nemo-Base-2407 |
|
library_name: transformers |
|
--- |
|
|
|
![](puffin.png) |
|
|
|
NorMistral-11b-warm is a large Norwegian language model initialized from [Mistral-Nemo-Base-2407](https://huggingface.co/mistralai/Mistral-Nemo-Base-2407) and |
|
continuously pretrained on a total of 260 billion subword tokens -- using a mix of Scandinavian, Sámi, English and code data (four repetitions of open Norwegian texts). |