Hugging Face's logo

allenai
/
OLMo-2-1124-7B

Safetensors
English
olmo2
Model card Files Community
8
amanrangapur commited on
Commit
627e96b
·
verified ·
1 Parent(s): ce9680f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -24,8 +24,8 @@ We release all code, checkpoints, logs (coming soon), and details involved in tr
24
  The core models released in this batch are the following:
25
  | Size | Training Tokens | Layers | Hidden Size | Attention Heads | Context Length |
26
  |------|--------|---------|-------------|-----------------|----------------|
27
- | [OLMo2-7B July 2024](https://huggingface.co/allenai/OLMo-7B-0724-hf) | 4 Trillion | 32 | 4096 | 32 | 4096 |
28
- | [OLMo2- 13B July 2024](https://huggingface.co/allenai/OLMo-1B-0724-hf) | 5 Trillion | 42 | 5120 | 16 | 4096 |
29
 
30
  We have released checkpoints for these models, for every 1000 training steps.
31
  The naming convention is `stepXXX-tokensYYYB`.
 
24
  The core models released in this batch are the following:
25
  | Size | Training Tokens | Layers | Hidden Size | Attention Heads | Context Length |
26
  |------|--------|---------|-------------|-----------------|----------------|
27
+ | [OLMo2-7B July 2024](https://huggingface.co/allenai/OLMo2-7B-1124) | 4 Trillion | 32 | 4096 | 32 | 4096 |
28
+ | [OLMo2- 13B July 2024](https://huggingface.co/allenai/OLMo2-13B-1124) | 5 Trillion | 40 | 5120 | 42 | 4096 |
29
 
30
  We have released checkpoints for these models, for every 1000 training steps.
31
  The naming convention is `stepXXX-tokensYYYB`.