Update README.md
Browse files
README.md
CHANGED
@@ -9,6 +9,8 @@ language:
|
|
9 |
This model is pretrained as a reference baseline to the Based model provided here: https://huggingface.co/hazyresearch/based-1b-50b
|
10 |
Both checkpoints are pretrained on 50Bn tokens of the Pile in the exact same data order using next token prediction.
|
11 |
|
|
|
|
|
12 |
|
13 |
### Model Sources
|
14 |
|
@@ -43,3 +45,5 @@ Please consider citing this paper if you use our work:
|
|
43 |
year={2024}
|
44 |
}
|
45 |
```
|
|
|
|
|
|
9 |
This model is pretrained as a reference baseline to the Based model provided here: https://huggingface.co/hazyresearch/based-1b-50b
|
10 |
Both checkpoints are pretrained on 50Bn tokens of the Pile in the exact same data order using next token prediction.
|
11 |
|
12 |
+
A WandB report for training is here: https://api.wandb.ai/links/hazy-research/ggo9rst2
|
13 |
+
|
14 |
|
15 |
### Model Sources
|
16 |
|
|
|
45 |
year={2024}
|
46 |
}
|
47 |
```
|
48 |
+
|
49 |
+
Please reach out to [email protected], [email protected], and [email protected] with questions.
|