simarora commited on
Commit
fe69dcb
1 Parent(s): eb13565

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -9,6 +9,8 @@ language:
9
  This model is pretrained as a reference baseline to the Based model provided here: https://huggingface.co/hazyresearch/based-1b-50b
10
  Both checkpoints are pretrained on 50Bn tokens of the Pile in the exact same data order using next token prediction.
11
 
 
 
12
 
13
  ### Model Sources
14
 
@@ -43,3 +45,5 @@ Please consider citing this paper if you use our work:
43
  year={2024}
44
  }
45
  ```
 
 
 
9
  This model is pretrained as a reference baseline to the Based model provided here: https://huggingface.co/hazyresearch/based-1b-50b
10
  Both checkpoints are pretrained on 50Bn tokens of the Pile in the exact same data order using next token prediction.
11
 
12
+ A WandB report for training is here: https://api.wandb.ai/links/hazy-research/ggo9rst2
13
+
14
 
15
  ### Model Sources
16
 
 
45
  year={2024}
46
  }
47
  ```
48
+
49
+ Please reach out to [email protected], [email protected], and [email protected] with questions.