omarmomen
/

transformer_base_final_2

Model card Files Files and versions Community

omarmomen commited on Mar 26

Commit

4872ef1

•

1 Parent(s): 36d776c

Update README.md

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -15,4 +15,6 @@ The paper titled "Increasing The Performance of Cognitively Inspired Data-Effici
 <strong>omarmomen/transformer_base_final_2</strong> is a baseline vanilla transformer encoder.
-The model is pretrained on the BabyLM 10M dataset using a custom pretrained RobertaTokenizer (https://huggingface.co/omarmomen/babylm_tokenizer_32k).

 <strong>omarmomen/transformer_base_final_2</strong> is a baseline vanilla transformer encoder.
+The model is pretrained on the BabyLM 10M dataset using a custom pretrained RobertaTokenizer (https://huggingface.co/omarmomen/babylm_tokenizer_32k).
+https://arxiv.org/abs/2310.20589