Data shuffled only at the document-level

BabyLM Sequence Length
community
AI & ML interests
BabyLM 2025 paper submission
Recent Activity
View all activity
models
1
datasets
18
babylm-seqlen/train_100M_64
Viewer
•
Updated
•
2.56M
•
43
babylm-seqlen/train_100M_512_single_shuffle
Viewer
•
Updated
•
319k
•
37
babylm-seqlen/train_100M_8192_single_shuffle
Viewer
•
Updated
•
19.8k
•
31
babylm-seqlen/train_100M_2048_single_shuffle
Viewer
•
Updated
•
79.8k
•
35
babylm-seqlen/train_100M_16384_single_shuffle
Viewer
•
Updated
•
9.86k
•
35
babylm-seqlen/train_100M_4096_single_shuffle
Viewer
•
Updated
•
39.8k
•
32
babylm-seqlen/train_100M_256_single_shuffle
Viewer
•
Updated
•
639k
•
40
babylm-seqlen/train_100M_1024_single_shuffle
Viewer
•
Updated
•
160k
•
37
babylm-seqlen/train_100M_128_single_shuffle
Viewer
•
Updated
•
1.28M
•
45
babylm-seqlen/train_100M_64_single_shuffle
Viewer
•
Updated
•
2.56M
•
35