yuzhaouoe/BM25Chunk
Text Generation
•
Updated
•
8
Pre-Trianing Data Packing
[ACL'24] Analysing the Impact of Sequence Composition on Language Model Pre-Training. https://github.com/yuzhaouoe/pretraining-data-packing
-
-
yuzhaouoe/UniChunk
Text Generation • Updated • 9 -
yuzhaouoe/BM25Chunk-2048
Text Generation • Updated • 25 -
yuzhaouoe/MixChunk
Text Generation • Updated • 10 -
yuzhaouoe/IntraDoc
Text Generation • Updated • 19 -
yuzhaouoe/UniChunk-2048
Text Generation • Updated • 27 -
yuzhaouoe/MixChunk-2048
Text Generation • Updated • 27 -
yuzhaouoe/IntraDoc-2048
Text Generation • Updated • 27 -
yuzhaouoe/eval_data
Updated -
Analysing The Impact of Sequence Composition on Language Model Pre-Training
Paper • 2402.13991 • Published • 1