instruction-pretrain's picture

instruction-pretrain

instruction-pretrain

·

https://huggingface.co/papers/2406.14491

DaixuanC45443

AI & ML interests

Synthetic Instructions for Pre-Training

Recent Activity

updated a model about 1 month ago

instruction-pretrain/instruction-synthesizer

upvoted a paper about 1 month ago

How to Synthesize Text Data without Model Collapse?

updated a model about 2 months ago

instruction-pretrain/instruction-synthesizer

View all activity

Organizations

None yet

models 5

instruction-pretrain/instruction-synthesizer

Text Generation • Updated Dec 21, 2024 • 217 • 77

instruction-pretrain/InstructLM-500M

Text Generation • Updated Dec 2, 2024 • 201 • 34

instruction-pretrain/medicine-Llama3-8B

Text Generation • Updated Dec 2, 2024 • 217 • 37

instruction-pretrain/InstructLM-1.3B

Text Generation • Updated Dec 2, 2024 • 40 • 42

instruction-pretrain/finance-Llama3-8B

Text Generation • Updated Dec 2, 2024 • 1.06k • 57

datasets 3

instruction-pretrain/general-instruction-augmented-corpora

Preview • Updated Dec 2, 2024 • 2.96k • 16

instruction-pretrain/medicine-instruction-augmented-corpora

Preview • Updated Dec 2, 2024 • 280 • 12

instruction-pretrain/ft-instruction-synthesizer-collection

Viewer • Updated Dec 2, 2024 • 249k • 1.39k • 60