O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning
Paper
•
2501.12570
•
Published
•
23
Carlo Moro
cnmoro
AI & ML interests
I like small & fast models
Recent Activity
reacted
to
sometimesanotion's
post
with 🚀
1 day ago
I've felt confident that 14B Qwen finetunes and merges could break the 42.0 average, and Arcee appears to have done exactly that with https://huggingface.co/arcee-ai/Virtuoso-Small-2. Congratulations to @arcee-ai!
Just two months ago, it was easy to think that 14B had plateaued, that you could have high IFEVAL or high MUSR/MATH/GPQA at 14B, but not both. That barrier is completely shattered. I see a pathway to even better, and Virtuoso Small 2 is a big part of why. Very impressive work. This community would expect no less from Arcee.
Just look at this graph! Keep in mind, my merges here build on the first Virtuoso Small, and *-DS merges build on DeepSeek R1. There are some impressive merges in the pipe!
liked
a model
3 days ago
nvidia/Eagle2-1B
updated
a model
4 days ago
cnmoro/granite-question-classifier
Organizations
cnmoro's activity
upvoted
a
paper
11 days ago
upvoted
an
article
19 days ago
Article
Train 400x faster Static Embedding Models with Sentence Transformers
•
132
upvoted
a
collection
2 months ago
upvoted
3
collections
8 months ago
upvoted
a
collection
11 months ago
upvoted
2
collections
about 1 year ago