justus27 commited on
Commit
60740e3
·
verified ·
1 Parent(s): 2a63ca2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -3
README.md CHANGED
@@ -1,3 +1,16 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ ---
4
+
5
+ # INTELLECT-MATH: State-of-the-Art Mathematical Reasoning through Better Initializations for Reinforcement Learning
6
+
7
+ INTELLECT-MATH is a 7B parameter model optimized for mathematical reasoning. It was trained in two stages, an SFT stage, in which the model was fine-tuned on verified QwQ outputs, and an RL stage, in which the model was trained using the [PRIME-RL](https://github.com/PRIME-RL/PRIME) recipe.
8
+
9
+ We demonstrate that the quality of our SFT data can impact the performance and training speed of the RL stage: Due to its better synthetic SFT dataset that encourages the model to imitate the reasoning behavior of a strong teacher model, INTELLECT-MATH outperforms Eurus-2-PRIME, the previous state-of-the-art trained with PRIME-RL, and matches its performance with 10x faster training.
10
+
11
+
12
+ ### Links
13
+
14
+ - 📜 [Blog Post]()
15
+ - 🔗 [Github]()
16
+ - 🤗 [Hugging Face Collection]()