Spaces:
Running
Running
Update README.md
Browse files
README.md
CHANGED
@@ -7,4 +7,26 @@ sdk: static
|
|
7 |
pinned: false
|
8 |
---
|
9 |
|
10 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
7 |
pinned: false
|
8 |
---
|
9 |
|
10 |
+
# **Introduction**
|
11 |
+
We aim to advance LLM reasoning with autoregressive search capabilities, i.e., a single LLM performs an extended reasoning process with self-reflection and self-exploration of new strategies.
|
12 |
+
We achieve this through our proposed Chain-of-Action-Thought (COAT) reasoning and a new post-training paradigm: 1) a small-scale format tuning (FT) stage to internalize the COAT reasoning format and 2) a large-scale self-improvement
|
13 |
+
stage leveraging reinforcement learning (RL). Our approach results in Satori, a 7B LLM trained on open-source model (Qwen-2.5-Math-7B) and open-source data (OpenMathInstruct-2 and NuminaMath). Key features of Satori include:
|
14 |
+
- Capable of self-reflection and self-exploration without external guidance.
|
15 |
+
- Achieve state-of-the-art reasoning performance mainly through self-improvement (RL).
|
16 |
+
- Exhibit transferability of reasoning capabilities on unseen domains beyond math.
|
17 |
+
|
18 |
+
# **Resources**
|
19 |
+
Please refer to our blog and research paper for more details of Satori.
|
20 |
+
- [Blog](https://satori-reasoning.github.io/blog/satori/)
|
21 |
+
- [Paper](https://satori-reasoning.github.io/blog/satori/)
|
22 |
+
|
23 |
+
# **Citation**
|
24 |
+
If you find our model and data helpful, please consider citing our paper:
|
25 |
+
```
|
26 |
+
@article{TBD,
|
27 |
+
title={Satori: Reinforcement Learning with Chain-of-Action-Thought Enhances LLM Reasoning via Autoregressive Search},
|
28 |
+
author={Maohao Shen and Guangtao Zeng and Zhenting Qi and Zhang-Wei Hong and Zhenfang Chen and Wei Lu and Gregory Wornell and Subhro Das and David Cox and Chuang Gan},
|
29 |
+
journal={arXiv preprint arXiv: TBD},
|
30 |
+
year={2025}
|
31 |
+
}
|
32 |
+
```
|