Quentin Gallouédec's picture

Quentin Gallouédec

qgallouedec

AI & ML interests

None yet

Recent Activity

Organizations

Hugging Face's profile picture Stable-Baselines3's profile picture trl internal testing's profile picture Jack of All Trades project's profile picture HuggingFaceM4's profile picture TRL's profile picture Hugging Face H4's profile picture Hugging Face OSS Metrics's profile picture cleanrl's profile picture LeRobot's profile picture Open RL Leaderboard's profile picture Paris AI Running Club's profile picture HF SB3 Test's profile picture PDF2Dataset's profile picture IOPO Experiments's profile picture Hugging Face Science's profile picture HF CMU Collab's profile picture Bluesky Community's profile picture ChaosCraft AI's profile picture Hugging Face Agents Course's profile picture Open R1's profile picture

qgallouedec's activity

upvoted an article 11 days ago
reacted to lewtun's post with 🔥 16 days ago
view post
Post
10138
We are reproducing the full DeepSeek R1 data and training pipeline so everybody can use their recipe. Instead of doing it in secret we can do it together in the open!

🧪 Step 1: replicate the R1-Distill models by distilling a high-quality reasoning corpus from DeepSeek-R1.

🧠 Step 2: replicate the pure RL pipeline that DeepSeek used to create R1-Zero. This will involve curating new, large-scale datasets for math, reasoning, and code.

🔥 Step 3: show we can go from base model -> SFT -> RL via multi-stage training.

Follow along: https://github.com/huggingface/open-r1
·
upvoted an article 19 days ago