Wan-AI/Wan2.1-T2V-14B
Text-to-Video
•
Updated
•
271
Kristaller486
kristaller486
AI & ML interests
NLP, Machine Translation
Recent Activity
liked
a model
about 2 hours ago
Wan-AI/Wan2.1-T2V-14B
liked
a model
about 2 hours ago
Wan-AI/Wan2.1-T2V-1.3B
liked
a model
about 19 hours ago
slprl/slam
Organizations
kristaller486's activity
liked
2
models
about 2 hours ago
liked
a
model
about 19 hours ago
upvoted
a
collection
about 19 hours ago
liked
a
dataset
5 days ago
upvoted
a
collection
7 days ago
liked
2
models
7 days ago
liked
a
dataset
7 days ago
liked
a
dataset
9 days ago
liked
a
model
9 days ago
liked
a
dataset
12 days ago
updated
a
dataset
13 days ago
liked
a
model
13 days ago
upvoted
a
paper
15 days ago
liked
a
model
16 days ago
reacted to
s-emanuilov's
post with 🔥
17 days ago
Post
5158
Tutorial 💥 Training a non-English reasoning model with GRPO and Unsloth
I wanted to share my experiment with training reasoning models in languages other than English/Chinese.
Using Llama 3.1 8B as base, GRPO trainer from trl, and Unsloth optimizations, I got a working prototype in Bulgarian after ~5 hours on an L40S GPU. The approach should work for any language where the base model has some pre-training coverage.
Full code and tutorial here: https://unfoldai.com/reasoning-in-a-non-english-language/
The model itself: s-emanuilov/LLMBG-Llama-3.1-8B-BG-Reasoning-v0.1
I hope this helps anyone looking to build reasoning models in their language.
I wanted to share my experiment with training reasoning models in languages other than English/Chinese.
Using Llama 3.1 8B as base, GRPO trainer from trl, and Unsloth optimizations, I got a working prototype in Bulgarian after ~5 hours on an L40S GPU. The approach should work for any language where the base model has some pre-training coverage.
Full code and tutorial here: https://unfoldai.com/reasoning-in-a-non-english-language/
The model itself: s-emanuilov/LLMBG-Llama-3.1-8B-BG-Reasoning-v0.1
I hope this helps anyone looking to build reasoning models in their language.
- 4 replies
liked
2
models
17 days ago
published
a
dataset
17 days ago