Arman Jukic's picture

2 24

Arman Jukic

Jukka-Sun

·

Jukka-Sun

AI & ML interests

AI, machinelearning, deep-learning, comuter-vision, programming

Recent Activity

liked a model 10 days ago

mlx-community/UI-TARS-7B-DPO-8bit

liked a model 10 days ago

Wan-AI/Wan2.1-T2V-14B

reacted to Jaward's post with ❤️ 12 days ago

made a few improvements on custom grpo trainer: - added sequence similarity reward (seems to work) - improved vllm support (5x inference speed) - adjusted reward scores (this helped with format/accuracy) - can now push to hf hub (already pushed mine lol: https://huggingface.co/Jaward/smollm2_360m_grpo_gsm8k_reasoner) Code: https://github.com/Jaykef/ai-algorithms/blob/main/smollm2_360M_135M_grpo_gsm8k.ipynb

View all activity

Organizations

None yet

Collections 1

models

None public yet

datasets

None public yet