Hugging Face's logo

qgallouedec
/
online-dpo-qwen2-2

Text Generation
Transformers
Safetensors
PEFT
qwen2
trl
online-dpo
Generated from Trainer
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
Edit model card

Model Card for online-dpo-qwen2-2

This model is a fine-tuned version of Qwen/Qwen2-0.5B-Instruct on the https://huggingface.co/datasets/trl-lib/ultrafeedback-prompt dataset.

Downloads last month
85
Safetensors
Model size
494M params
Tensor type
F32
·
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.