Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
trl-lib
/
Qwen2-0.5B-ORPO
like
1
Follow
TRL
35
Text Generation
Transformers
Safetensors
trl-lib/ultrafeedback_binarized
qwen2
Generated from Trainer
trl
orpo
conversational
text-generation-inference
Inference Endpoints
arxiv:
2403.07691
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
Qwen2-0.5B-ORPO
1 contributor
History:
2 commits
qgallouedec
HF staff
End of training
5807863
verified
27 days ago
.gitattributes
Safe
1.57 kB
End of training
27 days ago
README.md
Safe
2.23 kB
End of training
27 days ago
added_tokens.json
Safe
80 Bytes
End of training
27 days ago
config.json
Safe
733 Bytes
End of training
27 days ago
generation_config.json
Safe
247 Bytes
End of training
27 days ago
merges.txt
Safe
1.67 MB
End of training
27 days ago
model.safetensors
Safe
1.98 GB
LFS
End of training
27 days ago
special_tokens_map.json
Safe
367 Bytes
End of training
27 days ago
tokenizer.json
Safe
11.4 MB
LFS
End of training
27 days ago
tokenizer_config.json
Safe
1.3 kB
End of training
27 days ago
training_args.bin
Safe
5.56 kB
LFS
End of training
27 days ago
vocab.json
Safe
2.78 MB
End of training
27 days ago