Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
EllieS
/
zephyr-7b-dpo-lora-ultrafeedback
like
0
PEFT
TensorBoard
Safetensors
HuggingFaceH4/ultrafeedback_binarized
mistral
alignment-handbook
Generated from Trainer
trl
dpo
License:
apache-2.0
Model card
Files
Files and versions
Metrics
Training metrics
Community
Train
Use this model
c497384
zephyr-7b-dpo-lora-ultrafeedback
Commit History
Training in progress, step 1000
c497384
verified
EllieS
commited on
Jan 15
Training in progress, step 500
d952c6f
verified
EllieS
commited on
Jan 15
initial commit
9bcf76d
verified
EllieS
commited on
Jan 15