Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
just1nseo
/
zephyr-dpo-qlora-uf-ours-5e-6-epoch1
like
0
PEFT
TensorBoard
Safetensors
generation/UF
mistral
alignment-handbook
trl
dpo
Generated from Trainer
4-bit precision
bitsandbytes
License:
apache-2.0
Model card
Files
Files and versions
Metrics
Training metrics
Community
Train
Use this model
main
zephyr-dpo-qlora-uf-ours-5e-6-epoch1
/
adapter_model.safetensors
Commit History
Model save
3fb2d1c
verified
just1nseo
commited on
Jul 29
Training in progress, step 300
f6c74c2
verified
just1nseo
commited on
Jul 29
Training in progress, step 200
aba3aca
verified
just1nseo
commited on
Jul 29
Training in progress, step 100
87ae7b3
verified
just1nseo
commited on
Jul 29