Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
just1nseo
/
zephyr-dpo-qlora-gpt4-5e-6
like
0
PEFT
TensorBoard
Safetensors
generation/GPT4
mistral
alignment-handbook
trl
dpo
Generated from Trainer
4-bit precision
bitsandbytes
License:
apache-2.0
Model card
Files
Files and versions
Metrics
Training metrics
Community
Train
Use this model
c35d5de
zephyr-dpo-qlora-gpt4-5e-6
Commit History
Model save
c35d5de
verified
just1nseo
commited on
Jul 28
Training in progress, step 300
9620709
verified
just1nseo
commited on
Jul 28
Training in progress, step 200
e5abd4d
verified
just1nseo
commited on
Jul 28
Training in progress, step 100
01fff42
verified
just1nseo
commited on
Jul 28
initial commit
6101a2d
verified
just1nseo
commited on
Jul 28