Hugging Face's logo

sfulay
/
zephyr-7b-dpo-full-prometheus_consistent-reward-scale-1-rpo

Safetensors
mistral
trl
dpo
alignment-handbook
Generated from Trainer
Model card Files Community
sfulay commited on
Commit
f947fdc
·
verified ·
1 Parent(s): d1dca68

Training in progress, step 200

Browse files
Files changed (3) hide show
  1. model-00001-of-00003.safetensors +1 -1
  2. model-00002-of-00003.safetensors +1 -1
  3. model-00003-of-00003.safetensors +1 -1
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1daec9bd6fdd1609619c2c255b030a93020012c0435c882fa3e9203481fdeb23
3
  size 4943162336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dbd93bd67aae0464ad159a75930213ec09cbe28dafdab8e7386610649b1ea080
3
  size 4943162336
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:61f950901437c0dab89432c19cc7ced5b24b26df3eb5d6d8838c21ab426030e7
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:717fafb13736d44da658b39519b915c02c7e04a2420a81a0376f35580aeaebe9
3
  size 4999819336
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5a2ebd166a50bfdc7e364e635589519fbb1588c579ba6ada64992b3c3b240ab6
3
  size 4540516344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:692d6b7cd69d0b00342eba598cc13dcac1a1c840f4fe376a6bab5b4ea43dbf55
3
  size 4540516344