Hugging Face's logo

sfulay
/
zephyr-7b-dpo-full-prometheus_consistent-reward-scale-1-rpo

Safetensors
mistral
trl
dpo
alignment-handbook
Generated from Trainer
Model card Files Community
sfulay commited on
Commit
0a89baf
·
verified ·
1 Parent(s): f947fdc

Training in progress, step 300

Browse files
Files changed (3) hide show
  1. model-00001-of-00003.safetensors +1 -1
  2. model-00002-of-00003.safetensors +1 -1
  3. model-00003-of-00003.safetensors +1 -1
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dbd93bd67aae0464ad159a75930213ec09cbe28dafdab8e7386610649b1ea080
3
  size 4943162336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8d38d3ab98128928341ce317c377f4b1fbf81b625c33e8f294d4299f8bd5271b
3
  size 4943162336
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:717fafb13736d44da658b39519b915c02c7e04a2420a81a0376f35580aeaebe9
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dd1217eb3a3aecc51fd5834d332a6f77eb4798c405d7c5d12d2e1d8bb1bfc06f
3
  size 4999819336
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:692d6b7cd69d0b00342eba598cc13dcac1a1c840f4fe376a6bab5b4ea43dbf55
3
  size 4540516344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ce487deb86037d46be122e3422fe79e8723598aadd19027e49125d0c8fdf72bd
3
  size 4540516344