Hugging Face's logo

sfulay
/
zephyr-7b-dpo-full-prometheus_consistent-reward-scale-1-rpo

Safetensors
mistral
trl
dpo
alignment-handbook
Generated from Trainer
Model card Files Community
sfulay commited on
Commit
458b6c5
·
verified ·
1 Parent(s): 0a89baf

Training in progress, step 400

Browse files
Files changed (3) hide show
  1. model-00001-of-00003.safetensors +1 -1
  2. model-00002-of-00003.safetensors +1 -1
  3. model-00003-of-00003.safetensors +1 -1
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8d38d3ab98128928341ce317c377f4b1fbf81b625c33e8f294d4299f8bd5271b
3
  size 4943162336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d93991a56be6c3ccbbf833c0473b57059fffc079c7b2e72353fcbca995b9ae09
3
  size 4943162336
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dd1217eb3a3aecc51fd5834d332a6f77eb4798c405d7c5d12d2e1d8bb1bfc06f
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0be3e23405f48c20587c8a0bb9d9b1dd3839ff30064f10dd2ae6b342ed420e2f
3
  size 4999819336
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ce487deb86037d46be122e3422fe79e8723598aadd19027e49125d0c8fdf72bd
3
  size 4540516344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:daac7eb4018866a9722faca5e74a0e8924f50374e2b25d8ae6a76ad2b03703d6
3
  size 4540516344