Hugging Face's logo

sfulay
/
zephyr-7b-dpo-full-magpi-reward-scale-1

Safetensors
mistral
trl
dpo
alignment-handbook
Generated from Trainer
Model card Files Community
sfulay commited on
Commit
4748676
·
verified ·
1 Parent(s): 7165d2a

Training in progress, step 300

Browse files
Files changed (3) hide show
  1. model-00001-of-00003.safetensors +1 -1
  2. model-00002-of-00003.safetensors +1 -1
  3. model-00003-of-00003.safetensors +1 -1
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7943966855b1b97051ae2fe536f9db9665d7d3d38291059a66d9d7d79fc7a1df
3
  size 4943162336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bbb5725a0592c863c999f15b037b88077b5d7d79de3af600777823a19fbb519b
3
  size 4943162336
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a81096b2408cc188999dff821ed05465a67b7ce884a434e258ead6941e0d0840
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d32c7f275c8aa9c963cbeb9f6d60e8658e01e4ec092e7dc9f42b33d70c6be07
3
  size 4999819336
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:97700e43e181181c0763f9817df155bb6fa664ccfc763ce4c6009d229fbe9169
3
  size 4540516344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fcf52ffc7d0458ab9ca8e7a52f3ea939a4707d3f645aac5c19d6ac79e7bbdf34
3
  size 4540516344