Hugging Face's logo

sfulay
/
zephyr-7b-dpo-full-magpi-reward-scale-1

Safetensors
mistral
trl
dpo
alignment-handbook
Generated from Trainer
Model card Files Community
sfulay commited on
Commit
34aed1b
•
1 Parent(s): 4748676

Training in progress, step 352

Browse files
Files changed (3) hide show
  1. model-00001-of-00003.safetensors +1 -1
  2. model-00002-of-00003.safetensors +1 -1
  3. model-00003-of-00003.safetensors +1 -1
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bbb5725a0592c863c999f15b037b88077b5d7d79de3af600777823a19fbb519b
3
  size 4943162336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9dcaf4dc0c0b909976aa056b81e0a2b319bd4cc0fbe64b4ad6e3bff5b5e9e4a8
3
  size 4943162336
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0d32c7f275c8aa9c963cbeb9f6d60e8658e01e4ec092e7dc9f42b33d70c6be07
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c30155721a38abfe4d3230f2893721359f0c129fc60a0d96725ac39198147de8
3
  size 4999819336
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fcf52ffc7d0458ab9ca8e7a52f3ea939a4707d3f645aac5c19d6ac79e7bbdf34
3
  size 4540516344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8a1a9bbcf8a17b2d6d5785f3df9d8faf5023eb273d7fae9702a0c719f089c4ac
3
  size 4540516344