Hugging Face's logo

sfulay
/
zephyr-7b-dpo-full-gpt_consistent-reward-scale-1

Safetensors
mistral
trl
dpo
Generated from Trainer
Model card Files Community
sfulay commited on
Commit
905b239
•
1 Parent(s): b9f4a21

Training in progress, step 436

Browse files
Files changed (3) hide show
  1. model-00001-of-00003.safetensors +1 -1
  2. model-00002-of-00003.safetensors +1 -1
  3. model-00003-of-00003.safetensors +1 -1
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:45381c62c71e3ea0e51ba71101b9e1b6c6d8e22b6666153d9072e298759a567b
3
  size 4943162336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:21d6a441ece9fbeceac587a1120e932f83a27e9f559b16254ebaaa47b7b8d988
3
  size 4943162336
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:12bc978fffd4c722d96713518616df2451e36cba98c47ad75730c6f23b05386b
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:11ce5a3955f1b484013ca8062d176f7089279c3ba4fff8935f490ac7eee8604a
3
  size 4999819336
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:90b9b51bfb63e7f852bcabffc4c810887653a2568f047181c1b738dcfc9f4241
3
  size 4540516344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:03c02eb006e1d93b6a588d7878f93b3a8d0d91931a97dcf8870e5d4a0f29e4a6
3
  size 4540516344