Hugging Face's logo

sfulay
/
zephyr-7b-dpo-full-ultrabin-reward-scale-1-rpo

Safetensors
mistral
trl
dpo
Generated from Trainer
Model card Files Community
sfulay commited on
Commit
0e5d873
•
1 Parent(s): 15a1409

Training in progress, step 478

Browse files
Files changed (3) hide show
  1. model-00001-of-00003.safetensors +1 -1
  2. model-00002-of-00003.safetensors +1 -1
  3. model-00003-of-00003.safetensors +1 -1
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a12502450c36955c2d0d1580fb9e8c91f87d4b9b4e67b2333cd150d66e58cf04
3
  size 4943162336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:25cee948b83e786fa3653a4b9b8deff5a88542137094f45e87d99823e4d37c0b
3
  size 4943162336
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1c692d62dad1ca9b1bfae5b761634c0584d70b43c081de17140c048c592af514
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2fb3a63d318c9c9431ad5a24ffd67f62bee9deeaf885eb0cf9d1852d6c8049ad
3
  size 4999819336
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:972488d708c4f680df32522a7bc9870724e66764888029569907f70894e94e9a
3
  size 4540516344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:438e72897f9db16fc18f7a0e2a09398fb964611addd34b95cf7abecdc60e302b
3
  size 4540516344