Hugging Face's logo

sfulay
/
zephyr-7b-dpo-full-ultrabin-reward-scale-1-rpo

Safetensors
mistral
trl
dpo
Generated from Trainer
Model card Files Community
sfulay commited on
Commit
82e0b88
•
1 Parent(s): f04d5f1

Training in progress, step 200

Browse files
Files changed (3) hide show
  1. model-00001-of-00003.safetensors +1 -1
  2. model-00002-of-00003.safetensors +1 -1
  3. model-00003-of-00003.safetensors +1 -1
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:87d89697daef7af88a51db26defedab6dd0dbe86753ee9bbba71aeba59fe8644
3
  size 4943162336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a6f7d9b98ff9d279dd153a043df2432402f8920c8805d5c10bddcd492855c40d
3
  size 4943162336
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b0f064cca87cb99867b609b1cfb9e4e378e6daf69839d80a5a0fe47fd7d34cb2
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e67de6e31337407251641bc0abeab354947149a90319baf51a98ba21e8c4fb52
3
  size 4999819336
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2eccdd67c2d44ab50e1fad23b0775c7df192b66d635d63150a2d7847dda53472
3
  size 4540516344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d4a66ebc1a8bcc314eb7be8cfbc69ba8c1d4bcd474afee799d26e5ac44028cf5
3
  size 4540516344