Hugging Face's logo

sfulay
/
zephyr-7b-dpo-full-ultrabin-reward-scale-1-rpo

Safetensors
mistral
trl
dpo
Generated from Trainer
Model card Files Community
sfulay commited on
Commit
83f3f23
•
1 Parent(s): 82e0b88

Training in progress, step 100

Browse files
Files changed (4) hide show
  1. model-00001-of-00003.safetensors +1 -1
  2. model-00002-of-00003.safetensors +1 -1
  3. model-00003-of-00003.safetensors +1 -1
  4. training_args.bin +1 -1
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a6f7d9b98ff9d279dd153a043df2432402f8920c8805d5c10bddcd492855c40d
3
  size 4943162336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b6720dd0c59db38fcf1a45e866eea20d14d7ca5c39103822fe5f4f01301939e
3
  size 4943162336
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e67de6e31337407251641bc0abeab354947149a90319baf51a98ba21e8c4fb52
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:48b784664373eb3fd7fcde14ab16e8109a4481e32485727dc1d38469bca5597f
3
  size 4999819336
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d4a66ebc1a8bcc314eb7be8cfbc69ba8c1d4bcd474afee799d26e5ac44028cf5
3
  size 4540516344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e340845af09de9fcf0bdb7060f3670dc4f3e2b1cda105fcb4a53e20dd2e3d191
3
  size 4540516344
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:79055b74732ef9087bc129e1d310fb1ade008df4e4fdf86ce8626b7ccc63b22d
3
  size 7608
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eec092d574ec803c0a5ae3985cb1db7b51a64e27481762b84caeafc33fe7a97c
3
  size 7608