Hugging Face's logo

sfulay
/
zephyr-7b-dpo-full-ultrabin-reward-scale-1-rpo

Safetensors
mistral
trl
dpo
Generated from Trainer
Model card Files Community
sfulay commited on
Commit
15a1409
•
1 Parent(s): 3f4f613

Training in progress, step 400

Browse files
Files changed (3) hide show
  1. model-00001-of-00003.safetensors +1 -1
  2. model-00002-of-00003.safetensors +1 -1
  3. model-00003-of-00003.safetensors +1 -1
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7a3ec57842ab279f8516ea8010b49a8ccb391a63e8dbc5f5c90f1208215789b5
3
  size 4943162336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a12502450c36955c2d0d1580fb9e8c91f87d4b9b4e67b2333cd150d66e58cf04
3
  size 4943162336
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7bbdeabf3c216d219f320404470975dc029a38eaeeb6dd23bc08a5c53c57cc42
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1c692d62dad1ca9b1bfae5b761634c0584d70b43c081de17140c048c592af514
3
  size 4999819336
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:77be5f45409eb96fad220b4d3529d95509feebb4c98a702ab0c3c111e192a4fb
3
  size 4540516344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:972488d708c4f680df32522a7bc9870724e66764888029569907f70894e94e9a
3
  size 4540516344