Hugging Face's logo

RyanYr
/
self-correct_Ministral8Bit_mMQA-mix_iter4

Text Generation
Transformers
Safetensors
mistral
Generated from Trainer
trl
dpo
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
RyanYr commited on
Commit
a1b2f16
•
1 Parent(s): e235819

Model save

Browse files
Files changed (6) hide show
  1. README.md +1 -1
  2. last_checkpoint/model-00001-of-00004.safetensors +1 -1
  3. last_checkpoint/model-00002-of-00004.safetensors +1 -1
  4. last_checkpoint/model-00003-of-00004.safetensors +1 -1
  5. last_checkpoint/model-00004-of-00004.safetensors +1 -1
  6. last_checkpoint/training_args.bin +1 -1
README.md CHANGED
@@ -27,7 +27,7 @@ print(output["generated_text"])
27
 
28
  ## Training procedure
29
 
30
- [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/yyr/huggingface/runs/cq2pf23v)
31
 
32
  This model was trained with DPO, a method introduced in [Direct Preference Optimization: Your Language Model is Secretly a Reward Model](https://huggingface.co/papers/2305.18290).
33
 
 
27
 
28
  ## Training procedure
29
 
30
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/yyr/huggingface/runs/l4bi6uzm)
31
 
32
  This model was trained with DPO, a method introduced in [Direct Preference Optimization: Your Language Model is Secretly a Reward Model](https://huggingface.co/papers/2305.18290).
33
 
last_checkpoint/model-00001-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5474dd546a6263e6d59a145b74b4c7485c5a0dddaacc20bf607c89971fa8e39d
3
  size 4983016096
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:36b86e5e9b16ec1e968d765263692711bd08c8b25725b1c1268cc4c2c07e24c1
3
  size 4983016096
last_checkpoint/model-00002-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f1a9e2d33834dd838b4db7e9270bae618fb8cfe127943f015e8f0e9de625e03c
3
  size 4999836776
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:47a047d269a076249edf787b4ebc09aa2a000c24a2f5f3644879cf0defbbc721
3
  size 4999836776
last_checkpoint/model-00003-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8379a0e91723d8ca73830a8a88b1a86e185fe4dd8b198528550fe962b6bbae61
3
  size 4983067960
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8f971b52c136eb54f913fd12b9262903cc76ecf24907b911a020eb310ca291b0
3
  size 4983067960
last_checkpoint/model-00004-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b69b223bf73cd0ddd13c388ab0a3726a81307a29011fe09746f60344a3ede5b7
3
  size 1073750144
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d3a1ca70e821839c3c84f8c74ad3321cc31a51327d3572321f24136305f9fc3a
3
  size 1073750144
last_checkpoint/training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8621efc3c372a020d3cd58c1a3e56b7146e4eebd84de1d993a3f8297b19e50dd
3
  size 7992
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:96cd4db97a89c4328a093065aebebf8e2ea8036d982ce2aafa1a10b3054a0d7b
3
  size 7992