Hugging Face's logo

RyanYr
/
self-correct_Ministral8Bit_mMQA-mix_iter4

Text Generation
Transformers
Safetensors
mistral
Generated from Trainer
trl
dpo
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
RyanYr commited on
Commit
37655cc
•
1 Parent(s): ea63016

Model save

Browse files
Files changed (6) hide show
  1. README.md +1 -1
  2. last_checkpoint/model-00001-of-00004.safetensors +1 -1
  3. last_checkpoint/model-00002-of-00004.safetensors +1 -1
  4. last_checkpoint/model-00003-of-00004.safetensors +1 -1
  5. last_checkpoint/model-00004-of-00004.safetensors +1 -1
  6. last_checkpoint/training_args.bin +1 -1
README.md CHANGED
@@ -27,7 +27,7 @@ print(output["generated_text"])
27
 
28
  ## Training procedure
29
 
30
- [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/yyr/huggingface/runs/2alp0asg)
31
 
32
  This model was trained with DPO, a method introduced in [Direct Preference Optimization: Your Language Model is Secretly a Reward Model](https://huggingface.co/papers/2305.18290).
33
 
 
27
 
28
  ## Training procedure
29
 
30
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/yyr/huggingface/runs/cq2pf23v)
31
 
32
  This model was trained with DPO, a method introduced in [Direct Preference Optimization: Your Language Model is Secretly a Reward Model](https://huggingface.co/papers/2305.18290).
33
 
last_checkpoint/model-00001-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:409fe4df5c39787621b5c56231c760a4db2590226bc11b592276135ac8430150
3
  size 4983016096
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5474dd546a6263e6d59a145b74b4c7485c5a0dddaacc20bf607c89971fa8e39d
3
  size 4983016096
last_checkpoint/model-00002-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3e846039f29cd5439dfdadabb8442d39dae10756131a419ca884edad0d2a8395
3
  size 4999836776
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f1a9e2d33834dd838b4db7e9270bae618fb8cfe127943f015e8f0e9de625e03c
3
  size 4999836776
last_checkpoint/model-00003-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:639168421f66bbb22bcd4f3c840e23090a2a65b84fcf5d723c53921b5ccd2820
3
  size 4983067960
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8379a0e91723d8ca73830a8a88b1a86e185fe4dd8b198528550fe962b6bbae61
3
  size 4983067960
last_checkpoint/model-00004-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c5b40ea80acf0ac89531818cc97c4ed81bf2dcae94ecd0544ea91698b048cbc9
3
  size 1073750144
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b69b223bf73cd0ddd13c388ab0a3726a81307a29011fe09746f60344a3ede5b7
3
  size 1073750144
last_checkpoint/training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dfb9bd4685cf0aa92b9878dccaa51350eb974e628a3326fe5d505a3a651996aa
3
  size 7992
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8621efc3c372a020d3cd58c1a3e56b7146e4eebd84de1d993a3f8297b19e50dd
3
  size 7992