File size: 320 Bytes
3e6ced0 10d00c0 c6ff7a9 391e662 ce15fd9 e7e7e18 97c7129 3e6ced0 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
---
license: cc-by-nc-4.0
---
* [This is DPO improved version of cloudyu/Mixtral_7Bx4_MOE_24B](https://huggingface.co/cloudyu/Mixtral_7Bx4_MOE_24B)
* [DPO Trainer](https://huggingface.co/docs/trl/main/en/dpo_trainer)
* Metrics improved by DPO
|