Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
mlx-community
/
Nous-Hermes-2-Mixtral-8x7B-DPO-4bit
like
18
MLX
English
mixtral
Mixtral
instruct
finetune
chatml
DPO
RLHF
gpt4
synthetic data
distillation
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Use this model
56d7451
Nous-Hermes-2-Mixtral-8x7B-DPO-4bit
File size: 51 Bytes
c77f0fc
1
2
3
4
5
{
"<|im_end|>"
:
32000
,
"<|im_start|>"
:
32001
}