Lelantos-Maid-DPO-7B 8bpw EXL2
Note: There have been issues with never ending generations for the exl quant of this model, i have not been able to figure out why, though it works for some.
Description
Exllama quant of SanjiWatsuki/Lelantos-Maid-DPO-7B
Other quants:
Prompt format: ChatML
It is partly Noromaid so should be ChatML
<|im_start|>system
{sysprompt}<|im_end|>
<|im_start|>user
{input}<|im_end|>
<|im_start|>assistant
{output}<|im_end|>
Contact
Kooten on discord
- Downloads last month
- 8
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.