Kooten
/

OpenDolphinMaid-4x7b-4bpw-exl2

Text Generation

Not-For-All-Audiences

nsfw

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

OpenDolphinMaid-4x7b 4bpw

Exllama quant of Undi95/OpenDolphinMaid-4x7b

Other quants:

EXL2: 6bpw, 5bpw, 4bpw

Prompt template: Chatml

<|im_start|>system
{sysprompt}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant

Contact

Kooten on discord

Downloads last month: 8

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported Inference Providers.