|
--- |
|
license: cc-by-4.0 |
|
language: |
|
- en |
|
library_name: transformers |
|
pipeline_tag: text-generation |
|
tags: |
|
- roleplay |
|
--- |
|
|
|
# LemonadeRP-4.5.3 8bpw |
|
Exllama quant of [KatyTheCutie/LemonadeRP-4.5.3](https://huggingface.co/KatyTheCutie/LemonadeRP-4.5.3) |
|
> 7B roleplay focused model, creativity and less cliché is the focus of this merge. |
|
|
|
## Other quants: |
|
EXL2: [8bpw](https://huggingface.co/Kooten/LemonadeRP-4.5.3-8bpw-exl2), [6bpw](https://huggingface.co/Kooten/LemonadeRP-4.5.3-6bpw-exl2), [5bpw](https://huggingface.co/Kooten/LemonadeRP-4.5.3-5bpw-exl2), [4bpw](https://huggingface.co/Kooten/LemonadeRP-4.5.3-4bpw-exl2) |
|
|
|
|
|
## Prompt format: Chatml |
|
Based on the models going in to this I would assume Chatml is the appropriate format. |
|
``` |
|
<|im_start|>system |
|
{sysprompt}<|im_end|> |
|
<|im_start|>user |
|
{input}<|im_end|> |
|
<|im_start|>assistant |
|
{output}<|im_end|> |
|
``` |
|
|
|
## Contact |
|
Kooten on discord |
|
|
|
[ko-fi.com/kooten](https://ko-fi.com/kooten) if you would like to support me |
|
|
