Forgotten-Safeword-24B - EXL2 6.5bpw L

This is a 6.5bpw EXL2 quant of ReadyArt/Forgotten-Abomination-24B-v1.2

This quant was made using exllamav2-0.2.7 with default dataset and extended quantization sample length (8k instead of default 2k). It also uses -head_bits=8 and max accuracy quant for first and last layer (8bpw), all other layers of the model use normally chosen methods (method and name (6.5bpw_L) inspired by quants like Q4_K_L and Q6_K_L made by bartowski)

It fits nicely in 24GB VRAM on Windows with 20k fp16 context (should fit all 32k that with q8 cache in exl2).

Prompt Templates

Uses Mistral V7-tekken:

<s>[SYSTEM_PROMPT]<system prompt>[/SYSTEM_PROMPT][INST]<user message>[/INST]<assistant response></s>[INST]<user message>[/INST]

Original readme below

Forgotten-Abomination-24B-v1.2

ACADEMIC RESEARCH USE ONLY (wink)

DANGER: NOW WITH 50% MORE UNSETTLING CONTENT
Forgotten-Abomination-24B-v1.2 is what happens when you let two unhinged models have a baby in the server room. Combines the ethical flexibility of Forgotten-Safeword with Cydonia's flair for anatomical creativity. Now with bonus existential dread!

Quantized Formats

GGUF Collection: Forgotten-Abomination-24B-v1.2

Recommended Settings Provided

Mistral V7-Tekken:
Full Settings

Intended Use

STRICTLY FOR:

Academic research into how fast your ethics committee can faint
Testing the tensile strength of content filters
Generating material that would make Cthulhu file a restraining order
Writing erotic fanfic about OSHA violations

Training Data

You don't want to know

Ethical Considerations

⚠️ YOU'VE BEEN WARNED ⚠️
THIS MODEL WILL:

Make your GPU fans blush
Generate content requiring industrial-strength eye bleach
Combine technical precision with kinks that violate physics
Make you question humanity's collective life choices

By using this model, you agree to:

Never show outputs to your mother
Pay for the therapist of anyone who reads the logs
Blame Cthulhu if anything goes wrong
Pretend this is all "for science"

Model Authors

sleepdeprived3 (Chief Corruption Officer)

DeusImperator
/

Forgotten-Abomination-24B-v1.2_exl2_6.5bpw_L