--- tags: - gptq language: - en base_model: Sao10K/L3-8B-Stheno-v3.2 --- Original Model: https://huggingface.co/Sao10K/L3-8B-Stheno-v3.2 Quantized with AutoGPTQ 128g wikitext2, using the script from https://aphrodite.pygmalion.chat/pages/quantization/quantization-methods.html#gptq