ericpolewski
/

AIRIC-The-Mistral-5.0bpw-exl2

Text Generation

Inference Endpoints

Model card Files Files and versions Community

AIRIC-The-Mistral-5.0bpw-exl2 / README.md

ericpolewski's picture

Update README.md

a5787dd 10 months ago

|

169 Bytes

This is a 5-bit exl2 quant of https://huggingface.co/ericpolewski/AIRIC-The-Mistral

8-bit available at https://huggingface.co/ericpolewski/AIRIC-The-Mistral-8.0bpw-exl2