Hugging Face's logo

ConfidentialMind
/
Arcee-Blitz-GPTQ-G32-W4A16-MSE

Text Generation
Safetensors
mistral
gptq
quantization
4bit
confidentialmind
apache2.0
mistral-small-24b
conversational
4-bit precision
Model card Files Community

馃敟 Quantized Model: Arcee-Blitz_gptq_g32_4bit 馃敟

The MSE based test did not work out too well; use non-MSE quant.

Downloads last month
0
Safetensors
Model size
4.91B params
Tensor type
I32
路
BF16
路
FP16
路
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.