Hugging Face's logo

neuralmagic
/
Mistral-7B-Instruct-v0.3-quantized.w4a16

Text Generation
Transformers
Safetensors
English
mistral
conversational
text-generation-inference
Inference Endpoints
4-bit precision
gptq
Model card Files Community
Mistral-7B-Instruct-v0.3-quantized.w4a16 / quantize_config.json

Commit History

Upload quantize_config.json with huggingface_hub
8a3b7ab
verified

abhinavnmagic commited on