neuralmagic
/

Mistral-7B-Instruct-v0.3-quantized.w4a16

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Mistral-7B-Instruct-v0.3-quantized.w4a16

2 contributors

History: 6 commits

abhinavnmagic's picture

Upload tokenizer.json with huggingface_hub

c148a4a verified 7 months ago

.gitattributes

1.52 kB

initial commit 7 months ago
config.json

973 Bytes

Upload config.json with huggingface_hub 7 months ago
model.safetensors

4.17 GB
LFS

Upload model.safetensors with huggingface_hub 7 months ago
quantize_config.json

270 Bytes

Upload quantize_config.json with huggingface_hub 7 months ago
special_tokens_map.json

414 Bytes

Upload special_tokens_map.json with huggingface_hub 7 months ago
tokenizer.json

1.96 MB

Upload tokenizer.json with huggingface_hub 7 months ago