neuralmagic
/

Mistral-7B-Instruct-v0.3-quantized.w4a16

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Mistral-7B-Instruct-v0.3-quantized.w4a16

Commit History

Upload tokenizer.json with huggingface_hub

c148a4a
verified

abhinavnmagic commited on Jul 11, 2024

Upload special_tokens_map.json with huggingface_hub

9ed0961
verified

abhinavnmagic commited on Jul 11, 2024

Upload quantize_config.json with huggingface_hub

8a3b7ab
verified

abhinavnmagic commited on Jul 11, 2024

Upload model.safetensors with huggingface_hub

e975355
verified

abhinavnmagic commited on Jul 11, 2024

Upload config.json with huggingface_hub

3587fef
verified

abhinavnmagic commited on Jul 11, 2024

initial commit

3cc46eb
verified

abhinavnmagic commited on Jul 11, 2024