neuralmagic
/

Mistral-7B-Instruct-v0.3-quantized.w4a16

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Mistral-7B-Instruct-v0.3-quantized.w4a16

Commit History

Update README.md

bae95d3
verified

alexmarques commited on Jul 18, 2024

Create README.md

286250c
verified

abhinavnmagic commited on Jul 16, 2024

Upload tokenizer_config.json with huggingface_hub

7c65df0
verified

abhinavnmagic commited on Jul 11, 2024

Upload tokenizer.model with huggingface_hub

1f1685b
verified

abhinavnmagic commited on Jul 11, 2024

Upload tokenizer.json with huggingface_hub

c148a4a
verified

abhinavnmagic commited on Jul 11, 2024

Upload special_tokens_map.json with huggingface_hub

9ed0961
verified

abhinavnmagic commited on Jul 11, 2024

Upload quantize_config.json with huggingface_hub

8a3b7ab
verified

abhinavnmagic commited on Jul 11, 2024

Upload model.safetensors with huggingface_hub

e975355
verified

abhinavnmagic commited on Jul 11, 2024

Upload config.json with huggingface_hub

3587fef
verified

abhinavnmagic commited on Jul 11, 2024

initial commit

3cc46eb
verified

abhinavnmagic commited on Jul 11, 2024