neuralmagic
/

SmolLM-1.7B-Instruct-quantized.w8a8

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

compressed-tensors

Model card Files Files and versions Community

SmolLM-1.7B-Instruct-quantized.w8a8

Commit History

Updated compression_config to quantization_config

b16737d
verified

mgoin commited on about 1 month ago

Create README.md

4d31352
verified

alexmarques commited on Aug 23

Upload folder using huggingface_hub

fe1f31f
verified

alexmarques commited on Aug 23

initial commit

79df1d9
verified

alexmarques commited on Aug 23