neuralmagic
/

TinyLlama-1.1B-Chat-v1.0-marlin

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

TinyLlama-1.1B-Chat-v1.0-marlin / quantize_config.json

Commit History

Upload folder using huggingface_hub

5059cf5
verified

mgoin commited on Mar 5