neuralmagic
/

Qwen2-1.5B-Instruct-quantized.w4a16

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Qwen2-1.5B-Instruct-quantized.w4a16 / vllm-clearml /results_2024-06-29T02-27-23.641279.json

Commit History

Upload folder using huggingface_hub

4debe3d
verified

abhinavnmagic commited on Jul 9, 2024