neuralmagic
/

Qwen2-1.5B-Instruct-quantized.w4a16

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Qwen2-1.5B-Instruct-quantized.w4a16 / truthfulqa_mc2-vllm

Commit History

Upload folder using huggingface_hub

4debe3d
verified

abhinavnmagic commited on Jul 9