neuralmagic
/

Qwen2-72B-Instruct-quantized.w4a16

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Qwen2-72B-Instruct-quantized.w4a16 / model.safetensors

Commit History

Upload model.safetensors with huggingface_hub

cd9283e
verified

abhinavnmagic commited on Jul 11, 2024