Zenabius
/

Qwen2.5-3B-Instruct-exl2

8-bit precision

Model card Files Files and versions Community

EXL2 Quantizations of Qwen2.5-3B-Instruct

Using exllamav2 release 0.2.6 for quantization.

Original model: https://huggingface.co/Qwen/Qwen2.5-3B-Instruct

Bits 8.0, lm_head 8.0

Downloads last month: 6

Inference API

Unable to determine this model's library. Check the docs .

Model tree for Zenabius/Qwen2.5-3B-Instruct-exl2

Base model

Qwen/Qwen2.5-3B

Finetuned

Qwen/Qwen2.5-3B-Instruct

Quantized

(79)

this model