EXL2 Quants by FrenzyBiscuit.

This model is 8.0BPW EXL2.

Downloads last month
10
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Model tree for ReadyArt/Qwen2.5-QwQ-RP-Draft-v0.2-1.5B_EXL2_8.0bpw_H8

Base model

Qwen/Qwen2.5-1.5B
Quantized
(5)
this model

Collection including ReadyArt/Qwen2.5-QwQ-RP-Draft-v0.2-1.5B_EXL2_8.0bpw_H8