EXL2 Quants by FrenzyBiscuit.

This model is 5.0BPW EXL2.

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

Model tree for ReadyArt/Qwen2.5-QwQ-RP-Draft-v0.2-1.5B_EXL2_5.0bpw_H8

Base model

Finetuned

Finetuned

Quantized

(5)

this model

Collection including ReadyArt/Qwen2.5-QwQ-RP-Draft-v0.2-1.5B_EXL2_5.0bpw_H8