ReadyArt
/

QwQ-32B-Snowdrop-v0_EXL2_4.0bpw_H8

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

QwQ-32B-Snowdrop-v0_EXL2_4.0bpw_H8 / README.md

FrenzyBiscuit's picture

Update README.md

e5cd18c verified 3 days ago

|

history blame contribute delete

177 Bytes

metadata

base_model:
  - trashpanda-org/QwQ-32B-Snowdrop-v0
library_name: transformers
base_model_relation: quantized

EXL2 Quants by FrenzyBiscuit.

This model is 4.0 BPW EXL2.