Configuration Parsing
Warning:
In config.json: "quantization_config.bits" must be an integer
EXL2 quants by FrenzyBiscuit
This model is 5.5 BPW EXL2
- Downloads last month
- 0
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.
Model tree for ReadyArt/Cydonia-24B-v2.1_EXL2_5.5bpw_H8
Base model
TheDrummer/Cydonia-24B-v2.1