Configuration Parsing Warning: In config.json: "quantization_config.bits" must be an integer

This is an EXL2 quant (5.5bpw H8) of TheDrummer/Skyfall-36B-v2.

EXL2 Quants by ArtusDev.

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ArtusDev/Skyfall-36B-v2_EXL2_5.5bpw_H8

Base model

Quantized

(26)

this model

Collection including ArtusDev/Skyfall-36B-v2_EXL2_5.5bpw_H8