RioShiina
/

qwen2.5-bakeneko-32b-exl2

Model card Files Files and versions Community

Using turboderp's ExLlamaV2 v0.2.8 for quantization.

2.2bpw
3.0bpw
4.0bpw
5.0bpw
6.0bpw
7.0bpw
8.0bpw

Calibration Dataset

TFMC/imatrix-dataset-for-japanese-llm

qwen2.5-bakeneko-32b-exl2

Model creator: rinna
Original model: qwen2.5-bakeneko-32b

License

The Apache License, Version 2.0

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for RioShiina/qwen2.5-bakeneko-32b-exl2

Base model

Qwen/Qwen2.5-32B

Finetuned

rinna/qwen2.5-bakeneko-32b

Quantized

(4)

this model