riveRiPH
/

MN-12B-Lyra-v4-6bpw-h8-exl2

Model card Files Files and versions

MN-12B-Lyra-v4-6bpw-h8-exl2

This is a 6bpw h8 exl2 quant of MN-12B-Lyra-v4

Built-in(default) calibration dataset is used.

Downloads last month: 14

Inference API

Unable to determine this model's library. Check the docs .

Model tree for riveRiPH/MN-12B-Lyra-v4-6bpw-h8-exl2

Base model

Sao10K/MN-12B-Lyra-v4

Quantized

(4)

this model

Collection including riveRiPH/MN-12B-Lyra-v4-6bpw-h8-exl2

MN-12B-Lyra-v4 EXL2

3 items • Updated 25 days ago