IlyaGusev
/

saiga_nemo_12b_gptq_8bit

8-bit precision

Model card Files Files and versions Community

No model card

Downloads last month: 3,535

Safetensors

Model size

4.18B params

Tensor type

I32

·

FP16

·

Inference API

Unable to determine this model's library. Check the docs .

Space using IlyaGusev/saiga_nemo_12b_gptq_8bit 1