altomek
/

magnum-v2-4b-8bpw-EXL2

Text Generation

8-bit precision

Model card Files Files and versions Community

magnum-v2-4b

ExLlamav2 8 bpw quants of https://huggingface.co/anthracite-org/magnum-v2-4b

Downloads last month: 12

Inference Examples

Text Generation

Inference API (serverless) has been turned off for this model.

Model tree for altomek/magnum-v2-4b-8bpw-EXL2

Base model

nvidia/Llama-3.1-Minitron-4B-Width-Base

Finetuned

anthracite-org/magnum-v2-4b

Quantized

(11)

this model