RichardErkhov
/

netcat420_-_MFANN3bv0.2-4bits

4-bit precision

Model card Files Files and versions Community

YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

Quantization made by Richard Erkhov.

Request more models

MFANN3bv0.2 - bnb 4bits

Model creator: https://huggingface.co/netcat420/
Original model: https://huggingface.co/netcat420/MFANN3bv0.2/

Original model description:

library_name: transformers license: apache-2.0 datasets: - netcat420/MFANN

63.08 <- Average 61.77 <- ARC 76.35 <- HellaSwag 56.23 <- MMLU 53 <- TruthfulQA 75.85 <- Winogrande 55.27 <- GSM8K

Downloads last month: 0

Safetensors

Model size

1.56B params

Tensor type

F32

·

FP16

·

U8

·

Inference API

Unable to determine this model's library. Check the docs .