Update README.md
Browse files
README.md
CHANGED
|
@@ -35,6 +35,21 @@ Original model: https://huggingface.co/google/gemma-2-2b
|
|
| 35 |
| [gemma-2-2b-Q3_K_S.gguf](https://huggingface.co/fedric95/gemma-2-2b-GGUF/blob/main/gemma-2-2b-Q3_K_S.gguf) | Q3_K_S | 1.36GB | 10.8067 +/- 0.08032 |
|
| 36 |
| [gemma-2-2b-Q2_K.gguf](https://huggingface.co/fedric95/gemma-2-2b-GGUF/blob/main/gemma-2-2b-Q2_K.gguf) | Q2_K | 1.23GB | 13.8994 +/- 0.10723 |
|
| 37 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 38 |
## Downloading using huggingface-cli
|
| 39 |
|
| 40 |
First, make sure you have hugginface-cli installed:
|
|
|
|
| 35 |
| [gemma-2-2b-Q3_K_S.gguf](https://huggingface.co/fedric95/gemma-2-2b-GGUF/blob/main/gemma-2-2b-Q3_K_S.gguf) | Q3_K_S | 1.36GB | 10.8067 +/- 0.08032 |
|
| 36 |
| [gemma-2-2b-Q2_K.gguf](https://huggingface.co/fedric95/gemma-2-2b-GGUF/blob/main/gemma-2-2b-Q2_K.gguf) | Q2_K | 1.23GB | 13.8994 +/- 0.10723 |
|
| 37 |
|
| 38 |
+
## Benchmark Results
|
| 39 |
+
|
| 40 |
+
| Benchmark | Quant type | Metric |
|
| 41 |
+
| -------- | ---------- | --------- |
|
| 42 |
+
| WinoGrande (0-shot) | Q8_0 | 68.3504 +/- 1.3072 |
|
| 43 |
+
| WinoGrande (0-shot) | Q4_K_M | 67.5612 +/- 1.3157 |
|
| 44 |
+
| WinoGrande (0-shot) | Q3_K_M | 65.9037 +/- 1.3323 |
|
| 45 |
+
| WinoGrande (0-shot) | Q3_K_S | 65.51483768 |
|
| 46 |
+
| WinoGrande (0-shot) | Q2_K | 63.2991 +/- 1.3546 |
|
| 47 |
+
| HellaSwag (0-shot) | Q8_0 | 71.25074686 |
|
| 48 |
+
| HellaSwag (0-shot) | Q4_K_M | 69.95618403 |
|
| 49 |
+
| HellaSwag (0-shot) | Q3_K_M | 68.00438160 |
|
| 50 |
+
| HellaSwag (0-shot) | Q3_K_S | 66.6930 +/- 1.3246 |
|
| 51 |
+
| HellaSwag (0-shot) | Q2_K | 59.38060147 |
|
| 52 |
+
|
| 53 |
## Downloading using huggingface-cli
|
| 54 |
|
| 55 |
First, make sure you have hugginface-cli installed:
|