fedric95 commited on
Commit
b61be20
1 Parent(s): fd9faf7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md CHANGED
@@ -49,6 +49,11 @@ Original model: https://huggingface.co/google/gemma-2-2b
49
  | HellaSwag (0-shot) | Q3_K_M | 68.00438160 |
50
  | HellaSwag (0-shot) | Q3_K_S | 69.95618403 |
51
  | HellaSwag (0-shot) | Q2_K | 59.38060147 |
 
 
 
 
 
52
 
53
  ## Downloading using huggingface-cli
54
 
 
49
  | HellaSwag (0-shot) | Q3_K_M | 68.00438160 |
50
  | HellaSwag (0-shot) | Q3_K_S | 69.95618403 |
51
  | HellaSwag (0-shot) | Q2_K | 59.38060147 |
52
+ | MMLU (0-shot) | Q8_0 | 35.5943 +/- 1.2173 |
53
+ | MMLU (0-shot) | Q4_K_M | 35.5943 +/- 1.2173 |
54
+ | MMLU (0-shot) | Q3_K_M | 35.2067 +/- 1.2143 |
55
+ | MMLU (0-shot) | Q3_K_S | 33.9147 +/- 1.2037 |
56
+ | MMLU (0-shot) | Q2_K | 33.0749 +/- 1.1962 |
57
 
58
  ## Downloading using huggingface-cli
59