fedric95 commited on
Commit
98d8de5
1 Parent(s): b61be20

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -0
README.md CHANGED
@@ -37,6 +37,14 @@ Original model: https://huggingface.co/google/gemma-2-2b
37
 
38
  ## Benchmark Results
39
 
 
 
 
 
 
 
 
 
40
  | Benchmark | Quant type | Metric |
41
  | -------- | ---------- | --------- |
42
  | WinoGrande (0-shot) | Q8_0 | 68.3504 +/- 1.3072 |
 
37
 
38
  ## Benchmark Results
39
 
40
+ Results have been computed using:
41
+
42
+ [hellaswage_val_full](https://raw.githubusercontent.com/klosax/hellaswag_text_data/main/hellaswag_val_full.txt)
43
+
44
+ [winogrande-debiased-eval](https://huggingface.co/datasets/ikawrakow/winogrande-eval-for-llama.cpp/raw/main/winogrande-debiased-eval.csv)
45
+
46
+ [mmlu-validation](https://huggingface.co/datasets/ikawrakow/validation-datasets-for-llama.cpp/resolve/main/mmlu-validation.bin)
47
+
48
  | Benchmark | Quant type | Metric |
49
  | -------- | ---------- | --------- |
50
  | WinoGrande (0-shot) | Q8_0 | 68.3504 +/- 1.3072 |