Update README.md
Browse files
README.md
CHANGED
@@ -37,6 +37,14 @@ Original model: https://huggingface.co/google/gemma-2-2b
|
|
37 |
|
38 |
## Benchmark Results
|
39 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
40 |
| Benchmark | Quant type | Metric |
|
41 |
| -------- | ---------- | --------- |
|
42 |
| WinoGrande (0-shot) | Q8_0 | 68.3504 +/- 1.3072 |
|
|
|
37 |
|
38 |
## Benchmark Results
|
39 |
|
40 |
+
Results have been computed using:
|
41 |
+
|
42 |
+
[hellaswage_val_full](https://raw.githubusercontent.com/klosax/hellaswag_text_data/main/hellaswag_val_full.txt)
|
43 |
+
|
44 |
+
[winogrande-debiased-eval](https://huggingface.co/datasets/ikawrakow/winogrande-eval-for-llama.cpp/raw/main/winogrande-debiased-eval.csv)
|
45 |
+
|
46 |
+
[mmlu-validation](https://huggingface.co/datasets/ikawrakow/validation-datasets-for-llama.cpp/resolve/main/mmlu-validation.bin)
|
47 |
+
|
48 |
| Benchmark | Quant type | Metric |
|
49 |
| -------- | ---------- | --------- |
|
50 |
| WinoGrande (0-shot) | Q8_0 | 68.3504 +/- 1.3072 |
|