Update README.md
Browse files
README.md
CHANGED
@@ -17,14 +17,14 @@ Produced using [AutoFP8 with calibration samples from ultrachat](https://github.
|
|
17 |
### Open LLM Leaderboard evaluation scores
|
18 |
| | Mixtral-8x7B-Instruct-v0.1 | Mixtral-8x7B-Instruct-v0.1-FP8<br>(this model) |
|
19 |
| :------------------: | :----------------------: | :------------------------------------------------: |
|
20 |
-
| arc-c<br>25-shot | 71.50 |
|
21 |
-
| hellaswag<br>10-shot | 87.53 |
|
22 |
| mmlu<br>5-shot | 70.33 | 68.81 |
|
23 |
-
| truthfulqa<br>0-shot | 64.79 |
|
24 |
-
| winogrande<br>5-shot | 82.40 |
|
25 |
-
| gsm8k<br>5-shot | 64.36 |
|
26 |
-
| **Average<br>Accuracy** | **73.48** | **
|
27 |
-
| **Recovery** | **100%** | **
|
28 |
|
29 |
|
30 |
|
|
|
17 |
### Open LLM Leaderboard evaluation scores
|
18 |
| | Mixtral-8x7B-Instruct-v0.1 | Mixtral-8x7B-Instruct-v0.1-FP8<br>(this model) |
|
19 |
| :------------------: | :----------------------: | :------------------------------------------------: |
|
20 |
+
| arc-c<br>25-shot | 71.50 | 71.08 |
|
21 |
+
| hellaswag<br>10-shot | 87.53 | 87.38 |
|
22 |
| mmlu<br>5-shot | 70.33 | 68.81 |
|
23 |
+
| truthfulqa<br>0-shot | 64.79 | 64.20 |
|
24 |
+
| winogrande<br>5-shot | 82.40 | 82.40 |
|
25 |
+
| gsm8k<br>5-shot | 64.36 | 64.06 |
|
26 |
+
| **Average<br>Accuracy** | **73.48** | **72.99** |
|
27 |
+
| **Recovery** | **100%** | **99.33%** |
|
28 |
|
29 |
|
30 |
|