pszemraj leaderboard-pr-bot commited on
Commit
15da1bb
1 Parent(s): fe96d63

Adding Evaluation Results (#3)

Browse files

- Adding Evaluation Results (655f4fb9e103f8b5170817cc7c0eb64419d9490e)


Co-authored-by: Open LLM Leaderboard PR Bot <[email protected]>

Files changed (1) hide show
  1. README.md +14 -0
README.md CHANGED
@@ -156,3 +156,17 @@ The following hyperparameters were used during training:
156
  - Pytorch 1.12.0+cu113
157
  - Datasets 2.4.0
158
  - Tokenizers 0.12.1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
156
  - Pytorch 1.12.0+cu113
157
  - Datasets 2.4.0
158
  - Tokenizers 0.12.1
159
+
160
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
161
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_postbot__distilgpt2-emailgen)
162
+
163
+ | Metric | Value |
164
+ |-----------------------|---------------------------|
165
+ | Avg. | 24.89 |
166
+ | ARC (25-shot) | 21.76 |
167
+ | HellaSwag (10-shot) | 27.52 |
168
+ | MMLU (5-shot) | 25.97 |
169
+ | TruthfulQA (0-shot) | 46.17 |
170
+ | Winogrande (5-shot) | 51.62 |
171
+ | GSM8K (5-shot) | 0.0 |
172
+ | DROP (3-shot) | 1.16 |