Commit
•
bbbbdca
1
Parent(s):
4309eed
Adding Evaluation Results (#2)
Browse files- Adding Evaluation Results (85df9ef49a08179352aa67dead9950e2440c1485)
Co-authored-by: Open LLM Leaderboard PR Bot <[email protected]>
README.md
CHANGED
|
@@ -22,4 +22,17 @@ ASSISTANT:
|
|
| 22 |
>
|
| 23 |
>The first thing Jack did was ask for directions from one of the many colorful birds flying overhead. They told him that if he followed the path straight ahead he would eventually come across a village inhabited by friendly fairies. So off he went down the well-worn trail leading deeper into the woods. After several hours of hiking he finally reached the edge of the fairy settlement where tiny houses made entirely of flowers dotted the landscape like jewels on a crown.
|
| 24 |
>
|
| 25 |
-
>Jack knocked at the door of the largest cottage which belonged to the king and queen of these mystical folk. Upon entering they welcomed him warmly as their newest guest. Over tea and scones they explained how magic flowed freely throughout their land but only those pure of heart could see its beauty. Jack promised not to tell anyone else about what he had witnessed here so long as he might return someday when needed most. With that assurance given, the fairies bid him goodnight and sent him back along the same path he came from - now knowing more than ever before just how special life truly is.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 22 |
>
|
| 23 |
>The first thing Jack did was ask for directions from one of the many colorful birds flying overhead. They told him that if he followed the path straight ahead he would eventually come across a village inhabited by friendly fairies. So off he went down the well-worn trail leading deeper into the woods. After several hours of hiking he finally reached the edge of the fairy settlement where tiny houses made entirely of flowers dotted the landscape like jewels on a crown.
|
| 24 |
>
|
| 25 |
+
>Jack knocked at the door of the largest cottage which belonged to the king and queen of these mystical folk. Upon entering they welcomed him warmly as their newest guest. Over tea and scones they explained how magic flowed freely throughout their land but only those pure of heart could see its beauty. Jack promised not to tell anyone else about what he had witnessed here so long as he might return someday when needed most. With that assurance given, the fairies bid him goodnight and sent him back along the same path he came from - now knowing more than ever before just how special life truly is.
|
| 26 |
+
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
| 27 |
+
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Norquinal__llama-2-7b-claude-chat-rp)
|
| 28 |
+
|
| 29 |
+
| Metric | Value |
|
| 30 |
+
|-----------------------|---------------------------|
|
| 31 |
+
| Avg. | 44.78 |
|
| 32 |
+
| ARC (25-shot) | 54.95 |
|
| 33 |
+
| HellaSwag (10-shot) | 80.05 |
|
| 34 |
+
| MMLU (5-shot) | 47.03 |
|
| 35 |
+
| TruthfulQA (0-shot) | 43.47 |
|
| 36 |
+
| Winogrande (5-shot) | 74.74 |
|
| 37 |
+
| GSM8K (5-shot) | 7.28 |
|
| 38 |
+
| DROP (3-shot) | 5.94 |
|