CobraMamba leaderboard-pr-bot commited on
Commit
0c130d6
1 Parent(s): 22ffe52

Adding Evaluation Results (#1)

Browse files

- Adding Evaluation Results (94ac47c87ff57fed0307b0399a93c4bc9e2ee181)


Co-authored-by: Open LLM Leaderboard PR Bot <[email protected]>

Files changed (1) hide show
  1. README.md +14 -0
README.md CHANGED
@@ -68,3 +68,17 @@ Please read this disclaimer carefully before using the large language model prov
68
  ---
69
  license: apache-2.0
70
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
68
  ---
69
  license: apache-2.0
70
  ---
71
+
72
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
73
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_CobraMamba__mamba-gpt-7b-v2)
74
+
75
+ | Metric | Value |
76
+ |-----------------------|---------------------------|
77
+ | Avg. | 54.85 |
78
+ | ARC (25-shot) | 61.95 |
79
+ | HellaSwag (10-shot) | 83.83 |
80
+ | MMLU (5-shot) | 61.74 |
81
+ | TruthfulQA (0-shot) | 46.63 |
82
+ | Winogrande (5-shot) | 78.45 |
83
+ | GSM8K (5-shot) | 17.29 |
84
+ | DROP (3-shot) | 34.07 |