hiyouga commited on
Commit
f4907d3
1 Parent(s): 583a62b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -0
README.md CHANGED
@@ -91,6 +91,16 @@ The following hyperparameters were used during training:
91
 
92
  ![loss](train_loss.png)
93
 
 
 
 
 
 
 
 
 
 
 
94
  ### Framework versions
95
 
96
  - PEFT 0.9.0
 
91
 
92
  ![loss](train_loss.png)
93
 
94
+ ### Benchmark results
95
+
96
+ | MMLU Benchmark | Bits | Metric | Accurary |
97
+ | --------------- | ---- | ------------- | -------- |
98
+ | Average | 2 | 5-shot, top-1 | 62.38 |
99
+ | STEM | 2 | 5-shot, top-1 | 51.57 |
100
+ | Social Sciences | 2 | 5-shot, top-1 | 73.44 |
101
+ | Humanities | 2 | 5-shot, top-1 | 57.82 |
102
+ | Other | 2 | 5-shot, top-1 | 68.56 |
103
+
104
  ### Framework versions
105
 
106
  - PEFT 0.9.0