huseinzol05
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -22,6 +22,22 @@ Continue finetuning https://huggingface.co/meta-llama/Llama-3.2-1B on highly cur
|
|
22 |
## MalayMMLU
|
23 |
|
24 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
25 |
```
|
26 |
|
27 |
## Training session
|
|
|
22 |
## MalayMMLU
|
23 |
|
24 |
```
|
25 |
+
Model Accuracy shot by_letter category
|
26 |
+
0 Llama-3.2-1B-Malaysian-Reasoning 48.939419 0shot True STEM
|
27 |
+
1 Llama-3.2-1B-Malaysian-Reasoning 42.529898 0shot True Language
|
28 |
+
2 Llama-3.2-1B-Malaysian-Reasoning 45.995663 0shot True Social science
|
29 |
+
3 Llama-3.2-1B-Malaysian-Reasoning 49.323099 0shot True Others
|
30 |
+
4 Llama-3.2-1B-Malaysian-Reasoning 49.043231 0shot True Humanities
|
31 |
+
{'Social science': 6918, 'Language': 6288, 'Humanities': 4395, 'Others': 4169, 'STEM': 2443}
|
32 |
+
Model : Llama-3.2-1B-Malaysian-Reasoning
|
33 |
+
Metric : first
|
34 |
+
Shot : 0shot
|
35 |
+
average accuracy 47.16626209232134
|
36 |
+
accuracy for STEM 48.93941874744167
|
37 |
+
accuracy for Language 42.529898218829516
|
38 |
+
accuracy for Social science 45.99566348655681
|
39 |
+
accuracy for Others 49.323099064523866
|
40 |
+
accuracy for Humanities 49.04323094425484
|
41 |
```
|
42 |
|
43 |
## Training session
|