huseinzol05 commited on
Commit
e063c2e
·
verified ·
1 Parent(s): 47eb46a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -0
README.md CHANGED
@@ -22,6 +22,22 @@ Continue finetuning https://huggingface.co/meta-llama/Llama-3.2-1B on highly cur
22
  ## MalayMMLU
23
 
24
  ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
25
  ```
26
 
27
  ## Training session
 
22
  ## MalayMMLU
23
 
24
  ```
25
+ Model Accuracy shot by_letter category
26
+ 0 Llama-3.2-1B-Malaysian-Reasoning 48.939419 0shot True STEM
27
+ 1 Llama-3.2-1B-Malaysian-Reasoning 42.529898 0shot True Language
28
+ 2 Llama-3.2-1B-Malaysian-Reasoning 45.995663 0shot True Social science
29
+ 3 Llama-3.2-1B-Malaysian-Reasoning 49.323099 0shot True Others
30
+ 4 Llama-3.2-1B-Malaysian-Reasoning 49.043231 0shot True Humanities
31
+ {'Social science': 6918, 'Language': 6288, 'Humanities': 4395, 'Others': 4169, 'STEM': 2443}
32
+ Model : Llama-3.2-1B-Malaysian-Reasoning
33
+ Metric : first
34
+ Shot : 0shot
35
+ average accuracy 47.16626209232134
36
+ accuracy for STEM 48.93941874744167
37
+ accuracy for Language 42.529898218829516
38
+ accuracy for Social science 45.99566348655681
39
+ accuracy for Others 49.323099064523866
40
+ accuracy for Humanities 49.04323094425484
41
  ```
42
 
43
  ## Training session