Update README.md
Browse files
README.md
CHANGED
|
@@ -23,23 +23,9 @@ This model is the 2B version. It was trained for 2 days on 1 A100 GPU using LoRA
|
|
| 23 |
# Evaluation :
|
| 24 |
My model is now on the Arabic leaderboard.
|
| 25 |
|
| 26 |
-
| Metric |
|
| 27 |
-
|
| 28 |
-
|
|
| 29 |
-
| ACVA | 39.5 |
|
| 30 |
-
| AlGhafa | 46.5 |
|
| 31 |
-
| MMLU | 37.06 |
|
| 32 |
-
| EXAMS | 38.73 |
|
| 33 |
-
| ARC Challenge | 35.78 |
|
| 34 |
-
| ARC Easy | 36.97 |
|
| 35 |
-
| BOOLQ | 73.77 |
|
| 36 |
-
| COPA | 50 |
|
| 37 |
-
| HELLAWSWAG | 28.98 |
|
| 38 |
-
| OPENBOOK QA | 43.84 |
|
| 39 |
-
| PIQA | 56.36 |
|
| 40 |
-
| RACE | 36.19 |
|
| 41 |
-
| SCIQ | 55.78 |
|
| 42 |
-
| TOXIGEN | 78.29 |
|
| 43 |
|
| 44 |
Please refer to https://github.com/Slim205/Arabicllm/ for more details.
|
| 45 |
|
|
|
|
| 23 |
# Evaluation :
|
| 24 |
My model is now on the Arabic leaderboard.
|
| 25 |
|
| 26 |
+
| Metric | Average | ACVA | AlGhafa | MMLU | EXAMS | ARC Challenge | ARC Easy | BOOLQ | COPA | HELLAWSWAG | OPENBOOK QA | PIQA | RACE | SCIQ | TOXIGEN |
|
| 27 |
+
|----------------------|---------|------|---------|------|-------|---------------|----------|-------|------|------------|-------------|------|------|------|---------|
|
| 28 |
+
| Slim205/Barka-2b-it | 46.98 | 39.5 | 46.5 | 37.06| 38.73 | 35.78 | 36.97 | 73.77 | 50 | 28.98 | 43.84 | 56.36| 36.19| 55.78| 78.29 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 29 |
|
| 30 |
Please refer to https://github.com/Slim205/Arabicllm/ for more details.
|
| 31 |
|