Malikeh1375
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -53,7 +53,26 @@ Arcee Meraj Mini model consistently outperforms state-of-the-art models on most
|
|
53 |
#### Translated MMLU
|
54 |
We focused on the multilingual MMLU dataset, as distributed through the LM Evaluation Harness repository, to compare the multilingual strength of different models for this benchmark. Arcee Meraj Mini along with the base model, Qwen2.5-7B-Instruct outperforms the other models, showcasing these models’ superior performance compared to the other state-of-the-art models.
|
55 |
<div align="center">
|
56 |
-
<img src="https://i.ibb.co/
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
57 |
</div>
|
58 |
|
59 |
|
|
|
53 |
#### Translated MMLU
|
54 |
We focused on the multilingual MMLU dataset, as distributed through the LM Evaluation Harness repository, to compare the multilingual strength of different models for this benchmark. Arcee Meraj Mini along with the base model, Qwen2.5-7B-Instruct outperforms the other models, showcasing these models’ superior performance compared to the other state-of-the-art models.
|
55 |
<div align="center">
|
56 |
+
<img src="https://i.ibb.co/dfwW1W5/W-B-Chart-10-15-2024-2-07-12-PM.png" alt="Arcee Meraj Mini Trnalsated MMLU" style="border-radius: 10px; box-shadow: 0 4px 8px 0 rgba(0, 0, 0, 0.2), 0 6px 20px 0 rgba(0, 0, 0, 0.19); max-width: 80%; height: auto;">
|
57 |
+
</div>
|
58 |
+
|
59 |
+
#### English Benchmarks:
|
60 |
+
Arcee Meraj Mini performs comparably to state-of-the-art models, demonstrating how the model retains its English language knowledge and capabilities while learning Arabic.
|
61 |
+
|
62 |
+
<div align="center">
|
63 |
+
<img src="https://i.ibb.co/mTcLFzt/W-B-Chart-10-15-2024-2-15-57-PM.png" alt="Arcee Meraj Mini Winogrande" style="border-radius: 10px; box-shadow: 0 4px 8px 0 rgba(0, 0, 0, 0.2), 0 6px 20px 0 rgba(0, 0, 0, 0.19); max-width: 80%; height: auto;">
|
64 |
+
</div>
|
65 |
+
|
66 |
+
<div align="center">
|
67 |
+
<img src="https://i.ibb.co/GRBjjGN/W-B-Chart-10-15-2024-2-17-34-PM.png" alt="Arcee Meraj Mini Arc Challenge" style="border-radius: 10px; box-shadow: 0 4px 8px 0 rgba(0, 0, 0, 0.2), 0 6px 20px 0 rgba(0, 0, 0, 0.19); max-width: 80%; height: auto;">
|
68 |
+
</div>
|
69 |
+
|
70 |
+
<div align="center">
|
71 |
+
<img src="https://i.ibb.co/98s0qTf/W-B-Chart-10-15-2024-2-17-46-PM.png" alt="Arcee Meraj Mini TruthfulQA" style="border-radius: 10px; box-shadow: 0 4px 8px 0 rgba(0, 0, 0, 0.2), 0 6px 20px 0 rgba(0, 0, 0, 0.19); max-width: 80%; height: auto;">
|
72 |
+
</div>
|
73 |
+
|
74 |
+
<div align="center">
|
75 |
+
<img src="https://i.ibb.co/yqvRK3L/W-B-Chart-10-15-2024-2-17-57-PM.png" alt="Arcee Meraj Mini GSM8K" style="border-radius: 10px; box-shadow: 0 4px 8px 0 rgba(0, 0, 0, 0.2), 0 6px 20px 0 rgba(0, 0, 0, 0.19); max-width: 80%; height: auto;">
|
76 |
</div>
|
77 |
|
78 |
|