Update README.md
Browse files
README.md
CHANGED
|
@@ -15,6 +15,12 @@ datasets:
|
|
| 15 |
- mlabonne/FineTome-100k
|
| 16 |
---
|
| 17 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 18 |
# IMPORTANT
|
| 19 |
|
| 20 |
In case you got the following error: `exception: data did not match any variant of untagged enum modelwrapper at line 1251003 column 3`. Please upgrade your **transformer** package, that is, use the following code: `pip install --upgrade "transformers>=4.45"`.
|
|
|
|
| 15 |
- mlabonne/FineTome-100k
|
| 16 |
---
|
| 17 |
|
| 18 |
+
# Notice
|
| 19 |
+
|
| 20 |
+
Model was submitted to OpenLLM for full envaluation.
|
| 21 |
+
|
| 22 |
+
**MMLU-PRO (5-shot)** (self-reported): 0.1553 ± 0.0033
|
| 23 |
+
|
| 24 |
# IMPORTANT
|
| 25 |
|
| 26 |
In case you got the following error: `exception: data did not match any variant of untagged enum modelwrapper at line 1251003 column 3`. Please upgrade your **transformer** package, that is, use the following code: `pip install --upgrade "transformers>=4.45"`.
|