sreemanti-abacus
commited on
Commit
•
1121150
1
Parent(s):
10cabc4
Updated model card with HF benchmarks
Browse files
README.md
CHANGED
@@ -83,3 +83,10 @@ print(outputs[0]["generated_text"][len(prompt):])
|
|
83 |
|---------------------------|-----------------|----------------|-----------------------|
|
84 |
| **Dracarys-72B-Instruct** | 33.86 | 54.30 | 53.26 |
|
85 |
| Qwen2-72B-Instruct | 30.10 | TBD | TBD |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
83 |
|---------------------------|-----------------|----------------|-----------------------|
|
84 |
| **Dracarys-72B-Instruct** | 33.86 | 54.30 | 53.26 |
|
85 |
| Qwen2-72B-Instruct | 30.10 | TBD | TBD |
|
86 |
+
|
87 |
+
## HuggingFace Benchmarks
|
88 |
+
|
89 |
+
| Model | MMLU-Pro | MMLU | BBH |
|
90 |
+
|---------------------------|-----------------|----------------|-----------------------|
|
91 |
+
| **Dracarys-72B-Instruct** | **63.22** | **82.4** | **68.17** |
|
92 |
+
| Qwen2-72B-Instruct | 62.8 | 82.2 | 67.78 |
|