OPEA
/

Llama-3.3-70B-Instruct-int3-sym-inc

Model card Files Files and versions Community

cicdatopea commited on 20 days ago

Commit

6e23eda

·

verified ·

1 Parent(s): 226c497

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -112,7 +112,7 @@ lm-eval --model hf --model_args pretrained=OPEA/Llama-3.3-70B-Instruct-int3-sym-
 | avg                         | 0.7023                   |        |             |
 | leaderboard_mmlu_pro  5shot | 0.5484                   |        |             |
 | leaderboard_ifeval          | 0.6661=(0.7110+0.6211)/2 |        |             |
-| mmlu                        | 0.8195                   |        |             |
 | lambada_openai              | 0.7528                   |        |             |
 | hellaswag                   | 0.6575                   |        |             |
 | winogrande                  | 0.7869                   |        |             |

 | avg                         | 0.7023                   |        |             |
 | leaderboard_mmlu_pro  5shot | 0.5484                   |        |             |
 | leaderboard_ifeval          | 0.6661=(0.7110+0.6211)/2 |        |             |
+| mmlu                        | 0.8195                   | 0.8052       |             |
 | lambada_openai              | 0.7528                   |        |             |
 | hellaswag                   | 0.6575                   |        |             |
 | winogrande                  | 0.7869                   |        |             |