Tasks Version Filter n-shot Metric Value Stderr
arc_challenge 1 none 0 acc ↑ 0.2304 ± 0.0123
none 0 acc_norm ↑ 0.2551 ± 0.0127
arc_easy 1 none 0 acc ↑ 0.2559 ± 0.0090
none 0 acc_norm ↑ 0.2572 ± 0.0090
boolq 2 none 0 acc ↑ 0.4599 ± 0.0087
hellaswag 1 none 0 acc ↑ 0.2538 ± 0.0043
none 0 acc_norm ↑ 0.2601 ± 0.0044
openbookqa 1 none 0 acc ↑ 0.1580 ± 0.0163
none 0 acc_norm ↑ 0.2720 ± 0.0199
piqa 1 none 0 acc ↑ 0.5424 ± 0.0116
none 0 acc_norm ↑ 0.5180 ± 0.0117
winogrande 1 none 0 acc ↑ 0.4980 ± 0.0141
Downloads last month
9
Safetensors
Model size
1.49B params
Tensor type
F32
·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.