---
license: apache-2.0
---
|    Tasks    |Version|Filter|n-shot| Metric |   |Value |   |Stderr|
|-------------|------:|------|-----:|--------|---|-----:|---|-----:|
|arc_challenge|      1|none  |     0|acc     |↑  |0.2176|±  |0.0121|
|             |       |none  |     0|acc_norm|↑  |0.2628|±  |0.0129|
|arc_easy     |      1|none  |     0|acc     |↑  |0.2538|±  |0.0089|
|             |       |none  |     0|acc_norm|↑  |0.2475|±  |0.0089|
|boolq        |      2|none  |     0|acc     |↑  |0.4239|±  |0.0086|
|hellaswag    |      1|none  |     0|acc     |↑  |0.2566|±  |0.0044|
|             |       |none  |     0|acc_norm|↑  |0.2606|±  |0.0044|
|openbookqa   |      1|none  |     0|acc     |↑  |0.1340|±  |0.0152|
|             |       |none  |     0|acc_norm|↑  |0.2660|±  |0.0198|
|piqa         |      1|none  |     0|acc     |↑  |0.5381|±  |0.0116|
|             |       |none  |     0|acc_norm|↑  |0.5190|±  |0.0117|
|winogrande   |      1|none  |     0|acc     |↑  |0.4704|±  |0.0140|