metadata
library_name: transformers
tags: []
Model Card for Model ID Trying to implement Llama3 Tokenizer with Tinyllama
Model Details
Model Description
| Tasks | Version | Filter | n-shot | Metric | Value | Stderr | ||
|---|---|---|---|---|---|---|---|---|
| arc_challenge | 1 | none | 0 | acc | ↑ | 0.2312 | ± | 0.0123 |
| none | 0 | acc_norm | ↑ | 0.2602 | ± | 0.0128 | ||
| arc_easy | 1 | none | 0 | acc | ↑ | 0.2593 | ± | 0.0090 |
| none | 0 | acc_norm | ↑ | 0.2572 | ± | 0.0090 | ||
| boolq | 2 | none | 0 | acc | ↑ | 0.5685 | ± | 0.0087 |
| hellaswag | 1 | none | 0 | acc | ↑ | 0.2583 | ± | 0.0044 |
| none | 0 | acc_norm | ↑ | 0.2642 | ± | 0.0044 | ||
| openbookqa | 1 | none | 0 | acc | ↑ | 0.1260 | ± | 0.0149 |
| none | 0 | acc_norm | ↑ | 0.2800 | ± | 0.0201 | ||
| piqa | 1 | none | 0 | acc | ↑ | 0.5457 | ± | 0.0116 |
| none | 0 | acc_norm | ↑ | 0.5158 | ± | 0.0117 | ||
| winogrande | 1 | none | 0 | acc | ↑ | 0.5130 | ± | 0.0140 |