|
--- |
|
library_name: transformers |
|
tags: [] |
|
--- |
|
|
|
# Model Card for Model ID Trying to implement Llama3 Tokenizer with Tinyllama |
|
|
|
<!-- Provide a quick summary of what the model is/does. --> |
|
|
|
|
|
|
|
## Model Details |
|
|
|
### Model Description |
|
|
|
<!-- Provide a longer summary of what this model is. --> |
|
|
|
| Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr| |
|
|-------------|------:|------|-----:|--------|---|-----:|---|-----:| |
|
|arc_challenge| 1|none | 0|acc |↑ |0.2312|± |0.0123| |
|
| | |none | 0|acc_norm|↑ |0.2602|± |0.0128| |
|
|arc_easy | 1|none | 0|acc |↑ |0.2593|± |0.0090| |
|
| | |none | 0|acc_norm|↑ |0.2572|± |0.0090| |
|
|boolq | 2|none | 0|acc |↑ |0.5685|± |0.0087| |
|
|hellaswag | 1|none | 0|acc |↑ |0.2583|± |0.0044| |
|
| | |none | 0|acc_norm|↑ |0.2642|± |0.0044| |
|
|openbookqa | 1|none | 0|acc |↑ |0.1260|± |0.0149| |
|
| | |none | 0|acc_norm|↑ |0.2800|± |0.0201| |
|
|piqa | 1|none | 0|acc |↑ |0.5457|± |0.0116| |
|
| | |none | 0|acc_norm|↑ |0.5158|± |0.0117| |
|
|winogrande | 1|none | 0|acc |↑ |0.5130|± |0.0140| |
