File size: 1,826 Bytes
c54e0c7 24e665b 40d1046 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 |
---
license: llama3.2
datasets:
- CarrotAI/ko-instruction-dataset
- CarrotAI/Magpie-Ko-Pro-AIR
language:
- ko
- en
base_model:
- meta-llama/Llama-3.2-1B-Instruct
pipeline_tag: text-generation
---
## Score
| Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|----------------|------:|------|-----:|--------|---|-----:|---|------|
|kobest_boolq | 1|none | 5|acc |↑ |0.5726|± |0.0132|
| | |none | 5|f1 |↑ |0.5725|± | N/A|
|kobest_copa | 1|none | 5|acc |↑ |0.5200|± |0.0158|
| | |none | 5|f1 |↑ |0.5189|± | N/A|
|kobest_hellaswag| 1|none | 5|acc |↑ |0.3640|± |0.0215|
| | |none | 5|acc_norm|↑ |0.4380|± |0.0222|
| | |none | 5|f1 |↑ |0.3592|± | N/A|
|kobest_sentineg | 1|none | 5|acc |↑ |0.5642|± |0.0249|
| | |none | 5|f1 |↑ |0.5554|± | N/A|
|kobest_wic | 1|none | 5|acc |↑ |0.5087|± |0.0141|
| | |none | 5|f1 |↑ |0.4979|± | N/A|
|Tasks|Version| Filter |n-shot| Metric | |Value | |Stderr|
|-----|------:|----------------|-----:|-----------|---|-----:|---|-----:|
|gsm8k| 3|flexible-extract| 5|exact_match|↑ |0.2995|± |0.0126|
| | |strict-match | 5|exact_match|↑ |0.2987|± |0.0126|
```
@article{Llama3.2RabbitKo1BInstruct,
title={CarrotAI/Llama-3.2-Rabbit-Ko-1B-Instruct Card},
author={CarrotAI (L, GEUN)},
year={2024},
url = {https://huggingface.co/CarrotAI/Llama-3.2-Rabbit-Ko-1B-Instruct}
}
``` |