T3Q-LLM-solar10.8-sft-v1.0
This model is a version of yanolja/EEVE-Korean-Instruct-10.8B-v1.0 that has been fine-tuned with SFT.
Model Developers Chihoon Lee(chihoonlee10), T3Q
hf (pretrained=T3Q-LLM/T3Q-LLM-solar10.8-sft-v1.0), limit: None, provide_description: False, num_fewshot: 0, batch_size: None
Task | Version | Metric | Value | Stderr | |
---|---|---|---|---|---|
kobest_boolq | 0 | acc | 0.9288 | ± | 0.0069 |
macro_f1 | 0.9286 | ± | 0.0069 | ||
kobest_copa | 0 | acc | 0.7440 | ± | 0.0138 |
macro_f1 | 0.7434 | ± | 0.0138 | ||
kobest_hellaswag | 0 | acc | 0.4880 | ± | 0.0224 |
acc_norm | 0.5600 | ± | 0.0222 | ||
macro_f1 | 0.4854 | ± | 0.0224 | ||
kobest_sentineg | 0 | acc | 0.8589 | ± | 0.0175 |
macro_f1 | 0.8589 | ± | 0.0175 |
hf (pretrained=yanolja/EEVE-Korean-Instruct-10.8B-v1.0), limit: None, provide_description: False, num_fewshot: 0, batch_size: None
Task | Version | Metric | Value | Stderr | |
---|---|---|---|---|---|
kobest_boolq | 0 | acc | 0.9188 | ± | 0.0073 |
macro_f1 | 0.9185 | ± | 0.0073 | ||
kobest_copa | 0 | acc | 0.7520 | ± | 0.0137 |
macro_f1 | 0.7516 | ± | 0.0136 | ||
kobest_hellaswag | 0 | acc | 0.4840 | ± | 0.0224 |
acc_norm | 0.5580 | ± | 0.0222 | ||
macro_f1 | 0.4804 | ± | 0.0223 | ||
kobest_sentineg | 0 | acc | 0.8514 | ± | 0.0179 |
macro_f1 | 0.8508 | ± | 0.0180 |
- Downloads last month
- 1,991
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.