hades-9b-keyword
License
Use of this model requires company approval. Please contact [email protected]. For more details, please refer to the website below: https://2digit.io/#contactus
Evaluation
task | file | recall | precision | f1 | top1_score | (0, 5](20) | (15, 20](2) | (20, 25](5) | (25, 30](5) | (30, 35](4) | (35, 40](2) | (40, 45](1) | (45, 50](1) | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
0 | keyword | hades-9b-keyword-keyword_testset.jsonl | 0.61 | 0.44 | 0.47 | 0.55 | 0.69 | 0.25 | 0.62 | 0.54 | 0.6 | 0.76 | 0.33 | 0.35 |
1 | keyword | hades-7b-keyword_testset.jsonl | 0.39 | 0.43 | 0.35 | 0.49 | 0.48 | 0.1 | 0.42 | 0.35 | 0.24 | 0.35 | 0.33 | 0 |
2 | keyword | Meta-Llama-3-8B-Instruct-keyword_23k-sft-lora-keyword_testset.jsonl | 0.24 | 0.28 | 0.21 | 0.39 | 0.32 | 0.18 | 0.27 | 0.11 | 0.1 | 0.16 | 0.14 | 0 |