|
--- |
|
license: mit |
|
--- |
|
|
|
Classifies locution based on their illocutionary force intents: |
|
|
|
"0": "Agreeing", |
|
"1": "Arguing", |
|
"2": "Asserting", |
|
"3": "Assertive Questioning", |
|
"4": "Challenging", |
|
"5": "Default Illocuting", |
|
"6": "Disagreeing", |
|
"7": "Pure Questioning", |
|
"8": "Restating", |
|
"9": "Rhetorical Questioning" |
|
|
|
F1_macro - 0.55 |
|
|
|
F1_weighted - 0.67 |
|
|
|
Accuracy - 0.67 |
|
|
|
Dataset: |
|
|
|
MM2012 - https://corpora.aifdb.org/mm2012 |
|
|
|
MM123 - https://corpora.aifdb.org/mm123 |
|
|
|
QT30 - https://corpora.aifdb.org/qt30 |
|
|
|
US2016 - https://corpora.aifdb.org/US2016 |
|
|
|
|
|
| | precision | recall | f1-score | support | |
|
|------------------------|-----------|--------|----------|---------| |
|
| Agreeing | 0.63 | 0.67 | 0.65 | 18 | |
|
| Arguing | 0.67 | 0.40 | 0.50 | 5 | |
|
| Asserting | 0.79 | 0.89 | 0.84 | 200 | |
|
| Assertive Questioning | 0.52 | 0.44 | 0.48 | 124 | |
|
| Challenging | 0.48 | 0.42 | 0.44 | 24 | |
|
| Default Illocuting | 1.00 | 0.07 | 0.13 | 14 | |
|
| Disagreeing | 0.33 | 0.40 | 0.36 | 5 | |
|
| Pure Questioning | 0.75 | 0.76 | 0.76 | 293 | |
|
| Restating | 1.00 | 1.00 | 1.00 | 2 | |
|
| Rhetorical Questioning | 0.36 | 0.40 | 0.38 | 81 | |
|
|
|
| | | | | | |
|
|------------------------|-----------|--------|----------|---------| |
|
| accuracy | | | 0.67 | 766 | |
|
| macro avg | 0.65 | 0.54 | 0.55 | 766 | |
|
| weighted avg | 0.67 | 0.67 | 0.67 | 766 | |
|
|
