metadata
license: mit
Classifies locution based on their illocutionary force intents:
"0": "Agreeing",
"1": "Arguing",
"2": "Asserting",
"3": "Assertive Questioning",
"4": "Challenging",
"5": "Default Illocuting",
"6": "Disagreeing",
"7": "Pure Questioning",
"8": "Restating",
"9": "Rhetorical Questioning"
F1_macro - 0.55
F1_weighted - 0.67
Accuracy - 0.67
Dataset:
MM2012 - https://corpora.aifdb.org/mm2012
MM123 - https://corpora.aifdb.org/mm123
QT30 - https://corpora.aifdb.org/qt30
US2016 - https://corpora.aifdb.org/US2016
| precision | recall | f1-score | support | |
|---|---|---|---|---|
| Agreeing | 0.63 | 0.67 | 0.65 | 18 |
| Arguing | 0.67 | 0.40 | 0.50 | 5 |
| Asserting | 0.79 | 0.89 | 0.84 | 200 |
| Assertive Questioning | 0.52 | 0.44 | 0.48 | 124 |
| Challenging | 0.48 | 0.42 | 0.44 | 24 |
| Default Illocuting | 1.00 | 0.07 | 0.13 | 14 |
| Disagreeing | 0.33 | 0.40 | 0.36 | 5 |
| Pure Questioning | 0.75 | 0.76 | 0.76 | 293 |
| Restating | 1.00 | 1.00 | 1.00 | 2 |
| Rhetorical Questioning | 0.36 | 0.40 | 0.38 | 81 |
| accuracy | 0.67 | 766 | ||
| macro avg | 0.65 | 0.54 | 0.55 | 766 |
| weighted avg | 0.67 | 0.67 | 0.67 | 766 |