File size: 1,778 Bytes
f553304 e8bc83e ee4971c e8bc83e 8254d14 e8bc83e 8254d14 ee4971c 8254d14 e8bc83e 1f19bff aa6d2bc 8254d14 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 |
---
license: mit
---
Classifies locution based on their illocutionary force intents:
"0": "Agreeing",
"1": "Arguing",
"2": "Asserting",
"3": "Assertive Questioning",
"4": "Challenging",
"5": "Default Illocuting",
"6": "Disagreeing",
"7": "Pure Questioning",
"8": "Restating",
"9": "Rhetorical Questioning"
F1_macro - 0.55
F1_weighted - 0.67
Accuracy - 0.67
Dataset:
MM2012 - https://corpora.aifdb.org/mm2012
MM123 - https://corpora.aifdb.org/mm123
QT30 - https://corpora.aifdb.org/qt30
US2016 - https://corpora.aifdb.org/US2016
| | precision | recall | f1-score | support |
|------------------------|-----------|--------|----------|---------|
| Agreeing | 0.63 | 0.67 | 0.65 | 18 |
| Arguing | 0.67 | 0.40 | 0.50 | 5 |
| Asserting | 0.79 | 0.89 | 0.84 | 200 |
| Assertive Questioning | 0.52 | 0.44 | 0.48 | 124 |
| Challenging | 0.48 | 0.42 | 0.44 | 24 |
| Default Illocuting | 1.00 | 0.07 | 0.13 | 14 |
| Disagreeing | 0.33 | 0.40 | 0.36 | 5 |
| Pure Questioning | 0.75 | 0.76 | 0.76 | 293 |
| Restating | 1.00 | 1.00 | 1.00 | 2 |
| Rhetorical Questioning | 0.36 | 0.40 | 0.38 | 81 |
| | | | | |
|------------------------|-----------|--------|----------|---------|
| accuracy | | | 0.67 | 766 |
| macro avg | 0.65 | 0.54 | 0.55 | 766 |
| weighted avg | 0.67 | 0.67 | 0.67 | 766 |
|