mt5-small-itquad-qg-ae / eval /metric.first.answer.paragraph.questions_answers.lmqg_qg_itquad.default.json
asahi417's picture
add model
0a87ca6
raw
history blame
659 Bytes
{"test": {"QAAlignedF1Score (BERTScore)": 0.8181381118319444, "QAAlignedF1Score (MoverScore)": 0.5602399541685288, "QAAlignedRecall (BERTScore)": 0.8251302983425036, "QAAlignedPrecision (BERTScore)": 0.8117152577788601, "QAAlignedRecall (MoverScore)": 0.5632266676286006, "QAAlignedPrecision (MoverScore)": 0.5576476898045706}, "validation": {"QAAlignedF1Score (BERTScore)": 0.808018132044897, "QAAlignedF1Score (MoverScore)": 0.5529970356002839, "QAAlignedRecall (BERTScore)": 0.8337714235558947, "QAAlignedPrecision (BERTScore)": 0.7844637542451787, "QAAlignedRecall (MoverScore)": 0.5703996580099424, "QAAlignedPrecision (MoverScore)": 0.5375445209352104}}