Hugging Face's logo

lmqg
/
mt5-small-itquad-qg-ae

Text2Text Generation
Transformers
PyTorch
Italian
mt5
question generation
answer extraction
Eval Results
Inference Endpoints
Model card Files Community
1
asahi417 commited on
Commit
673aa23
·
1 Parent(s): 0a87ca6

model update

Browse files
Files changed (1) hide show
  1. README.md +7 -7
README.md CHANGED
@@ -53,22 +53,22 @@ model-index:
53
  value: 0.5662580131358668
54
  - name: QAAlignedF1Score (BERTScore)
55
  type: qa_aligned_f1_score_bertscore
56
- value: 0.8201168562166311
57
  - name: QAAlignedRecall (BERTScore)
58
  type: qa_aligned_recall_bertscore
59
- value: 0.8293064683621632
60
  - name: QAAlignedPrecision (BERTScore)
61
  type: qa_aligned_precision_bertscore
62
- value: 0.8115697991577736
63
  - name: QAAlignedF1Score (MoverScore)
64
  type: qa_aligned_f1_score_moverscore
65
- value: 0.5608720507831051
66
  - name: QAAlignedRecall (MoverScore)
67
  type: qa_aligned_recall_moverscore
68
- value: 0.5655273951343827
69
  - name: QAAlignedPrecision (MoverScore)
70
  type: qa_aligned_precision_moverscore
71
- value: 0.5567033660535845
72
  ---
73
 
74
  # Model Card of `lmqg/mt5-small-itquad-multitask`
@@ -141,7 +141,7 @@ question = pipe('generate question: <hl> Dopo il 1971 <hl> , l' OPEC ha tardato
141
 
142
  | Dataset | Type | QA Aligned F1 Score (BERTScore) | QA Aligned F1 Score (MoverScore) | Link |
143
  |:--------|:-----|--------------------------------:|---------------------------------:|-----:|
144
- | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) | default | 0.82 | 0.561 | [link](https://huggingface.co/lmqg/mt5-small-itquad-multitask/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qg_itquad.default.json) |
145
 
146
 
147
 
 
53
  value: 0.5662580131358668
54
  - name: QAAlignedF1Score (BERTScore)
55
  type: qa_aligned_f1_score_bertscore
56
+ value: 0.8181381118319444
57
  - name: QAAlignedRecall (BERTScore)
58
  type: qa_aligned_recall_bertscore
59
+ value: 0.8251302983425036
60
  - name: QAAlignedPrecision (BERTScore)
61
  type: qa_aligned_precision_bertscore
62
+ value: 0.8117152577788601
63
  - name: QAAlignedF1Score (MoverScore)
64
  type: qa_aligned_f1_score_moverscore
65
+ value: 0.5602399541685288
66
  - name: QAAlignedRecall (MoverScore)
67
  type: qa_aligned_recall_moverscore
68
+ value: 0.5632266676286006
69
  - name: QAAlignedPrecision (MoverScore)
70
  type: qa_aligned_precision_moverscore
71
+ value: 0.5576476898045706
72
  ---
73
 
74
  # Model Card of `lmqg/mt5-small-itquad-multitask`
 
141
 
142
  | Dataset | Type | QA Aligned F1 Score (BERTScore) | QA Aligned F1 Score (MoverScore) | Link |
143
  |:--------|:-----|--------------------------------:|---------------------------------:|-----:|
144
+ | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) | default | 0.818 | 0.56 | [link](https://huggingface.co/lmqg/mt5-small-itquad-multitask/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qg_itquad.default.json) |
145
 
146
 
147