Dataset Size: 204416 Examples from squadv2 and NQ dataset | |
Trained for 1 epoch on TPU | |
Accuracy on Squadv2 dev | |
{'exact': 76.2402088772846, | |
'f1': 79.42257205291492, | |
'total': 11873, | |
'HasAns_exact': 79.97638326585695, | |
'HasAns_f1': 86.35023582730433, | |
'HasAns_total': 5928, | |
'NoAns_exact': 72.51471825063078, | |
'NoAns_f1': 72.51471825063078, | |
'NoAns_total': 5945, | |
'best_exact': 76.2402088772846, | |
'best_exact_thresh': 0.0, | |
'best_f1': 79.42257205291494, | |
'best_f1_thresh': 0.0} |