Dataset Size: 204416 Examples from squadv2 and NQ dataset | |
Trained for 1 epoch on TPU | |
Accuracy on Squadv2 dev | |
{'exact': 80.2998399730481, | |
'f1': 83.4402145786235, | |
'total': 11873, | |
'HasAns_exact': 79.08232118758434, | |
'HasAns_f1': 85.37207619635592, | |
'HasAns_total': 5928, | |
'NoAns_exact': 81.5138772077376, | |
'NoAns_f1': 81.5138772077376, | |
'NoAns_total': 5945, | |
'best_exact': 80.2998399730481, | |
'best_exact_thresh': 0.0, | |
'best_f1': 83.44021457862335, | |
'best_f1_thresh': 0.0} |