sjrhuschlee commited on
Commit
a3e980a
1 Parent(s): 103e5be

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +90 -0
README.md CHANGED
@@ -46,6 +46,96 @@ model-index:
46
  - type: f1
47
  value: 93.924
48
  name: F1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
49
  ---
50
 
51
  # deberta-v3-base for Extractive QA
 
46
  - type: f1
47
  value: 93.924
48
  name: F1
49
+ - task:
50
+ type: question-answering
51
+ name: Question Answering
52
+ dataset:
53
+ name: adversarial_qa
54
+ type: adversarial_qa
55
+ config: adversarialQA
56
+ split: validation
57
+ metrics:
58
+ - type: exact_match
59
+ value: 24.633
60
+ name: Exact Match
61
+ - type: f1
62
+ value: 34.011
63
+ name: F1
64
+ - task:
65
+ type: question-answering
66
+ name: Question Answering
67
+ dataset:
68
+ name: squad_adversarial
69
+ type: squad_adversarial
70
+ config: AddOneSent
71
+ split: validation
72
+ metrics:
73
+ - type: exact_match
74
+ value: 73.027
75
+ name: Exact Match
76
+ - type: f1
77
+ value: 77.432
78
+ name: F1
79
+ - task:
80
+ type: question-answering
81
+ name: Question Answering
82
+ dataset:
83
+ name: squadshifts
84
+ type: squadshifts
85
+ config: amazon
86
+ split: test
87
+ metrics:
88
+ - type: exact_match
89
+ value: 64.320
90
+ name: Exact Match
91
+ - type: f1
92
+ value: 75.584
93
+ name: F1
94
+ - task:
95
+ type: question-answering
96
+ name: Question Answering
97
+ dataset:
98
+ name: squadshifts
99
+ type: squadshifts
100
+ config: new_wiki
101
+ split: test
102
+ metrics:
103
+ - type: exact_match
104
+ value: 79.315
105
+ name: Exact Match
106
+ - type: f1
107
+ value: 87.498
108
+ name: F1
109
+ - task:
110
+ type: question-answering
111
+ name: Question Answering
112
+ dataset:
113
+ name: squadshifts
114
+ type: squadshifts
115
+ config: nyt
116
+ split: test
117
+ metrics:
118
+ - type: exact_match
119
+ value: 81.162
120
+ name: Exact Match
121
+ - type: f1
122
+ value: 88.123
123
+ name: F1
124
+ - task:
125
+ type: question-answering
126
+ name: Question Answering
127
+ dataset:
128
+ name: squadshifts
129
+ type: squadshifts
130
+ config: reddit
131
+ split: test
132
+ metrics:
133
+ - type: exact_match
134
+ value: 60.277
135
+ name: Exact Match
136
+ - type: f1
137
+ value: 68.808
138
+ name: F1
139
  ---
140
 
141
  # deberta-v3-base for Extractive QA