Hugging Face's logo

sjrhuschlee
/
deberta-v3-base-squad2

Question Answering
Transformers
PyTorch
TensorFlow
Safetensors
English
deberta-v2
deberta
deberta-v3
squad
squad_v2
Eval Results
Inference Endpoints
Model card Files Community
1
sjrhuschlee commited on
Commit
25770ce
•
1 Parent(s): a3e980a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +37 -37
README.md CHANGED
@@ -44,7 +44,7 @@ model-index:
44
  value: 87.862
45
  name: Exact Match
46
  - type: f1
47
- value: 93.924
48
  name: F1
49
  - task:
50
  type: question-answering
@@ -55,12 +55,12 @@ model-index:
55
  config: adversarialQA
56
  split: validation
57
  metrics:
58
- - type: exact_match
59
- value: 24.633
60
- name: Exact Match
61
- - type: f1
62
- value: 34.011
63
- name: F1
64
  - task:
65
  type: question-answering
66
  name: Question Answering
@@ -71,71 +71,71 @@ model-index:
71
  split: validation
72
  metrics:
73
  - type: exact_match
74
- value: 73.027
75
  name: Exact Match
76
  - type: f1
77
- value: 77.432
78
  name: F1
79
  - task:
80
  type: question-answering
81
  name: Question Answering
82
  dataset:
83
- name: squadshifts
84
  type: squadshifts
85
  config: amazon
86
  split: test
87
  metrics:
88
- - type: exact_match
89
- value: 64.320
90
- name: Exact Match
91
- - type: f1
92
- value: 75.584
93
- name: F1
94
  - task:
95
  type: question-answering
96
  name: Question Answering
97
  dataset:
98
- name: squadshifts
99
  type: squadshifts
100
  config: new_wiki
101
  split: test
102
  metrics:
103
- - type: exact_match
104
- value: 79.315
105
- name: Exact Match
106
- - type: f1
107
- value: 87.498
108
- name: F1
109
  - task:
110
  type: question-answering
111
  name: Question Answering
112
  dataset:
113
- name: squadshifts
114
  type: squadshifts
115
  config: nyt
116
  split: test
117
  metrics:
118
- - type: exact_match
119
- value: 81.162
120
- name: Exact Match
121
- - type: f1
122
- value: 88.123
123
- name: F1
124
  - task:
125
  type: question-answering
126
  name: Question Answering
127
  dataset:
128
- name: squadshifts
129
  type: squadshifts
130
  config: reddit
131
  split: test
132
  metrics:
133
- - type: exact_match
134
- value: 60.277
135
- name: Exact Match
136
- - type: f1
137
- value: 68.808
138
- name: F1
139
  ---
140
 
141
  # deberta-v3-base for Extractive QA
 
44
  value: 87.862
45
  name: Exact Match
46
  - type: f1
47
+ value: 93.905
48
  name: F1
49
  - task:
50
  type: question-answering
 
55
  config: adversarialQA
56
  split: validation
57
  metrics:
58
+ - type: exact_match
59
+ value: 34.367
60
+ name: Exact Match
61
+ - type: f1
62
+ value: 47.743
63
+ name: F1
64
  - task:
65
  type: question-answering
66
  name: Question Answering
 
71
  split: validation
72
  metrics:
73
  - type: exact_match
74
+ value: 82.597
75
  name: Exact Match
76
  - type: f1
77
+ value: 88.175
78
  name: F1
79
  - task:
80
  type: question-answering
81
  name: Question Answering
82
  dataset:
83
+ name: squadshifts amazon
84
  type: squadshifts
85
  config: amazon
86
  split: test
87
  metrics:
88
+ - type: exact_match
89
+ value: 73.080
90
+ name: Exact Match
91
+ - type: f1
92
+ value: 86.389
93
+ name: F1
94
  - task:
95
  type: question-answering
96
  name: Question Answering
97
  dataset:
98
+ name: squadshifts new_wiki
99
  type: squadshifts
100
  config: new_wiki
101
  split: test
102
  metrics:
103
+ - type: exact_match
104
+ value: 83.195
105
+ name: Exact Match
106
+ - type: f1
107
+ value: 92.178
108
+ name: F1
109
  - task:
110
  type: question-answering
111
  name: Question Answering
112
  dataset:
113
+ name: squadshifts nyt
114
  type: squadshifts
115
  config: nyt
116
  split: test
117
  metrics:
118
+ - type: exact_match
119
+ value: 84.839
120
+ name: Exact Match
121
+ - type: f1
122
+ value: 92.493
123
+ name: F1
124
  - task:
125
  type: question-answering
126
  name: Question Answering
127
  dataset:
128
+ name: squadshifts reddit
129
  type: squadshifts
130
  config: reddit
131
  split: test
132
  metrics:
133
+ - type: exact_match
134
+ value: 71.896
135
+ name: Exact Match
136
+ - type: f1
137
+ value: 83.122
138
+ name: F1
139
  ---
140
 
141
  # deberta-v3-base for Extractive QA