devpranjal/deberta-v3-base-devrev-data model
This model is based on microsoft/deberta-v3-base pretrained model.
Model Recycling
Evaluation on 36 datasets using devpranjal/deberta-v3-base-devrev-data as a base model yields average score of 79.58 in comparison to 79.04 by microsoft/deberta-v3-base.
The model is ranked 3rd among all tested models for the microsoft/deberta-v3-base architecture as of 07/02/2023 Results:
| 20_newsgroup | ag_news | amazon_reviews_multi | anli | boolq | cb | cola | copa | dbpedia | esnli | financial_phrasebank | imdb | isear | mnli | mrpc | multirc | poem_sentiment | qnli | qqp | rotten_tomatoes | rte | sst2 | sst_5bins | stsb | trec_coarse | trec_fine | tweet_ev_emoji | tweet_ev_emotion | tweet_ev_hate | tweet_ev_irony | tweet_ev_offensive | tweet_ev_sentiment | wic | wnli | wsc | yahoo_answers |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 85.4886 | 89.9333 | 66.72 | 58.1875 | 85.2599 | 80.3571 | 86.2895 | 70 | 79.0333 | 91.1849 | 87.7 | 94.012 | 71.2516 | 89.4833 | 89.951 | 63.6345 | 83.6538 | 93.8129 | 92.0257 | 90.2439 | 84.1155 | 94.7248 | 57.6471 | 91.4423 | 97.2 | 91.4 | 46.374 | 83.2512 | 57.6768 | 77.4235 | 85.9302 | 70.9297 | 70.8464 | 71.831 | 63.4615 | 72.5 |
For more information, see: Model Recycling