lewtun HF staff commited on
Commit
641a113
·
1 Parent(s): 827f854

Add evaluation results on banking77 dataset

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the [banking77](https://huggingface.co/datasets/banking77) dataset by

@lewtun
, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-project-f87a1758-7384796).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=banking77).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=banking77).

Files changed (1) hide show
  1. README.md +57 -1
README.md CHANGED
@@ -7,7 +7,63 @@ tags:
7
  datasets:
8
  - banking77
9
  widget:
10
- - text: "How long until my transfer goes through?"
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
11
  ---
12
  # distilroberta-base fine-tuned on banking77 dataset for intent classification
13
  Test set accuray: 0.896
 
7
  datasets:
8
  - banking77
9
  widget:
10
+ - text: How long until my transfer goes through?
11
+ model-index:
12
+ - name: mrm8488/distilroberta-finetuned-banking77
13
+ results:
14
+ - task:
15
+ type: text-classification
16
+ name: Text Classification
17
+ dataset:
18
+ name: banking77
19
+ type: banking77
20
+ config: default
21
+ split: test
22
+ metrics:
23
+ - name: Accuracy
24
+ type: accuracy
25
+ value: 0.8961038961038961
26
+ verified: true
27
+ - name: Precision Macro
28
+ type: precision
29
+ value: 0.9063619413451185
30
+ verified: true
31
+ - name: Precision Micro
32
+ type: precision
33
+ value: 0.8961038961038961
34
+ verified: true
35
+ - name: Precision Weighted
36
+ type: precision
37
+ value: 0.906361941345118
38
+ verified: true
39
+ - name: Recall Macro
40
+ type: recall
41
+ value: 0.8961038961038963
42
+ verified: true
43
+ - name: Recall Micro
44
+ type: recall
45
+ value: 0.8961038961038961
46
+ verified: true
47
+ - name: Recall Weighted
48
+ type: recall
49
+ value: 0.8961038961038961
50
+ verified: true
51
+ - name: F1 Macro
52
+ type: f1
53
+ value: 0.8914970725184695
54
+ verified: true
55
+ - name: F1 Micro
56
+ type: f1
57
+ value: 0.8961038961038962
58
+ verified: true
59
+ - name: F1 Weighted
60
+ type: f1
61
+ value: 0.8914970725184699
62
+ verified: true
63
+ - name: loss
64
+ type: loss
65
+ value: 0.5607758164405823
66
+ verified: true
67
  ---
68
  # distilroberta-base fine-tuned on banking77 dataset for intent classification
69
  Test set accuray: 0.896