update model card README.md
Browse files
README.md
ADDED
@@ -0,0 +1,195 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
tags:
|
4 |
+
- generated_from_trainer
|
5 |
+
metrics:
|
6 |
+
- accuracy
|
7 |
+
model-index:
|
8 |
+
- name: modeversion2_m7_e8
|
9 |
+
results: []
|
10 |
+
---
|
11 |
+
|
12 |
+
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
13 |
+
should probably proofread and complete it, then remove this comment. -->
|
14 |
+
|
15 |
+
# modeversion2_m7_e8
|
16 |
+
|
17 |
+
This model is a fine-tuned version of [google/vit-base-patch16-224-in21k](https://huggingface.co/google/vit-base-patch16-224-in21k) on the None dataset.
|
18 |
+
It achieves the following results on the evaluation set:
|
19 |
+
- Loss: 0.1060
|
20 |
+
- Accuracy: 0.9761
|
21 |
+
|
22 |
+
## Model description
|
23 |
+
|
24 |
+
More information needed
|
25 |
+
|
26 |
+
## Intended uses & limitations
|
27 |
+
|
28 |
+
More information needed
|
29 |
+
|
30 |
+
## Training and evaluation data
|
31 |
+
|
32 |
+
More information needed
|
33 |
+
|
34 |
+
## Training procedure
|
35 |
+
|
36 |
+
### Training hyperparameters
|
37 |
+
|
38 |
+
The following hyperparameters were used during training:
|
39 |
+
- learning_rate: 0.0002
|
40 |
+
- train_batch_size: 16
|
41 |
+
- eval_batch_size: 8
|
42 |
+
- seed: 42
|
43 |
+
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
44 |
+
- lr_scheduler_type: linear
|
45 |
+
- num_epochs: 8
|
46 |
+
- mixed_precision_training: Native AMP
|
47 |
+
|
48 |
+
### Training results
|
49 |
+
|
50 |
+
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|
51 |
+
|:-------------:|:-----:|:-----:|:---------------:|:--------:|
|
52 |
+
| 4.0231 | 0.06 | 100 | 3.8568 | 0.1883 |
|
53 |
+
| 3.3863 | 0.12 | 200 | 3.2510 | 0.2596 |
|
54 |
+
| 2.6187 | 0.18 | 300 | 2.6243 | 0.3882 |
|
55 |
+
| 2.3097 | 0.23 | 400 | 2.2189 | 0.4527 |
|
56 |
+
| 1.9016 | 0.29 | 500 | 1.9495 | 0.5244 |
|
57 |
+
| 1.7478 | 0.35 | 600 | 1.6609 | 0.6091 |
|
58 |
+
| 1.2345 | 0.41 | 700 | 1.4335 | 0.6426 |
|
59 |
+
| 1.4129 | 0.47 | 800 | 1.3001 | 0.6752 |
|
60 |
+
| 1.1722 | 0.53 | 900 | 1.2030 | 0.6785 |
|
61 |
+
| 1.0808 | 0.59 | 1000 | 1.0051 | 0.7273 |
|
62 |
+
| 0.8814 | 0.64 | 1100 | 1.0715 | 0.7063 |
|
63 |
+
| 0.9831 | 0.7 | 1200 | 0.9283 | 0.7334 |
|
64 |
+
| 0.8118 | 0.76 | 1300 | 0.8525 | 0.7631 |
|
65 |
+
| 0.7203 | 0.82 | 1400 | 0.7849 | 0.7756 |
|
66 |
+
| 0.8881 | 0.88 | 1500 | 0.8786 | 0.7487 |
|
67 |
+
| 0.6407 | 0.94 | 1600 | 0.6896 | 0.8000 |
|
68 |
+
| 0.7574 | 1.0 | 1700 | 0.7314 | 0.7754 |
|
69 |
+
| 0.6063 | 1.06 | 1800 | 0.6312 | 0.8068 |
|
70 |
+
| 0.4797 | 1.11 | 1900 | 0.5792 | 0.8296 |
|
71 |
+
| 0.4973 | 1.17 | 2000 | 0.5846 | 0.8221 |
|
72 |
+
| 0.4432 | 1.23 | 2100 | 0.7057 | 0.7905 |
|
73 |
+
| 0.5518 | 1.29 | 2200 | 0.5621 | 0.8304 |
|
74 |
+
| 0.3256 | 1.35 | 2300 | 0.5890 | 0.8143 |
|
75 |
+
| 0.4284 | 1.41 | 2400 | 0.5204 | 0.8485 |
|
76 |
+
| 0.3702 | 1.47 | 2500 | 0.5699 | 0.8256 |
|
77 |
+
| 0.2858 | 1.52 | 2600 | 0.5815 | 0.8287 |
|
78 |
+
| 0.3706 | 1.58 | 2700 | 0.4615 | 0.8571 |
|
79 |
+
| 0.3484 | 1.64 | 2800 | 0.4812 | 0.8518 |
|
80 |
+
| 0.2865 | 1.7 | 2900 | 0.4285 | 0.8638 |
|
81 |
+
| 0.4474 | 1.76 | 3000 | 0.5217 | 0.8377 |
|
82 |
+
| 0.2101 | 1.82 | 3100 | 0.4478 | 0.8589 |
|
83 |
+
| 0.3545 | 1.88 | 3200 | 0.4444 | 0.8612 |
|
84 |
+
| 0.2728 | 1.93 | 3300 | 0.4213 | 0.8645 |
|
85 |
+
| 0.3525 | 1.99 | 3400 | 0.3551 | 0.8848 |
|
86 |
+
| 0.0936 | 2.05 | 3500 | 0.4074 | 0.8748 |
|
87 |
+
| 0.2118 | 2.11 | 3600 | 0.4089 | 0.8812 |
|
88 |
+
| 0.2744 | 2.17 | 3700 | 0.3534 | 0.8894 |
|
89 |
+
| 0.211 | 2.23 | 3800 | 0.4422 | 0.8599 |
|
90 |
+
| 0.1684 | 2.29 | 3900 | 0.3705 | 0.8858 |
|
91 |
+
| 0.1885 | 2.34 | 4000 | 0.3651 | 0.8862 |
|
92 |
+
| 0.249 | 2.4 | 4100 | 0.4234 | 0.8687 |
|
93 |
+
| 0.1485 | 2.46 | 4200 | 0.3784 | 0.8798 |
|
94 |
+
| 0.1188 | 2.52 | 4300 | 0.3589 | 0.8873 |
|
95 |
+
| 0.1274 | 2.58 | 4400 | 0.3570 | 0.8917 |
|
96 |
+
| 0.2206 | 2.64 | 4500 | 0.3377 | 0.8920 |
|
97 |
+
| 0.1287 | 2.7 | 4600 | 0.3170 | 0.9023 |
|
98 |
+
| 0.1805 | 2.75 | 4700 | 0.3469 | 0.8934 |
|
99 |
+
| 0.1505 | 2.81 | 4800 | 0.4258 | 0.8757 |
|
100 |
+
| 0.1592 | 2.87 | 4900 | 0.3415 | 0.8948 |
|
101 |
+
| 0.1297 | 2.93 | 5000 | 0.3168 | 0.9028 |
|
102 |
+
| 0.1284 | 2.99 | 5100 | 0.3060 | 0.9089 |
|
103 |
+
| 0.0833 | 3.05 | 5200 | 0.2610 | 0.9207 |
|
104 |
+
| 0.0334 | 3.11 | 5300 | 0.2766 | 0.9197 |
|
105 |
+
| 0.0847 | 3.17 | 5400 | 0.3366 | 0.9016 |
|
106 |
+
| 0.1112 | 3.22 | 5500 | 0.3098 | 0.9079 |
|
107 |
+
| 0.0477 | 3.28 | 5600 | 0.3385 | 0.9041 |
|
108 |
+
| 0.0419 | 3.34 | 5700 | 0.2944 | 0.9139 |
|
109 |
+
| 0.0827 | 3.4 | 5800 | 0.2715 | 0.9239 |
|
110 |
+
| 0.0659 | 3.46 | 5900 | 0.2695 | 0.9230 |
|
111 |
+
| 0.0244 | 3.52 | 6000 | 0.3050 | 0.9147 |
|
112 |
+
| 0.0883 | 3.58 | 6100 | 0.2862 | 0.9203 |
|
113 |
+
| 0.0527 | 3.63 | 6200 | 0.2383 | 0.9319 |
|
114 |
+
| 0.0828 | 3.69 | 6300 | 0.2984 | 0.9182 |
|
115 |
+
| 0.0678 | 3.75 | 6400 | 0.2135 | 0.9436 |
|
116 |
+
| 0.0492 | 3.81 | 6500 | 0.2605 | 0.9296 |
|
117 |
+
| 0.0374 | 3.87 | 6600 | 0.2192 | 0.9380 |
|
118 |
+
| 0.1846 | 3.93 | 6700 | 0.2804 | 0.9187 |
|
119 |
+
| 0.0557 | 3.99 | 6800 | 0.2599 | 0.9253 |
|
120 |
+
| 0.0127 | 4.04 | 6900 | 0.2412 | 0.9336 |
|
121 |
+
| 0.0203 | 4.1 | 7000 | 0.2214 | 0.9415 |
|
122 |
+
| 0.0272 | 4.16 | 7100 | 0.2322 | 0.9356 |
|
123 |
+
| 0.066 | 4.22 | 7200 | 0.2643 | 0.9325 |
|
124 |
+
| 0.0628 | 4.28 | 7300 | 0.2170 | 0.9406 |
|
125 |
+
| 0.0108 | 4.34 | 7400 | 0.2388 | 0.9405 |
|
126 |
+
| 0.026 | 4.4 | 7500 | 0.2533 | 0.9372 |
|
127 |
+
| 0.0401 | 4.45 | 7600 | 0.2407 | 0.9358 |
|
128 |
+
| 0.0493 | 4.51 | 7700 | 0.2213 | 0.9415 |
|
129 |
+
| 0.0951 | 4.57 | 7800 | 0.3016 | 0.9237 |
|
130 |
+
| 0.0017 | 4.63 | 7900 | 0.2183 | 0.9448 |
|
131 |
+
| 0.0561 | 4.69 | 8000 | 0.1962 | 0.9492 |
|
132 |
+
| 0.0063 | 4.75 | 8100 | 0.1868 | 0.9522 |
|
133 |
+
| 0.0054 | 4.81 | 8200 | 0.2068 | 0.9459 |
|
134 |
+
| 0.0519 | 4.87 | 8300 | 0.2141 | 0.9429 |
|
135 |
+
| 0.027 | 4.92 | 8400 | 0.2138 | 0.9438 |
|
136 |
+
| 0.0034 | 4.98 | 8500 | 0.1774 | 0.9529 |
|
137 |
+
| 0.0096 | 5.04 | 8600 | 0.1778 | 0.9512 |
|
138 |
+
| 0.0011 | 5.1 | 8700 | 0.1854 | 0.9512 |
|
139 |
+
| 0.0195 | 5.16 | 8800 | 0.1914 | 0.9483 |
|
140 |
+
| 0.0245 | 5.22 | 8900 | 0.2156 | 0.9471 |
|
141 |
+
| 0.0055 | 5.28 | 9000 | 0.1640 | 0.9574 |
|
142 |
+
| 0.0166 | 5.33 | 9100 | 0.1770 | 0.9568 |
|
143 |
+
| 0.0217 | 5.39 | 9200 | 0.2011 | 0.9479 |
|
144 |
+
| 0.0017 | 5.45 | 9300 | 0.2210 | 0.9462 |
|
145 |
+
| 0.0161 | 5.51 | 9400 | 0.1510 | 0.9621 |
|
146 |
+
| 0.0193 | 5.57 | 9500 | 0.1643 | 0.9586 |
|
147 |
+
| 0.0121 | 5.63 | 9600 | 0.1716 | 0.9535 |
|
148 |
+
| 0.0146 | 5.69 | 9700 | 0.1720 | 0.9554 |
|
149 |
+
| 0.0071 | 5.74 | 9800 | 0.1831 | 0.9541 |
|
150 |
+
| 0.0018 | 5.8 | 9900 | 0.2076 | 0.9485 |
|
151 |
+
| 0.0007 | 5.86 | 10000 | 0.1636 | 0.9599 |
|
152 |
+
| 0.0005 | 5.92 | 10100 | 0.1625 | 0.9602 |
|
153 |
+
| 0.0277 | 5.98 | 10200 | 0.1874 | 0.9546 |
|
154 |
+
| 0.0005 | 6.04 | 10300 | 0.1790 | 0.9579 |
|
155 |
+
| 0.0012 | 6.1 | 10400 | 0.1840 | 0.9544 |
|
156 |
+
| 0.0431 | 6.15 | 10500 | 0.1571 | 0.9628 |
|
157 |
+
| 0.0332 | 6.21 | 10600 | 0.1599 | 0.9591 |
|
158 |
+
| 0.0014 | 6.27 | 10700 | 0.1493 | 0.9632 |
|
159 |
+
| 0.0014 | 6.33 | 10800 | 0.1366 | 0.9661 |
|
160 |
+
| 0.0006 | 6.39 | 10900 | 0.1582 | 0.9609 |
|
161 |
+
| 0.0005 | 6.45 | 11000 | 0.1704 | 0.9589 |
|
162 |
+
| 0.0004 | 6.51 | 11100 | 0.1376 | 0.9671 |
|
163 |
+
| 0.0755 | 6.57 | 11200 | 0.1375 | 0.9654 |
|
164 |
+
| 0.0002 | 6.62 | 11300 | 0.1361 | 0.9661 |
|
165 |
+
| 0.0006 | 6.68 | 11400 | 0.1323 | 0.9675 |
|
166 |
+
| 0.0009 | 6.74 | 11500 | 0.1239 | 0.9692 |
|
167 |
+
| 0.0004 | 6.8 | 11600 | 0.1514 | 0.9631 |
|
168 |
+
| 0.0002 | 6.86 | 11700 | 0.1386 | 0.9664 |
|
169 |
+
| 0.0004 | 6.92 | 11800 | 0.1368 | 0.9659 |
|
170 |
+
| 0.0004 | 6.98 | 11900 | 0.1276 | 0.9684 |
|
171 |
+
| 0.0002 | 7.03 | 12000 | 0.1171 | 0.9712 |
|
172 |
+
| 0.0002 | 7.09 | 12100 | 0.1142 | 0.9711 |
|
173 |
+
| 0.0001 | 7.15 | 12200 | 0.1183 | 0.9727 |
|
174 |
+
| 0.0002 | 7.21 | 12300 | 0.1167 | 0.9732 |
|
175 |
+
| 0.0002 | 7.27 | 12400 | 0.1143 | 0.9737 |
|
176 |
+
| 0.0001 | 7.33 | 12500 | 0.1129 | 0.9737 |
|
177 |
+
| 0.0002 | 7.39 | 12600 | 0.1116 | 0.9742 |
|
178 |
+
| 0.0002 | 7.44 | 12700 | 0.1126 | 0.9745 |
|
179 |
+
| 0.0002 | 7.5 | 12800 | 0.1111 | 0.9748 |
|
180 |
+
| 0.0002 | 7.56 | 12900 | 0.1102 | 0.9747 |
|
181 |
+
| 0.0001 | 7.62 | 13000 | 0.1094 | 0.9747 |
|
182 |
+
| 0.0001 | 7.68 | 13100 | 0.1086 | 0.9742 |
|
183 |
+
| 0.0001 | 7.74 | 13200 | 0.1079 | 0.9748 |
|
184 |
+
| 0.0002 | 7.8 | 13300 | 0.1062 | 0.9754 |
|
185 |
+
| 0.0002 | 7.85 | 13400 | 0.1068 | 0.9757 |
|
186 |
+
| 0.0001 | 7.91 | 13500 | 0.1061 | 0.9762 |
|
187 |
+
| 0.0001 | 7.97 | 13600 | 0.1060 | 0.9761 |
|
188 |
+
|
189 |
+
|
190 |
+
### Framework versions
|
191 |
+
|
192 |
+
- Transformers 4.20.1
|
193 |
+
- Pytorch 1.12.0
|
194 |
+
- Datasets 2.3.2
|
195 |
+
- Tokenizers 0.12.1
|