Hugging Face's logo

improz4
/
model

Fill-Mask
Transformers
PyTorch
bert
Generated from Trainer
Model card Files
xet
Community
1
improz4 commited on
Commit
71bc267
·
1 Parent(s): cadf791

MyLogBert

Browse files
Files changed (2) hide show
  1. README.md +154 -0
  2. generation_config.json +5 -0
README.md ADDED
@@ -0,0 +1,154 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - generated_from_trainer
4
+ model-index:
5
+ - name: model
6
+ results: []
7
+ ---
8
+
9
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
10
+ should probably proofread and complete it, then remove this comment. -->
11
+
12
+ # model
13
+
14
+ This model is a fine-tuned version of [](https://huggingface.co/) on the None dataset.
15
+ It achieves the following results on the evaluation set:
16
+ - Loss: 0.1795
17
+
18
+ ## Model description
19
+
20
+ More information needed
21
+
22
+ ## Intended uses & limitations
23
+
24
+ More information needed
25
+
26
+ ## Training and evaluation data
27
+
28
+ More information needed
29
+
30
+ ## Training procedure
31
+
32
+ ### Training hyperparameters
33
+
34
+ The following hyperparameters were used during training:
35
+ - learning_rate: 0.001
36
+ - train_batch_size: 32
37
+ - eval_batch_size: 32
38
+ - seed: 42
39
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
+ - lr_scheduler_type: linear
41
+ - num_epochs: 100
42
+
43
+ ### Training results
44
+
45
+ | Training Loss | Epoch | Step | Validation Loss |
46
+ |:-------------:|:-----:|:-----:|:---------------:|
47
+ | 0.639 | 1.0 | 125 | 0.3439 |
48
+ | 0.365 | 2.0 | 250 | 0.2767 |
49
+ | 0.3371 | 3.0 | 375 | 0.2818 |
50
+ | 0.3215 | 4.0 | 500 | 0.2573 |
51
+ | 0.2982 | 5.0 | 625 | 0.2449 |
52
+ | 0.2912 | 6.0 | 750 | 0.2377 |
53
+ | 0.2886 | 7.0 | 875 | 0.2535 |
54
+ | 0.2853 | 8.0 | 1000 | 0.2426 |
55
+ | 0.2814 | 9.0 | 1125 | 0.2532 |
56
+ | 0.272 | 10.0 | 1250 | 0.2322 |
57
+ | 0.2774 | 11.0 | 1375 | 0.2395 |
58
+ | 0.2692 | 12.0 | 1500 | 0.2360 |
59
+ | 0.2633 | 13.0 | 1625 | 0.2373 |
60
+ | 0.256 | 14.0 | 1750 | 0.2400 |
61
+ | 0.2512 | 15.0 | 1875 | 0.2082 |
62
+ | 0.2502 | 16.0 | 2000 | 0.2222 |
63
+ | 0.2573 | 17.0 | 2125 | 0.2183 |
64
+ | 0.2493 | 18.0 | 2250 | 0.2073 |
65
+ | 0.2562 | 19.0 | 2375 | 0.2220 |
66
+ | 0.2462 | 20.0 | 2500 | 0.2305 |
67
+ | 0.2495 | 21.0 | 2625 | 0.2098 |
68
+ | 0.2486 | 22.0 | 2750 | 0.2149 |
69
+ | 0.2493 | 23.0 | 2875 | 0.2193 |
70
+ | 0.237 | 24.0 | 3000 | 0.2148 |
71
+ | 0.2421 | 25.0 | 3125 | 0.2141 |
72
+ | 0.2391 | 26.0 | 3250 | 0.2252 |
73
+ | 0.2463 | 27.0 | 3375 | 0.2304 |
74
+ | 0.238 | 28.0 | 3500 | 0.2062 |
75
+ | 0.2346 | 29.0 | 3625 | 0.2111 |
76
+ | 0.235 | 30.0 | 3750 | 0.2055 |
77
+ | 0.2316 | 31.0 | 3875 | 0.2091 |
78
+ | 0.2385 | 32.0 | 4000 | 0.2135 |
79
+ | 0.2296 | 33.0 | 4125 | 0.2124 |
80
+ | 0.225 | 34.0 | 4250 | 0.2078 |
81
+ | 0.2343 | 35.0 | 4375 | 0.2069 |
82
+ | 0.2252 | 36.0 | 4500 | 0.2068 |
83
+ | 0.2279 | 37.0 | 4625 | 0.2187 |
84
+ | 0.223 | 38.0 | 4750 | 0.1986 |
85
+ | 0.2255 | 39.0 | 4875 | 0.1970 |
86
+ | 0.2261 | 40.0 | 5000 | 0.1994 |
87
+ | 0.2203 | 41.0 | 5125 | 0.2056 |
88
+ | 0.2223 | 42.0 | 5250 | 0.1934 |
89
+ | 0.2259 | 43.0 | 5375 | 0.2028 |
90
+ | 0.2103 | 44.0 | 5500 | 0.2020 |
91
+ | 0.2199 | 45.0 | 5625 | 0.1959 |
92
+ | 0.2211 | 46.0 | 5750 | 0.2017 |
93
+ | 0.2235 | 47.0 | 5875 | 0.1948 |
94
+ | 0.2145 | 48.0 | 6000 | 0.2015 |
95
+ | 0.2116 | 49.0 | 6125 | 0.2114 |
96
+ | 0.216 | 50.0 | 6250 | 0.1966 |
97
+ | 0.216 | 51.0 | 6375 | 0.2107 |
98
+ | 0.2121 | 52.0 | 6500 | 0.1939 |
99
+ | 0.2099 | 53.0 | 6625 | 0.2167 |
100
+ | 0.2069 | 54.0 | 6750 | 0.1909 |
101
+ | 0.2129 | 55.0 | 6875 | 0.2070 |
102
+ | 0.2105 | 56.0 | 7000 | 0.1927 |
103
+ | 0.2092 | 57.0 | 7125 | 0.1957 |
104
+ | 0.2043 | 58.0 | 7250 | 0.2064 |
105
+ | 0.2072 | 59.0 | 7375 | 0.1915 |
106
+ | 0.2069 | 60.0 | 7500 | 0.1972 |
107
+ | 0.2009 | 61.0 | 7625 | 0.1977 |
108
+ | 0.2001 | 62.0 | 7750 | 0.1853 |
109
+ | 0.2058 | 63.0 | 7875 | 0.1976 |
110
+ | 0.1944 | 64.0 | 8000 | 0.1887 |
111
+ | 0.1985 | 65.0 | 8125 | 0.1932 |
112
+ | 0.2061 | 66.0 | 8250 | 0.1924 |
113
+ | 0.2028 | 67.0 | 8375 | 0.1888 |
114
+ | 0.2016 | 68.0 | 8500 | 0.1967 |
115
+ | 0.2 | 69.0 | 8625 | 0.1983 |
116
+ | 0.201 | 70.0 | 8750 | 0.1862 |
117
+ | 0.1975 | 71.0 | 8875 | 0.1943 |
118
+ | 0.2035 | 72.0 | 9000 | 0.1856 |
119
+ | 0.2008 | 73.0 | 9125 | 0.1957 |
120
+ | 0.1966 | 74.0 | 9250 | 0.1843 |
121
+ | 0.1945 | 75.0 | 9375 | 0.1864 |
122
+ | 0.1989 | 76.0 | 9500 | 0.1876 |
123
+ | 0.195 | 77.0 | 9625 | 0.1867 |
124
+ | 0.1984 | 78.0 | 9750 | 0.2041 |
125
+ | 0.1974 | 79.0 | 9875 | 0.1996 |
126
+ | 0.1918 | 80.0 | 10000 | 0.1694 |
127
+ | 0.1959 | 81.0 | 10125 | 0.1780 |
128
+ | 0.1965 | 82.0 | 10250 | 0.1738 |
129
+ | 0.1917 | 83.0 | 10375 | 0.2058 |
130
+ | 0.1911 | 84.0 | 10500 | 0.1806 |
131
+ | 0.1905 | 85.0 | 10625 | 0.1852 |
132
+ | 0.1934 | 86.0 | 10750 | 0.1765 |
133
+ | 0.1874 | 87.0 | 10875 | 0.1858 |
134
+ | 0.1921 | 88.0 | 11000 | 0.1790 |
135
+ | 0.1883 | 89.0 | 11125 | 0.1933 |
136
+ | 0.1854 | 90.0 | 11250 | 0.1785 |
137
+ | 0.189 | 91.0 | 11375 | 0.1849 |
138
+ | 0.1873 | 92.0 | 11500 | 0.1880 |
139
+ | 0.1866 | 93.0 | 11625 | 0.1758 |
140
+ | 0.1909 | 94.0 | 11750 | 0.1783 |
141
+ | 0.1821 | 95.0 | 11875 | 0.1936 |
142
+ | 0.1868 | 96.0 | 12000 | 0.1954 |
143
+ | 0.1846 | 97.0 | 12125 | 0.1793 |
144
+ | 0.1847 | 98.0 | 12250 | 0.1866 |
145
+ | 0.1877 | 99.0 | 12375 | 0.1677 |
146
+ | 0.1845 | 100.0 | 12500 | 0.1718 |
147
+
148
+
149
+ ### Framework versions
150
+
151
+ - Transformers 4.33.2
152
+ - Pytorch 2.0.1+cu118
153
+ - Datasets 2.14.5
154
+ - Tokenizers 0.13.3
generation_config.json ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "pad_token_id": 0,
4
+ "transformers_version": "4.33.2"
5
+ }