| 10/17/2023 16:59:41 - INFO - app - Distributed environment: NO | |
| Num processes: 1 | |
| Process index: 0 | |
| Local process index: 0 | |
| Device: cuda | |
| Mixed precision type: no | |
| 10/17/2023 16:59:46 - INFO - app - Num examples = 10 | |
| 10/17/2023 16:59:46 - INFO - app - Num batches each epoch = 5 | |
| 10/17/2023 16:59:46 - INFO - app - Num Epochs = 250 | |
| 10/17/2023 16:59:46 - INFO - app - Instantaneous batch size per device = 2 | |
| 10/17/2023 16:59:46 - INFO - app - Total train batch size (w. parallel, distributed & accumulation) = 4 | |
| 10/17/2023 16:59:46 - INFO - app - Gradient Accumulation steps = 2 | |
| 10/17/2023 16:59:46 - INFO - app - Training Steps = 750 | |
| 10/17/2023 16:59:46 - INFO - app - STEP = 1 | |
| 10/17/2023 16:59:49 - INFO - app - STEP = 2 | |
| 10/17/2023 16:59:50 - INFO - app - STEP = 3 | |
| 10/17/2023 16:59:51 - INFO - app - STEP = 4 | |
| 10/17/2023 16:59:51 - INFO - app - STEP = 5 | |
| 10/17/2023 16:59:52 - INFO - app - Running validation... | |
| Generating 4 images with prompt: A photo of sks dog. | |
| 10/17/2023 17:00:19 - INFO - app - STEP = 6 | |
| 10/17/2023 17:00:20 - INFO - app - STEP = 7 | |
| 10/17/2023 17:00:21 - INFO - app - STEP = 8 | |
| 10/17/2023 17:00:22 - INFO - app - STEP = 9 | |
| 10/17/2023 17:00:23 - INFO - app - STEP = 10 | |
| 10/17/2023 17:00:24 - INFO - app - STEP = 11 | |
| 10/17/2023 17:00:25 - INFO - app - STEP = 12 | |
| 10/17/2023 17:00:26 - INFO - app - STEP = 13 | |
| 10/17/2023 17:00:27 - INFO - app - STEP = 14 | |
| 10/17/2023 17:00:28 - INFO - app - STEP = 15 | |
| 10/17/2023 17:00:29 - INFO - app - STEP = 16 | |
| 10/17/2023 17:00:30 - INFO - app - STEP = 17 | |
| 10/17/2023 17:00:31 - INFO - app - STEP = 18 | |
| 10/17/2023 17:00:32 - INFO - app - STEP = 19 | |
| 10/17/2023 17:00:33 - INFO - app - STEP = 20 | |
| 10/17/2023 17:00:34 - INFO - app - STEP = 21 | |
| 10/17/2023 17:00:35 - INFO - app - STEP = 22 | |
| 10/17/2023 17:00:36 - INFO - app - STEP = 23 | |
| 10/17/2023 17:00:37 - INFO - app - STEP = 24 | |
| 10/17/2023 17:00:38 - INFO - app - STEP = 25 | |
| 10/17/2023 17:00:39 - INFO - app - STEP = 26 | |
| 10/17/2023 17:00:40 - INFO - app - STEP = 27 | |
| 10/17/2023 17:00:41 - INFO - app - STEP = 28 | |
| 10/17/2023 17:00:42 - INFO - app - STEP = 29 | |
| 10/17/2023 17:00:43 - INFO - app - STEP = 30 | |
| 10/17/2023 17:00:44 - INFO - app - STEP = 31 | |
| 10/17/2023 17:00:45 - INFO - app - STEP = 32 | |
| 10/17/2023 17:00:46 - INFO - app - STEP = 33 | |
| 10/17/2023 17:00:47 - INFO - app - STEP = 34 | |
| 10/17/2023 17:00:48 - INFO - app - STEP = 35 | |
| 10/17/2023 17:00:50 - INFO - app - STEP = 36 | |
| 10/17/2023 17:00:51 - INFO - app - STEP = 37 | |
| 10/17/2023 17:00:52 - INFO - app - STEP = 38 | |
| 10/17/2023 17:00:53 - INFO - app - STEP = 39 | |
| 10/17/2023 17:00:54 - INFO - app - STEP = 40 | |
| 10/17/2023 17:00:55 - INFO - app - STEP = 41 | |
| 10/17/2023 17:00:56 - INFO - app - STEP = 42 | |
| 10/17/2023 17:00:57 - INFO - app - STEP = 43 | |
| 10/17/2023 17:00:58 - INFO - app - STEP = 44 | |
| 10/17/2023 17:00:59 - INFO - app - STEP = 45 | |
| 10/17/2023 17:01:00 - INFO - app - STEP = 46 | |
| 10/17/2023 17:01:01 - INFO - app - STEP = 47 | |
| 10/17/2023 17:01:02 - INFO - app - STEP = 48 | |
| 10/17/2023 17:01:03 - INFO - app - STEP = 49 | |
| 10/17/2023 17:01:04 - INFO - app - STEP = 50 | |
| 10/17/2023 17:01:05 - INFO - app - STEP = 51 | |
| 10/17/2023 17:01:06 - INFO - app - STEP = 52 | |
| 10/17/2023 17:01:07 - INFO - app - STEP = 53 | |
| 10/17/2023 17:01:08 - INFO - app - STEP = 54 | |
| 10/17/2023 17:01:09 - INFO - app - STEP = 55 | |
| 10/17/2023 17:01:10 - INFO - app - STEP = 56 | |
| 10/17/2023 17:01:11 - INFO - app - STEP = 57 | |
| 10/17/2023 17:01:12 - INFO - app - STEP = 58 | |
| 10/17/2023 17:01:13 - INFO - app - STEP = 59 | |
| 10/17/2023 17:01:14 - INFO - app - STEP = 60 | |
| 10/17/2023 17:01:15 - INFO - app - STEP = 61 | |
| 10/17/2023 17:01:16 - INFO - app - STEP = 62 | |
| 10/17/2023 17:01:17 - INFO - app - STEP = 63 | |
| 10/17/2023 17:01:18 - INFO - app - STEP = 64 | |
| 10/17/2023 17:01:19 - INFO - app - STEP = 65 | |
| 10/17/2023 17:01:20 - INFO - app - STEP = 66 | |
| 10/17/2023 17:01:21 - INFO - app - STEP = 67 | |
| 10/17/2023 17:01:22 - INFO - app - STEP = 68 | |
| 10/17/2023 17:01:23 - INFO - app - STEP = 69 | |
| 10/17/2023 17:01:24 - INFO - app - STEP = 70 | |
| 10/17/2023 17:01:26 - INFO - app - STEP = 71 | |
| 10/17/2023 17:01:27 - INFO - app - STEP = 72 | |
| 10/17/2023 17:01:28 - INFO - app - STEP = 73 | |
| 10/17/2023 17:01:29 - INFO - app - STEP = 74 | |
| 10/17/2023 17:01:30 - INFO - app - STEP = 75 | |
| 10/17/2023 17:01:31 - INFO - app - STEP = 76 | |
| 10/17/2023 17:01:32 - INFO - app - STEP = 77 | |
| 10/17/2023 17:01:33 - INFO - app - STEP = 78 | |
| 10/17/2023 17:01:34 - INFO - app - STEP = 79 | |
| 10/17/2023 17:01:35 - INFO - app - STEP = 80 | |
| 10/17/2023 17:01:36 - INFO - app - STEP = 81 | |
| 10/17/2023 17:01:37 - INFO - app - STEP = 82 | |
| 10/17/2023 17:01:38 - INFO - app - STEP = 83 | |
| 10/17/2023 17:01:39 - INFO - app - STEP = 84 | |
| 10/17/2023 17:01:40 - INFO - app - STEP = 85 | |
| 10/17/2023 17:01:41 - INFO - app - STEP = 86 | |
| 10/17/2023 17:01:42 - INFO - app - STEP = 87 | |
| 10/17/2023 17:01:43 - INFO - app - STEP = 88 | |
| 10/17/2023 17:01:44 - INFO - app - STEP = 89 | |
| 10/17/2023 17:01:45 - INFO - app - STEP = 90 | |
| 10/17/2023 17:01:46 - INFO - app - STEP = 91 | |
| 10/17/2023 17:01:47 - INFO - app - STEP = 92 | |
| 10/17/2023 17:01:48 - INFO - app - STEP = 93 | |
| 10/17/2023 17:01:49 - INFO - app - STEP = 94 | |
| 10/17/2023 17:01:50 - INFO - app - STEP = 95 | |
| 10/17/2023 17:01:51 - INFO - app - STEP = 96 | |
| 10/17/2023 17:01:53 - INFO - app - STEP = 97 | |
| 10/17/2023 17:01:54 - INFO - app - STEP = 98 | |
| 10/17/2023 17:01:55 - INFO - app - STEP = 99 | |
| 10/17/2023 17:01:56 - INFO - app - STEP = 100 | |
| 10/17/2023 17:01:57 - INFO - app - STEP = 101 | |
| 10/17/2023 17:01:58 - INFO - app - STEP = 102 | |
| 10/17/2023 17:01:59 - INFO - app - STEP = 103 | |
| 10/17/2023 17:02:00 - INFO - app - STEP = 104 | |
| 10/17/2023 17:02:01 - INFO - app - STEP = 105 | |
| 10/17/2023 17:02:02 - INFO - app - STEP = 106 | |
| 10/17/2023 17:02:03 - INFO - app - STEP = 107 | |
| 10/17/2023 17:02:04 - INFO - app - STEP = 108 | |
| 10/17/2023 17:02:05 - INFO - app - STEP = 109 | |
| 10/17/2023 17:02:06 - INFO - app - STEP = 110 | |
| 10/17/2023 17:02:07 - INFO - app - STEP = 111 | |
| 10/17/2023 17:02:08 - INFO - app - STEP = 112 | |
| 10/17/2023 17:02:09 - INFO - app - STEP = 113 | |
| 10/17/2023 17:02:10 - INFO - app - STEP = 114 | |
| 10/17/2023 17:02:11 - INFO - app - STEP = 115 | |
| 10/17/2023 17:02:12 - INFO - app - STEP = 116 | |
| 10/17/2023 17:02:13 - INFO - app - STEP = 117 | |
| 10/17/2023 17:02:14 - INFO - app - STEP = 118 | |
| 10/17/2023 17:02:15 - INFO - app - STEP = 119 | |
| 10/17/2023 17:02:16 - INFO - app - STEP = 120 | |
| 10/17/2023 17:02:17 - INFO - app - STEP = 121 | |
| 10/17/2023 17:02:19 - INFO - app - STEP = 122 | |
| 10/17/2023 17:02:20 - INFO - app - STEP = 123 | |
| 10/17/2023 17:02:21 - INFO - app - STEP = 124 | |
| 10/17/2023 17:02:22 - INFO - app - STEP = 125 | |
| 10/17/2023 17:02:23 - INFO - app - STEP = 126 | |
| 10/17/2023 17:02:24 - INFO - app - STEP = 127 | |
| 10/17/2023 17:02:25 - INFO - app - STEP = 128 | |
| 10/17/2023 17:02:26 - INFO - app - STEP = 129 | |
| 10/17/2023 17:02:27 - INFO - app - STEP = 130 | |
| 10/17/2023 17:02:28 - INFO - app - Running validation... | |
| Generating 4 images with prompt: A photo of sks dog. | |
| 10/17/2023 17:02:54 - INFO - app - STEP = 131 | |
| 10/17/2023 17:02:55 - INFO - app - STEP = 132 | |
| 10/17/2023 17:02:56 - INFO - app - STEP = 133 | |
| 10/17/2023 17:02:57 - INFO - app - STEP = 134 | |
| 10/17/2023 17:02:58 - INFO - app - STEP = 135 | |
| 10/17/2023 17:03:00 - INFO - app - STEP = 136 | |
| 10/17/2023 17:03:01 - INFO - app - STEP = 137 | |
| 10/17/2023 17:03:02 - INFO - app - STEP = 138 | |
| 10/17/2023 17:03:03 - INFO - app - STEP = 139 | |
| 10/17/2023 17:03:04 - INFO - app - STEP = 140 | |
| 10/17/2023 17:03:05 - INFO - app - STEP = 141 | |
| 10/17/2023 17:03:06 - INFO - app - STEP = 142 | |
| 10/17/2023 17:03:07 - INFO - app - STEP = 143 | |
| 10/17/2023 17:03:08 - INFO - app - STEP = 144 | |
| 10/17/2023 17:03:09 - INFO - app - STEP = 145 | |
| 10/17/2023 17:03:10 - INFO - app - STEP = 146 | |
| 10/17/2023 17:03:11 - INFO - app - STEP = 147 | |
| 10/17/2023 17:03:12 - INFO - app - STEP = 148 | |
| 10/17/2023 17:03:13 - INFO - app - STEP = 149 | |
| 10/17/2023 17:03:14 - INFO - app - STEP = 150 | |
| 10/17/2023 17:03:15 - INFO - app - STEP = 151 | |
| 10/17/2023 17:03:16 - INFO - app - STEP = 152 | |
| 10/17/2023 17:03:17 - INFO - app - STEP = 153 | |
| 10/17/2023 17:03:18 - INFO - app - STEP = 154 | |
| 10/17/2023 17:03:19 - INFO - app - STEP = 155 | |
| 10/17/2023 17:03:20 - INFO - app - STEP = 156 | |
| 10/17/2023 17:03:21 - INFO - app - STEP = 157 | |
| 10/17/2023 17:03:22 - INFO - app - STEP = 158 | |
| 10/17/2023 17:03:23 - INFO - app - STEP = 159 | |
| 10/17/2023 17:03:24 - INFO - app - STEP = 160 | |
| 10/17/2023 17:03:25 - INFO - app - STEP = 161 | |
| 10/17/2023 17:03:26 - INFO - app - STEP = 162 | |
| 10/17/2023 17:03:28 - INFO - app - STEP = 163 | |
| 10/17/2023 17:03:29 - INFO - app - STEP = 164 | |
| 10/17/2023 17:03:30 - INFO - app - STEP = 165 | |
| 10/17/2023 17:03:31 - INFO - app - STEP = 166 | |
| 10/17/2023 17:03:32 - INFO - app - STEP = 167 | |
| 10/17/2023 17:03:33 - INFO - app - STEP = 168 | |
| 10/17/2023 17:03:34 - INFO - app - STEP = 169 | |
| 10/17/2023 17:03:35 - INFO - app - STEP = 170 | |
| 10/17/2023 17:03:36 - INFO - app - STEP = 171 | |
| 10/17/2023 17:03:37 - INFO - app - STEP = 172 | |
| 10/17/2023 17:03:38 - INFO - app - STEP = 173 | |
| 10/17/2023 17:03:39 - INFO - app - STEP = 174 | |
| 10/17/2023 17:03:40 - INFO - app - STEP = 175 | |
| 10/17/2023 17:03:41 - INFO - app - STEP = 176 | |
| 10/17/2023 17:03:42 - INFO - app - STEP = 177 | |
| 10/17/2023 17:03:43 - INFO - app - STEP = 178 | |
| 10/17/2023 17:03:44 - INFO - app - STEP = 179 | |
| 10/17/2023 17:03:45 - INFO - app - STEP = 180 | |
| 10/17/2023 17:03:46 - INFO - app - STEP = 181 | |
| 10/17/2023 17:03:47 - INFO - app - STEP = 182 | |
| 10/17/2023 17:03:48 - INFO - app - STEP = 183 | |
| 10/17/2023 17:03:49 - INFO - app - STEP = 184 | |
| 10/17/2023 17:03:50 - INFO - app - STEP = 185 | |
| 10/17/2023 17:03:51 - INFO - app - STEP = 186 | |
| 10/17/2023 17:03:52 - INFO - app - STEP = 187 | |
| 10/17/2023 17:03:53 - INFO - app - STEP = 188 | |
| 10/17/2023 17:03:54 - INFO - app - STEP = 189 | |
| 10/17/2023 17:03:55 - INFO - app - STEP = 190 | |
| 10/17/2023 17:03:57 - INFO - app - STEP = 191 | |
| 10/17/2023 17:03:58 - INFO - app - STEP = 192 | |
| 10/17/2023 17:03:59 - INFO - app - STEP = 193 | |
| 10/17/2023 17:04:00 - INFO - app - STEP = 194 | |
| 10/17/2023 17:04:01 - INFO - app - STEP = 195 | |
| 10/17/2023 17:04:02 - INFO - app - STEP = 196 | |
| 10/17/2023 17:04:03 - INFO - app - STEP = 197 | |
| 10/17/2023 17:04:04 - INFO - app - STEP = 198 | |
| 10/17/2023 17:04:05 - INFO - app - STEP = 199 | |
| 10/17/2023 17:04:06 - INFO - app - STEP = 200 | |
| 10/17/2023 17:04:07 - INFO - app - STEP = 201 | |
| 10/17/2023 17:04:08 - INFO - app - STEP = 202 | |
| 10/17/2023 17:04:09 - INFO - app - STEP = 203 | |
| 10/17/2023 17:04:10 - INFO - app - STEP = 204 | |
| 10/17/2023 17:04:11 - INFO - app - STEP = 205 | |
| 10/17/2023 17:04:12 - INFO - app - STEP = 206 | |
| 10/17/2023 17:04:13 - INFO - app - STEP = 207 | |
| 10/17/2023 17:04:14 - INFO - app - STEP = 208 | |
| 10/17/2023 17:04:15 - INFO - app - STEP = 209 | |
| 10/17/2023 17:04:16 - INFO - app - STEP = 210 | |
| 10/17/2023 17:04:17 - INFO - app - STEP = 211 | |
| 10/17/2023 17:04:18 - INFO - app - STEP = 212 | |
| 10/17/2023 17:04:19 - INFO - app - STEP = 213 | |
| 10/17/2023 17:04:20 - INFO - app - STEP = 214 | |
| 10/17/2023 17:04:21 - INFO - app - STEP = 215 | |
| 10/17/2023 17:04:23 - INFO - app - STEP = 216 | |
| 10/17/2023 17:04:24 - INFO - app - STEP = 217 | |
| 10/17/2023 17:04:25 - INFO - app - STEP = 218 | |
| 10/17/2023 17:04:26 - INFO - app - STEP = 219 | |
| 10/17/2023 17:04:27 - INFO - app - STEP = 220 | |
| 10/17/2023 17:04:28 - INFO - app - STEP = 221 | |
| 10/17/2023 17:04:29 - INFO - app - STEP = 222 | |
| 10/17/2023 17:04:30 - INFO - app - STEP = 223 | |
| 10/17/2023 17:04:31 - INFO - app - STEP = 224 | |
| 10/17/2023 17:04:32 - INFO - app - STEP = 225 | |
| 10/17/2023 17:04:33 - INFO - app - STEP = 226 | |
| 10/17/2023 17:04:34 - INFO - app - STEP = 227 | |
| 10/17/2023 17:04:35 - INFO - app - STEP = 228 | |
| 10/17/2023 17:04:36 - INFO - app - STEP = 229 | |
| 10/17/2023 17:04:37 - INFO - app - STEP = 230 | |
| 10/17/2023 17:04:38 - INFO - app - STEP = 231 | |
| 10/17/2023 17:04:39 - INFO - app - STEP = 232 | |
| 10/17/2023 17:04:40 - INFO - app - STEP = 233 | |
| 10/17/2023 17:04:41 - INFO - app - STEP = 234 | |
| 10/17/2023 17:04:42 - INFO - app - STEP = 235 | |
| 10/17/2023 17:04:43 - INFO - app - STEP = 236 | |
| 10/17/2023 17:04:44 - INFO - app - STEP = 237 | |
| 10/17/2023 17:04:45 - INFO - app - STEP = 238 | |
| 10/17/2023 17:04:46 - INFO - app - STEP = 239 | |
| 10/17/2023 17:04:47 - INFO - app - STEP = 240 | |
| 10/17/2023 17:04:49 - INFO - app - STEP = 241 | |
| 10/17/2023 17:04:50 - INFO - app - STEP = 242 | |
| 10/17/2023 17:04:51 - INFO - app - STEP = 243 | |
| 10/17/2023 17:04:52 - INFO - app - STEP = 244 | |
| 10/17/2023 17:04:53 - INFO - app - STEP = 245 | |
| 10/17/2023 17:04:54 - INFO - app - STEP = 246 | |
| 10/17/2023 17:04:55 - INFO - app - STEP = 247 | |
| 10/17/2023 17:04:56 - INFO - app - STEP = 248 | |
| 10/17/2023 17:04:57 - INFO - app - STEP = 249 | |
| 10/17/2023 17:04:58 - INFO - app - STEP = 250 | |
| 10/17/2023 17:04:59 - INFO - app - STEP = 251 | |
| 10/17/2023 17:05:00 - INFO - app - STEP = 252 | |
| 10/17/2023 17:05:01 - INFO - app - STEP = 253 | |
| 10/17/2023 17:05:02 - INFO - app - STEP = 254 | |
| 10/17/2023 17:05:03 - INFO - app - STEP = 255 | |
| 10/17/2023 17:05:04 - INFO - app - Running validation... | |
| Generating 4 images with prompt: A photo of sks dog. | |
| 10/17/2023 17:05:30 - INFO - app - STEP = 256 | |
| 10/17/2023 17:05:32 - INFO - app - STEP = 257 | |
| 10/17/2023 17:05:33 - INFO - app - STEP = 258 | |
| 10/17/2023 17:05:34 - INFO - app - STEP = 259 | |
| 10/17/2023 17:05:35 - INFO - app - STEP = 260 | |
| 10/17/2023 17:05:36 - INFO - app - STEP = 261 | |
| 10/17/2023 17:05:37 - INFO - app - STEP = 262 | |
| 10/17/2023 17:05:38 - INFO - app - STEP = 263 | |
| 10/17/2023 17:05:39 - INFO - app - STEP = 264 | |
| 10/17/2023 17:05:40 - INFO - app - STEP = 265 | |
| 10/17/2023 17:05:41 - INFO - app - STEP = 266 | |
| 10/17/2023 17:05:42 - INFO - app - STEP = 267 | |
| 10/17/2023 17:05:43 - INFO - app - STEP = 268 | |
| 10/17/2023 17:05:44 - INFO - app - STEP = 269 | |
| 10/17/2023 17:05:45 - INFO - app - STEP = 270 | |
| 10/17/2023 17:05:46 - INFO - app - STEP = 271 | |
| 10/17/2023 17:05:47 - INFO - app - STEP = 272 | |
| 10/17/2023 17:05:48 - INFO - app - STEP = 273 | |
| 10/17/2023 17:05:49 - INFO - app - STEP = 274 | |
| 10/17/2023 17:05:50 - INFO - app - STEP = 275 | |
| 10/17/2023 17:05:51 - INFO - app - STEP = 276 | |
| 10/17/2023 17:05:52 - INFO - app - STEP = 277 | |
| 10/17/2023 17:05:53 - INFO - app - STEP = 278 | |
| 10/17/2023 17:05:54 - INFO - app - STEP = 279 | |
| 10/17/2023 17:05:55 - INFO - app - STEP = 280 | |
| 10/17/2023 17:05:57 - INFO - app - STEP = 281 | |
| 10/17/2023 17:05:58 - INFO - app - STEP = 282 | |
| 10/17/2023 17:05:59 - INFO - app - STEP = 283 | |
| 10/17/2023 17:06:00 - INFO - app - STEP = 284 | |
| 10/17/2023 17:06:01 - INFO - app - STEP = 285 | |
| 10/17/2023 17:06:02 - INFO - app - STEP = 286 | |
| 10/17/2023 17:06:03 - INFO - app - STEP = 287 | |
| 10/17/2023 17:06:04 - INFO - app - STEP = 288 | |
| 10/17/2023 17:06:05 - INFO - app - STEP = 289 | |
| 10/17/2023 17:06:06 - INFO - app - STEP = 290 | |
| 10/17/2023 17:06:07 - INFO - app - STEP = 291 | |
| 10/17/2023 17:06:08 - INFO - app - STEP = 292 | |
| 10/17/2023 17:06:09 - INFO - app - STEP = 293 | |
| 10/17/2023 17:06:10 - INFO - app - STEP = 294 | |
| 10/17/2023 17:06:11 - INFO - app - STEP = 295 | |
| 10/17/2023 17:06:12 - INFO - app - STEP = 296 | |
| 10/17/2023 17:06:13 - INFO - app - STEP = 297 | |
| 10/17/2023 17:06:14 - INFO - app - STEP = 298 | |
| 10/17/2023 17:06:15 - INFO - app - STEP = 299 | |
| 10/17/2023 17:06:16 - INFO - app - STEP = 300 | |
| 10/17/2023 17:06:17 - INFO - app - STEP = 301 | |
| 10/17/2023 17:06:18 - INFO - app - STEP = 302 | |
| 10/17/2023 17:06:19 - INFO - app - STEP = 303 | |
| 10/17/2023 17:06:21 - INFO - app - STEP = 304 | |
| 10/17/2023 17:06:21 - INFO - app - STEP = 305 | |
| 10/17/2023 17:06:23 - INFO - app - STEP = 306 | |
| 10/17/2023 17:06:24 - INFO - app - STEP = 307 | |
| 10/17/2023 17:06:25 - INFO - app - STEP = 308 | |
| 10/17/2023 17:06:26 - INFO - app - STEP = 309 | |
| 10/17/2023 17:06:27 - INFO - app - STEP = 310 | |
| 10/17/2023 17:06:28 - INFO - app - STEP = 311 | |
| 10/17/2023 17:06:29 - INFO - app - STEP = 312 | |
| 10/17/2023 17:06:30 - INFO - app - STEP = 313 | |
| 10/17/2023 17:06:31 - INFO - app - STEP = 314 | |
| 10/17/2023 17:06:32 - INFO - app - STEP = 315 | |
| 10/17/2023 17:06:33 - INFO - app - STEP = 316 | |
| 10/17/2023 17:06:34 - INFO - app - STEP = 317 | |
| 10/17/2023 17:06:35 - INFO - app - STEP = 318 | |
| 10/17/2023 17:06:36 - INFO - app - STEP = 319 | |
| 10/17/2023 17:06:37 - INFO - app - STEP = 320 | |
| 10/17/2023 17:06:38 - INFO - app - STEP = 321 | |
| 10/17/2023 17:06:39 - INFO - app - STEP = 322 | |
| 10/17/2023 17:06:40 - INFO - app - STEP = 323 | |
| 10/17/2023 17:06:41 - INFO - app - STEP = 324 | |
| 10/17/2023 17:06:42 - INFO - app - STEP = 325 | |
| 10/17/2023 17:06:43 - INFO - app - STEP = 326 | |
| 10/17/2023 17:06:44 - INFO - app - STEP = 327 | |
| 10/17/2023 17:06:45 - INFO - app - STEP = 328 | |
| 10/17/2023 17:06:46 - INFO - app - STEP = 329 | |
| 10/17/2023 17:06:47 - INFO - app - STEP = 330 | |
| 10/17/2023 17:06:49 - INFO - app - STEP = 331 | |
| 10/17/2023 17:06:50 - INFO - app - STEP = 332 | |
| 10/17/2023 17:06:51 - INFO - app - STEP = 333 | |
| 10/17/2023 17:06:52 - INFO - app - STEP = 334 | |
| 10/17/2023 17:06:53 - INFO - app - STEP = 335 | |
| 10/17/2023 17:06:54 - INFO - app - STEP = 336 | |
| 10/17/2023 17:06:55 - INFO - app - STEP = 337 | |
| 10/17/2023 17:06:56 - INFO - app - STEP = 338 | |
| 10/17/2023 17:06:57 - INFO - app - STEP = 339 | |
| 10/17/2023 17:06:58 - INFO - app - STEP = 340 | |
| 10/17/2023 17:06:59 - INFO - app - STEP = 341 | |
| 10/17/2023 17:07:00 - INFO - app - STEP = 342 | |
| 10/17/2023 17:07:01 - INFO - app - STEP = 343 | |
| 10/17/2023 17:07:02 - INFO - app - STEP = 344 | |
| 10/17/2023 17:07:03 - INFO - app - STEP = 345 | |
| 10/17/2023 17:07:04 - INFO - app - STEP = 346 | |
| 10/17/2023 17:07:05 - INFO - app - STEP = 347 | |
| 10/17/2023 17:07:06 - INFO - app - STEP = 348 | |
| 10/17/2023 17:07:07 - INFO - app - STEP = 349 | |
| 10/17/2023 17:07:08 - INFO - app - STEP = 350 | |
| 10/17/2023 17:07:09 - INFO - app - STEP = 351 | |
| 10/17/2023 17:07:10 - INFO - app - STEP = 352 | |
| 10/17/2023 17:07:11 - INFO - app - STEP = 353 | |
| 10/17/2023 17:07:12 - INFO - app - STEP = 354 | |
| 10/17/2023 17:07:13 - INFO - app - STEP = 355 | |
| 10/17/2023 17:07:14 - INFO - app - STEP = 356 | |
| 10/17/2023 17:07:16 - INFO - app - STEP = 357 | |
| 10/17/2023 17:07:17 - INFO - app - STEP = 358 | |
| 10/17/2023 17:07:18 - INFO - app - STEP = 359 | |
| 10/17/2023 17:07:19 - INFO - app - STEP = 360 | |
| 10/17/2023 17:07:20 - INFO - app - STEP = 361 | |
| 10/17/2023 17:07:21 - INFO - app - STEP = 362 | |
| 10/17/2023 17:07:22 - INFO - app - STEP = 363 | |
| 10/17/2023 17:07:23 - INFO - app - STEP = 364 | |
| 10/17/2023 17:07:24 - INFO - app - STEP = 365 | |
| 10/17/2023 17:07:25 - INFO - app - STEP = 366 | |
| 10/17/2023 17:07:26 - INFO - app - STEP = 367 | |
| 10/17/2023 17:07:27 - INFO - app - STEP = 368 | |
| 10/17/2023 17:07:28 - INFO - app - STEP = 369 | |
| 10/17/2023 17:07:29 - INFO - app - STEP = 370 | |
| 10/17/2023 17:07:30 - INFO - app - STEP = 371 | |
| 10/17/2023 17:07:31 - INFO - app - STEP = 372 | |
| 10/17/2023 17:07:32 - INFO - app - STEP = 373 | |
| 10/17/2023 17:07:33 - INFO - app - STEP = 374 | |
| 10/17/2023 17:07:34 - INFO - app - STEP = 375 | |
| 10/17/2023 17:07:35 - INFO - app - STEP = 376 | |
| 10/17/2023 17:07:36 - INFO - app - STEP = 377 | |
| 10/17/2023 17:07:37 - INFO - app - STEP = 378 | |
| 10/17/2023 17:07:38 - INFO - app - STEP = 379 | |
| 10/17/2023 17:07:39 - INFO - app - STEP = 380 | |
| 10/17/2023 17:07:40 - INFO - app - Running validation... | |
| Generating 4 images with prompt: A photo of sks dog. | |
| 10/17/2023 17:08:07 - INFO - app - STEP = 381 | |
| 10/17/2023 17:08:08 - INFO - app - STEP = 382 | |
| 10/17/2023 17:08:09 - INFO - app - STEP = 383 | |
| 10/17/2023 17:08:10 - INFO - app - STEP = 384 | |
| 10/17/2023 17:08:11 - INFO - app - STEP = 385 | |
| 10/17/2023 17:08:12 - INFO - app - STEP = 386 | |
| 10/17/2023 17:08:13 - INFO - app - STEP = 387 | |
| 10/17/2023 17:08:14 - INFO - app - STEP = 388 | |
| 10/17/2023 17:08:15 - INFO - app - STEP = 389 | |
| 10/17/2023 17:08:16 - INFO - app - STEP = 390 | |
| 10/17/2023 17:08:17 - INFO - app - STEP = 391 | |
| 10/17/2023 17:08:18 - INFO - app - STEP = 392 | |
| 10/17/2023 17:08:19 - INFO - app - STEP = 393 | |
| 10/17/2023 17:08:21 - INFO - app - STEP = 394 | |
| 10/17/2023 17:08:22 - INFO - app - STEP = 395 | |
| 10/17/2023 17:08:23 - INFO - app - STEP = 396 | |
| 10/17/2023 17:08:24 - INFO - app - STEP = 397 | |
| 10/17/2023 17:08:25 - INFO - app - STEP = 398 | |
| 10/17/2023 17:08:26 - INFO - app - STEP = 399 | |
| 10/17/2023 17:08:27 - INFO - app - STEP = 400 | |
| 10/17/2023 17:08:28 - INFO - app - STEP = 401 | |
| 10/17/2023 17:08:29 - INFO - app - STEP = 402 | |
| 10/17/2023 17:08:30 - INFO - app - STEP = 403 | |
| 10/17/2023 17:08:31 - INFO - app - STEP = 404 | |
| 10/17/2023 17:08:32 - INFO - app - STEP = 405 | |
| 10/17/2023 17:08:34 - INFO - app - STEP = 406 | |
| 10/17/2023 17:08:35 - INFO - app - STEP = 407 | |
| 10/17/2023 17:08:36 - INFO - app - STEP = 408 | |
| 10/17/2023 17:08:37 - INFO - app - STEP = 409 | |
| 10/17/2023 17:08:38 - INFO - app - STEP = 410 | |
| 10/17/2023 17:08:39 - INFO - app - STEP = 411 | |
| 10/17/2023 17:08:40 - INFO - app - STEP = 412 | |
| 10/17/2023 17:08:41 - INFO - app - STEP = 413 | |
| 10/17/2023 17:08:42 - INFO - app - STEP = 414 | |
| 10/17/2023 17:08:43 - INFO - app - STEP = 415 | |
| 10/17/2023 17:08:44 - INFO - app - STEP = 416 | |
| 10/17/2023 17:08:46 - INFO - app - STEP = 417 | |
| 10/17/2023 17:08:47 - INFO - accelerate.accelerator - Saving current state to models/zee-test/checkpoint-250 | |
| 10/17/2023 17:08:47 - INFO - accelerate.checkpointing - Optimizer state saved in models/zee-test/checkpoint-250/optimizer.bin | |
| 10/17/2023 17:08:47 - INFO - accelerate.checkpointing - Scheduler state saved in models/zee-test/checkpoint-250/scheduler.bin | |
| 10/17/2023 17:08:47 - INFO - accelerate.checkpointing - Random states saved in models/zee-test/checkpoint-250/random_states_0.pkl | |
| 10/17/2023 17:08:47 - INFO - app - Saved state to models/zee-test/checkpoint-250 | |
| 10/17/2023 17:08:47 - INFO - app - STEP = 418 | |
| 10/17/2023 17:08:48 - INFO - app - STEP = 419 | |
| 10/17/2023 17:08:49 - INFO - app - STEP = 420 | |
| 10/17/2023 17:08:50 - INFO - app - STEP = 421 | |
| 10/17/2023 17:08:51 - INFO - app - STEP = 422 | |
| 10/17/2023 17:08:52 - INFO - app - STEP = 423 | |
| 10/17/2023 17:08:53 - INFO - app - STEP = 424 | |
| 10/17/2023 17:08:54 - INFO - app - STEP = 425 | |
| 10/17/2023 17:08:55 - INFO - app - STEP = 426 | |
| 10/17/2023 17:08:56 - INFO - app - STEP = 427 | |
| 10/17/2023 17:08:57 - INFO - app - STEP = 428 | |
| 10/17/2023 17:08:58 - INFO - app - STEP = 429 | |
| 10/17/2023 17:08:59 - INFO - app - STEP = 430 | |
| 10/17/2023 17:09:00 - INFO - app - STEP = 431 | |
| 10/17/2023 17:09:01 - INFO - app - STEP = 432 | |
| 10/17/2023 17:09:02 - INFO - app - STEP = 433 | |
| 10/17/2023 17:09:04 - INFO - app - STEP = 434 | |
| 10/17/2023 17:09:04 - INFO - app - STEP = 435 | |
| 10/17/2023 17:09:06 - INFO - app - STEP = 436 | |
| 10/17/2023 17:09:07 - INFO - app - STEP = 437 | |
| 10/17/2023 17:09:08 - INFO - app - STEP = 438 | |
| 10/17/2023 17:09:09 - INFO - app - STEP = 439 | |
| 10/17/2023 17:09:10 - INFO - app - STEP = 440 | |
| 10/17/2023 17:09:11 - INFO - app - STEP = 441 | |
| 10/17/2023 17:09:12 - INFO - app - STEP = 442 | |
| 10/17/2023 17:09:13 - INFO - app - STEP = 443 | |
| 10/17/2023 17:09:14 - INFO - app - STEP = 444 | |
| 10/17/2023 17:09:15 - INFO - app - STEP = 445 | |
| 10/17/2023 17:09:16 - INFO - app - STEP = 446 | |
| 10/17/2023 17:09:17 - INFO - app - STEP = 447 | |
| 10/17/2023 17:09:18 - INFO - app - STEP = 448 | |
| 10/17/2023 17:09:19 - INFO - app - STEP = 449 | |
| 10/17/2023 17:09:20 - INFO - app - STEP = 450 | |
| 10/17/2023 17:09:21 - INFO - app - STEP = 451 | |
| 10/17/2023 17:09:22 - INFO - app - STEP = 452 | |
| 10/17/2023 17:09:23 - INFO - app - STEP = 453 | |
| 10/17/2023 17:09:24 - INFO - app - STEP = 454 | |
| 10/17/2023 17:09:25 - INFO - app - STEP = 455 | |
| 10/17/2023 17:09:26 - INFO - app - STEP = 456 | |
| 10/17/2023 17:09:27 - INFO - app - STEP = 457 | |
| 10/17/2023 17:09:28 - INFO - app - STEP = 458 | |
| 10/17/2023 17:09:29 - INFO - app - STEP = 459 | |
| 10/17/2023 17:09:30 - INFO - app - STEP = 460 | |
| 10/17/2023 17:09:32 - INFO - app - STEP = 461 | |
| 10/17/2023 17:09:33 - INFO - app - STEP = 462 | |
| 10/17/2023 17:09:34 - INFO - app - STEP = 463 | |
| 10/17/2023 17:09:35 - INFO - app - STEP = 464 | |
| 10/17/2023 17:09:36 - INFO - app - STEP = 465 | |
| 10/17/2023 17:09:37 - INFO - app - STEP = 466 | |
| 10/17/2023 17:09:38 - INFO - app - STEP = 467 | |
| 10/17/2023 17:09:39 - INFO - app - STEP = 468 | |
| 10/17/2023 17:09:40 - INFO - app - STEP = 469 | |
| 10/17/2023 17:09:41 - INFO - app - STEP = 470 | |
| 10/17/2023 17:09:42 - INFO - app - STEP = 471 | |
| 10/17/2023 17:09:43 - INFO - app - STEP = 472 | |
| 10/17/2023 17:09:44 - INFO - app - STEP = 473 | |
| 10/17/2023 17:09:45 - INFO - app - STEP = 474 | |
| 10/17/2023 17:09:46 - INFO - app - STEP = 475 | |
| 10/17/2023 17:09:47 - INFO - app - STEP = 476 | |
| 10/17/2023 17:09:48 - INFO - app - STEP = 477 | |
| 10/17/2023 17:09:49 - INFO - app - STEP = 478 | |
| 10/17/2023 17:09:50 - INFO - app - STEP = 479 | |
| 10/17/2023 17:09:51 - INFO - app - STEP = 480 | |
| 10/17/2023 17:09:52 - INFO - app - STEP = 481 | |
| 10/17/2023 17:09:53 - INFO - app - STEP = 482 | |
| 10/17/2023 17:09:54 - INFO - app - STEP = 483 | |
| 10/17/2023 17:09:55 - INFO - app - STEP = 484 | |
| 10/17/2023 17:09:56 - INFO - app - STEP = 485 | |
| 10/17/2023 17:09:57 - INFO - app - STEP = 486 | |
| 10/17/2023 17:09:58 - INFO - app - STEP = 487 | |
| 10/17/2023 17:09:59 - INFO - app - STEP = 488 | |
| 10/17/2023 17:10:01 - INFO - app - STEP = 489 | |
| 10/17/2023 17:10:01 - INFO - app - STEP = 490 | |
| 10/17/2023 17:10:03 - INFO - app - STEP = 491 | |
| 10/17/2023 17:10:04 - INFO - app - STEP = 492 | |
| 10/17/2023 17:10:05 - INFO - app - STEP = 493 | |
| 10/17/2023 17:10:06 - INFO - app - STEP = 494 | |
| 10/17/2023 17:10:07 - INFO - app - STEP = 495 | |
| 10/17/2023 17:10:08 - INFO - app - STEP = 496 | |
| 10/17/2023 17:10:09 - INFO - app - STEP = 497 | |
| 10/17/2023 17:10:10 - INFO - app - STEP = 498 | |
| 10/17/2023 17:10:11 - INFO - app - STEP = 499 | |
| 10/17/2023 17:10:12 - INFO - app - STEP = 500 | |
| 10/17/2023 17:10:13 - INFO - app - STEP = 501 | |
| 10/17/2023 17:10:14 - INFO - app - STEP = 502 | |
| 10/17/2023 17:10:15 - INFO - app - STEP = 503 | |
| 10/17/2023 17:10:16 - INFO - app - STEP = 504 | |
| 10/17/2023 17:10:17 - INFO - app - STEP = 505 | |
| 10/17/2023 17:10:18 - INFO - app - Running validation... | |
| Generating 4 images with prompt: A photo of sks dog. | |
| 10/17/2023 17:10:44 - INFO - app - STEP = 506 | |
| 10/17/2023 17:10:45 - INFO - app - STEP = 507 | |
| 10/17/2023 17:10:47 - INFO - app - STEP = 508 | |
| 10/17/2023 17:10:48 - INFO - app - STEP = 509 | |
| 10/17/2023 17:10:49 - INFO - app - STEP = 510 | |
| 10/17/2023 17:10:50 - INFO - app - STEP = 511 | |
| 10/17/2023 17:10:51 - INFO - app - STEP = 512 | |
| 10/17/2023 17:10:52 - INFO - app - STEP = 513 | |
| 10/17/2023 17:10:53 - INFO - app - STEP = 514 | |
| 10/17/2023 17:10:54 - INFO - app - STEP = 515 | |
| 10/17/2023 17:10:55 - INFO - app - STEP = 516 | |
| 10/17/2023 17:10:56 - INFO - app - STEP = 517 | |
| 10/17/2023 17:10:57 - INFO - app - STEP = 518 | |
| 10/17/2023 17:10:58 - INFO - app - STEP = 519 | |
| 10/17/2023 17:10:59 - INFO - app - STEP = 520 | |
| 10/17/2023 17:11:01 - INFO - app - STEP = 521 | |
| 10/17/2023 17:11:02 - INFO - app - STEP = 522 | |
| 10/17/2023 17:11:03 - INFO - app - STEP = 523 | |
| 10/17/2023 17:11:04 - INFO - app - STEP = 524 | |
| 10/17/2023 17:11:05 - INFO - app - STEP = 525 | |
| 10/17/2023 17:11:06 - INFO - app - STEP = 526 | |
| 10/17/2023 17:11:07 - INFO - app - STEP = 527 | |
| 10/17/2023 17:11:08 - INFO - app - STEP = 528 | |
| 10/17/2023 17:11:09 - INFO - app - STEP = 529 | |
| 10/17/2023 17:11:10 - INFO - app - STEP = 530 | |
| 10/17/2023 17:11:11 - INFO - app - STEP = 531 | |
| 10/17/2023 17:11:12 - INFO - app - STEP = 532 | |
| 10/17/2023 17:11:13 - INFO - app - STEP = 533 | |
| 10/17/2023 17:11:14 - INFO - app - STEP = 534 | |
| 10/17/2023 17:11:15 - INFO - app - STEP = 535 | |
| 10/17/2023 17:11:16 - INFO - app - STEP = 536 | |
| 10/17/2023 17:11:17 - INFO - app - STEP = 537 | |
| 10/17/2023 17:11:18 - INFO - app - STEP = 538 | |
| 10/17/2023 17:11:19 - INFO - app - STEP = 539 | |
| 10/17/2023 17:11:20 - INFO - app - STEP = 540 | |
| 10/17/2023 17:11:21 - INFO - app - STEP = 541 | |
| 10/17/2023 17:11:22 - INFO - app - STEP = 542 | |
| 10/17/2023 17:11:23 - INFO - app - STEP = 543 | |
| 10/17/2023 17:11:25 - INFO - app - STEP = 544 | |
| 10/17/2023 17:11:26 - INFO - app - STEP = 545 | |
| 10/17/2023 17:11:27 - INFO - app - STEP = 546 | |
| 10/17/2023 17:11:28 - INFO - app - STEP = 547 | |
| 10/17/2023 17:11:29 - INFO - app - STEP = 548 | |
| 10/17/2023 17:11:30 - INFO - app - STEP = 549 | |
| 10/17/2023 17:11:31 - INFO - app - STEP = 550 | |
| 10/17/2023 17:11:33 - INFO - app - STEP = 551 | |
| 10/17/2023 17:11:34 - INFO - app - STEP = 552 | |
| 10/17/2023 17:11:35 - INFO - app - STEP = 553 | |
| 10/17/2023 17:11:36 - INFO - app - STEP = 554 | |
| 10/17/2023 17:11:37 - INFO - app - STEP = 555 | |
| 10/17/2023 17:11:38 - INFO - app - STEP = 556 | |
| 10/17/2023 17:11:39 - INFO - app - STEP = 557 | |
| 10/17/2023 17:11:40 - INFO - app - STEP = 558 | |
| 10/17/2023 17:11:41 - INFO - app - STEP = 559 | |
| 10/17/2023 17:11:42 - INFO - app - STEP = 560 | |
| 10/17/2023 17:11:44 - INFO - app - STEP = 561 | |
| 10/17/2023 17:11:45 - INFO - app - STEP = 562 | |
| 10/17/2023 17:11:46 - INFO - app - STEP = 563 | |
| 10/17/2023 17:11:47 - INFO - app - STEP = 564 | |
| 10/17/2023 17:11:48 - INFO - app - STEP = 565 | |
| 10/17/2023 17:11:49 - INFO - app - STEP = 566 | |
| 10/17/2023 17:11:50 - INFO - app - STEP = 567 | |
| 10/17/2023 17:11:51 - INFO - app - STEP = 568 | |
| 10/17/2023 17:11:52 - INFO - app - STEP = 569 | |
| 10/17/2023 17:11:53 - INFO - app - STEP = 570 | |
| 10/17/2023 17:11:54 - INFO - app - STEP = 571 | |
| 10/17/2023 17:11:55 - INFO - app - STEP = 572 | |
| 10/17/2023 17:11:56 - INFO - app - STEP = 573 | |
| 10/17/2023 17:11:57 - INFO - app - STEP = 574 | |
| 10/17/2023 17:11:58 - INFO - app - STEP = 575 | |
| 10/17/2023 17:11:59 - INFO - app - STEP = 576 | |
| 10/17/2023 17:12:00 - INFO - app - STEP = 577 | |
| 10/17/2023 17:12:01 - INFO - app - STEP = 578 | |
| 10/17/2023 17:12:02 - INFO - app - STEP = 579 | |
| 10/17/2023 17:12:03 - INFO - app - STEP = 580 | |
| 10/17/2023 17:12:04 - INFO - app - STEP = 581 | |
| 10/17/2023 17:12:06 - INFO - app - STEP = 582 | |
| 10/17/2023 17:12:07 - INFO - app - STEP = 583 | |
| 10/17/2023 17:12:08 - INFO - app - STEP = 584 | |
| 10/17/2023 17:12:09 - INFO - app - STEP = 585 | |
| 10/17/2023 17:12:10 - INFO - app - STEP = 586 | |
| 10/17/2023 17:12:11 - INFO - app - STEP = 587 | |
| 10/17/2023 17:12:12 - INFO - app - STEP = 588 | |
| 10/17/2023 17:12:13 - INFO - app - STEP = 589 | |
| 10/17/2023 17:12:14 - INFO - app - STEP = 590 | |
| 10/17/2023 17:12:15 - INFO - app - STEP = 591 | |
| 10/17/2023 17:12:16 - INFO - app - STEP = 592 | |
| 10/17/2023 17:12:17 - INFO - app - STEP = 593 | |
| 10/17/2023 17:12:18 - INFO - app - STEP = 594 | |
| 10/17/2023 17:12:19 - INFO - app - STEP = 595 | |
| 10/17/2023 17:12:20 - INFO - app - STEP = 596 | |
| 10/17/2023 17:12:21 - INFO - app - STEP = 597 | |
| 10/17/2023 17:12:22 - INFO - app - STEP = 598 | |
| 10/17/2023 17:12:23 - INFO - app - STEP = 599 | |
| 10/17/2023 17:12:24 - INFO - app - STEP = 600 | |
| 10/17/2023 17:12:25 - INFO - app - STEP = 601 | |
| 10/17/2023 17:12:26 - INFO - app - STEP = 602 | |
| 10/17/2023 17:12:27 - INFO - app - STEP = 603 | |
| 10/17/2023 17:12:28 - INFO - app - STEP = 604 | |
| 10/17/2023 17:12:29 - INFO - app - STEP = 605 | |
| 10/17/2023 17:12:30 - INFO - app - STEP = 606 | |
| 10/17/2023 17:12:31 - INFO - app - STEP = 607 | |
| 10/17/2023 17:12:32 - INFO - app - STEP = 608 | |
| 10/17/2023 17:12:33 - INFO - app - STEP = 609 | |
| 10/17/2023 17:12:34 - INFO - app - STEP = 610 | |
| 10/17/2023 17:12:35 - INFO - app - STEP = 611 | |
| 10/17/2023 17:12:37 - INFO - app - STEP = 612 | |
| 10/17/2023 17:12:38 - INFO - app - STEP = 613 | |
| 10/17/2023 17:12:39 - INFO - app - STEP = 614 | |
| 10/17/2023 17:12:40 - INFO - app - STEP = 615 | |
| 10/17/2023 17:12:41 - INFO - app - STEP = 616 | |
| 10/17/2023 17:12:42 - INFO - app - STEP = 617 | |
| 10/17/2023 17:12:43 - INFO - app - STEP = 618 | |
| 10/17/2023 17:12:44 - INFO - app - STEP = 619 | |
| 10/17/2023 17:12:45 - INFO - app - STEP = 620 | |
| 10/17/2023 17:12:46 - INFO - app - STEP = 621 | |
| 10/17/2023 17:12:47 - INFO - app - STEP = 622 | |
| 10/17/2023 17:12:48 - INFO - app - STEP = 623 | |
| 10/17/2023 17:12:49 - INFO - app - STEP = 624 | |
| 10/17/2023 17:12:50 - INFO - app - STEP = 625 | |
| 10/17/2023 17:12:51 - INFO - app - STEP = 626 | |
| 10/17/2023 17:12:52 - INFO - app - STEP = 627 | |
| 10/17/2023 17:12:53 - INFO - app - STEP = 628 | |
| 10/17/2023 17:12:54 - INFO - app - STEP = 629 | |
| 10/17/2023 17:12:55 - INFO - app - STEP = 630 | |
| 10/17/2023 17:12:56 - INFO - app - Running validation... | |
| Generating 4 images with prompt: A photo of sks dog. | |
| 10/17/2023 17:13:23 - INFO - app - STEP = 631 | |
| 10/17/2023 17:13:24 - INFO - app - STEP = 632 | |
| 10/17/2023 17:13:25 - INFO - app - STEP = 633 | |
| 10/17/2023 17:13:26 - INFO - app - STEP = 634 | |
| 10/17/2023 17:13:27 - INFO - app - STEP = 635 | |
| 10/17/2023 17:13:28 - INFO - app - STEP = 636 | |
| 10/17/2023 17:13:29 - INFO - app - STEP = 637 | |
| 10/17/2023 17:13:30 - INFO - app - STEP = 638 | |
| 10/17/2023 17:13:31 - INFO - app - STEP = 639 | |
| 10/17/2023 17:13:32 - INFO - app - STEP = 640 | |
| 10/17/2023 17:13:33 - INFO - app - STEP = 641 | |
| 10/17/2023 17:13:34 - INFO - app - STEP = 642 | |
| 10/17/2023 17:13:35 - INFO - app - STEP = 643 | |
| 10/17/2023 17:13:36 - INFO - app - STEP = 644 | |
| 10/17/2023 17:13:37 - INFO - app - STEP = 645 | |
| 10/17/2023 17:13:38 - INFO - app - STEP = 646 | |
| 10/17/2023 17:13:39 - INFO - app - STEP = 647 | |
| 10/17/2023 17:13:40 - INFO - app - STEP = 648 | |
| 10/17/2023 17:13:41 - INFO - app - STEP = 649 | |
| 10/17/2023 17:13:42 - INFO - app - STEP = 650 | |
| 10/17/2023 17:13:43 - INFO - app - STEP = 651 | |
| 10/17/2023 17:13:44 - INFO - app - STEP = 652 | |
| 10/17/2023 17:13:46 - INFO - app - STEP = 653 | |
| 10/17/2023 17:13:47 - INFO - app - STEP = 654 | |
| 10/17/2023 17:13:47 - INFO - app - STEP = 655 | |
| 10/17/2023 17:13:49 - INFO - app - STEP = 656 | |
| 10/17/2023 17:13:50 - INFO - app - STEP = 657 | |
| 10/17/2023 17:13:51 - INFO - app - STEP = 658 | |
| 10/17/2023 17:13:52 - INFO - app - STEP = 659 | |
| 10/17/2023 17:13:53 - INFO - app - STEP = 660 | |
| 10/17/2023 17:13:54 - INFO - app - STEP = 661 | |
| 10/17/2023 17:13:55 - INFO - app - STEP = 662 | |
| 10/17/2023 17:13:56 - INFO - app - STEP = 663 | |
| 10/17/2023 17:13:57 - INFO - app - STEP = 664 | |
| 10/17/2023 17:13:58 - INFO - app - STEP = 665 | |
| 10/17/2023 17:13:59 - INFO - app - STEP = 666 | |
| 10/17/2023 17:14:00 - INFO - app - STEP = 667 | |
| 10/17/2023 17:14:01 - INFO - app - STEP = 668 | |
| 10/17/2023 17:14:02 - INFO - app - STEP = 669 | |
| 10/17/2023 17:14:03 - INFO - app - STEP = 670 | |
| 10/17/2023 17:14:04 - INFO - app - STEP = 671 | |
| 10/17/2023 17:14:05 - INFO - app - STEP = 672 | |
| 10/17/2023 17:14:06 - INFO - app - STEP = 673 | |
| 10/17/2023 17:14:07 - INFO - app - STEP = 674 | |
| 10/17/2023 17:14:08 - INFO - app - STEP = 675 | |
| 10/17/2023 17:14:09 - INFO - app - STEP = 676 | |
| 10/17/2023 17:14:10 - INFO - app - STEP = 677 | |
| 10/17/2023 17:14:11 - INFO - app - STEP = 678 | |
| 10/17/2023 17:14:12 - INFO - app - STEP = 679 | |
| 10/17/2023 17:14:13 - INFO - app - STEP = 680 | |
| 10/17/2023 17:14:14 - INFO - app - STEP = 681 | |
| 10/17/2023 17:14:16 - INFO - app - STEP = 682 | |
| 10/17/2023 17:14:17 - INFO - app - STEP = 683 | |
| 10/17/2023 17:14:18 - INFO - app - STEP = 684 | |
| 10/17/2023 17:14:19 - INFO - app - STEP = 685 | |
| 10/17/2023 17:14:20 - INFO - app - STEP = 686 | |
| 10/17/2023 17:14:21 - INFO - app - STEP = 687 | |
| 10/17/2023 17:14:22 - INFO - app - STEP = 688 | |
| 10/17/2023 17:14:23 - INFO - app - STEP = 689 | |
| 10/17/2023 17:14:24 - INFO - app - STEP = 690 | |
| 10/17/2023 17:14:25 - INFO - app - STEP = 691 | |
| 10/17/2023 17:14:26 - INFO - app - STEP = 692 | |
| 10/17/2023 17:14:27 - INFO - app - STEP = 693 | |
| 10/17/2023 17:14:28 - INFO - app - STEP = 694 | |
| 10/17/2023 17:14:29 - INFO - app - STEP = 695 | |
| 10/17/2023 17:14:30 - INFO - app - STEP = 696 | |
| 10/17/2023 17:14:31 - INFO - app - STEP = 697 | |
| 10/17/2023 17:14:32 - INFO - app - STEP = 698 | |
| 10/17/2023 17:14:33 - INFO - app - STEP = 699 | |
| 10/17/2023 17:14:34 - INFO - app - STEP = 700 | |
| 10/17/2023 17:14:35 - INFO - app - STEP = 701 | |
| 10/17/2023 17:14:36 - INFO - app - STEP = 702 | |
| 10/17/2023 17:14:37 - INFO - app - STEP = 703 | |
| 10/17/2023 17:14:38 - INFO - app - STEP = 704 | |
| 10/17/2023 17:14:39 - INFO - app - STEP = 705 | |
| 10/17/2023 17:14:40 - INFO - app - STEP = 706 | |
| 10/17/2023 17:14:41 - INFO - app - STEP = 707 | |
| 10/17/2023 17:14:42 - INFO - app - STEP = 708 | |
| 10/17/2023 17:14:43 - INFO - app - STEP = 709 | |
| 10/17/2023 17:14:44 - INFO - app - STEP = 710 | |
| 10/17/2023 17:14:45 - INFO - app - STEP = 711 | |
| 10/17/2023 17:14:47 - INFO - app - STEP = 712 | |
| 10/17/2023 17:14:48 - INFO - app - STEP = 713 | |
| 10/17/2023 17:14:49 - INFO - app - STEP = 714 | |
| 10/17/2023 17:14:50 - INFO - app - STEP = 715 | |
| 10/17/2023 17:14:51 - INFO - app - STEP = 716 | |
| 10/17/2023 17:14:52 - INFO - app - STEP = 717 | |
| 10/17/2023 17:14:53 - INFO - app - STEP = 718 | |
| 10/17/2023 17:14:54 - INFO - app - STEP = 719 | |
| 10/17/2023 17:14:55 - INFO - app - STEP = 720 | |
| 10/17/2023 17:14:56 - INFO - app - STEP = 721 | |
| 10/17/2023 17:14:57 - INFO - app - STEP = 722 | |
| 10/17/2023 17:14:58 - INFO - app - STEP = 723 | |
| 10/17/2023 17:14:59 - INFO - app - STEP = 724 | |
| 10/17/2023 17:15:00 - INFO - app - STEP = 725 | |
| 10/17/2023 17:15:01 - INFO - app - STEP = 726 | |
| 10/17/2023 17:15:02 - INFO - app - STEP = 727 | |
| 10/17/2023 17:15:03 - INFO - app - STEP = 728 | |
| 10/17/2023 17:15:04 - INFO - app - STEP = 729 | |
| 10/17/2023 17:15:05 - INFO - app - STEP = 730 | |
| 10/17/2023 17:15:06 - INFO - app - STEP = 731 | |
| 10/17/2023 17:15:07 - INFO - app - STEP = 732 | |
| 10/17/2023 17:15:08 - INFO - app - STEP = 733 | |
| 10/17/2023 17:15:09 - INFO - app - STEP = 734 | |
| 10/17/2023 17:15:10 - INFO - app - STEP = 735 | |
| 10/17/2023 17:15:11 - INFO - app - STEP = 736 | |
| 10/17/2023 17:15:12 - INFO - app - STEP = 737 | |
| 10/17/2023 17:15:13 - INFO - app - STEP = 738 | |
| 10/17/2023 17:15:14 - INFO - app - STEP = 739 | |
| 10/17/2023 17:15:15 - INFO - app - STEP = 740 | |
| 10/17/2023 17:15:17 - INFO - app - STEP = 741 | |
| 10/17/2023 17:15:18 - INFO - app - STEP = 742 | |
| 10/17/2023 17:15:19 - INFO - app - STEP = 743 | |
| 10/17/2023 17:15:20 - INFO - app - STEP = 744 | |
| 10/17/2023 17:15:21 - INFO - app - STEP = 745 | |
| 10/17/2023 17:15:22 - INFO - app - STEP = 746 | |
| 10/17/2023 17:15:23 - INFO - app - STEP = 747 | |
| 10/17/2023 17:15:24 - INFO - app - STEP = 748 | |
| 10/17/2023 17:15:25 - INFO - app - STEP = 749 | |
| 10/17/2023 17:15:26 - INFO - app - STEP = 750 | |
| 10/17/2023 17:15:27 - INFO - app - STEP = 751 | |
| 10/17/2023 17:15:28 - INFO - app - STEP = 752 | |
| 10/17/2023 17:15:29 - INFO - app - STEP = 753 | |
| 10/17/2023 17:15:30 - INFO - app - STEP = 754 | |
| 10/17/2023 17:15:31 - INFO - app - STEP = 755 | |
| 10/17/2023 17:15:32 - INFO - app - Running validation... | |
| Generating 4 images with prompt: A photo of sks dog. | |
| 10/17/2023 17:15:59 - INFO - app - STEP = 756 | |
| 10/17/2023 17:16:00 - INFO - app - STEP = 757 | |
| 10/17/2023 17:16:01 - INFO - app - STEP = 758 | |
| 10/17/2023 17:16:02 - INFO - app - STEP = 759 | |
| 10/17/2023 17:16:03 - INFO - app - STEP = 760 | |
| 10/17/2023 17:16:04 - INFO - app - STEP = 761 | |
| 10/17/2023 17:16:05 - INFO - app - STEP = 762 | |
| 10/17/2023 17:16:06 - INFO - app - STEP = 763 | |
| 10/17/2023 17:16:07 - INFO - app - STEP = 764 | |
| 10/17/2023 17:16:08 - INFO - app - STEP = 765 | |
| 10/17/2023 17:16:09 - INFO - app - STEP = 766 | |
| 10/17/2023 17:16:10 - INFO - app - STEP = 767 | |
| 10/17/2023 17:16:11 - INFO - app - STEP = 768 | |
| 10/17/2023 17:16:12 - INFO - app - STEP = 769 | |
| 10/17/2023 17:16:13 - INFO - app - STEP = 770 | |
| 10/17/2023 17:16:14 - INFO - app - STEP = 771 | |
| 10/17/2023 17:16:15 - INFO - app - STEP = 772 | |
| 10/17/2023 17:16:16 - INFO - app - STEP = 773 | |
| 10/17/2023 17:16:17 - INFO - app - STEP = 774 | |
| 10/17/2023 17:16:18 - INFO - app - STEP = 775 | |
| 10/17/2023 17:16:20 - INFO - app - STEP = 776 | |
| 10/17/2023 17:16:21 - INFO - app - STEP = 777 | |
| 10/17/2023 17:16:22 - INFO - app - STEP = 778 | |
| 10/17/2023 17:16:23 - INFO - app - STEP = 779 | |
| 10/17/2023 17:16:24 - INFO - app - STEP = 780 | |
| 10/17/2023 17:16:25 - INFO - app - STEP = 781 | |
| 10/17/2023 17:16:26 - INFO - app - STEP = 782 | |
| 10/17/2023 17:16:27 - INFO - app - STEP = 783 | |
| 10/17/2023 17:16:28 - INFO - app - STEP = 784 | |
| 10/17/2023 17:16:29 - INFO - app - STEP = 785 | |
| 10/17/2023 17:16:30 - INFO - app - STEP = 786 | |
| 10/17/2023 17:16:31 - INFO - app - STEP = 787 | |
| 10/17/2023 17:16:32 - INFO - app - STEP = 788 | |
| 10/17/2023 17:16:33 - INFO - app - STEP = 789 | |
| 10/17/2023 17:16:34 - INFO - app - STEP = 790 | |
| 10/17/2023 17:16:35 - INFO - app - STEP = 791 | |
| 10/17/2023 17:16:36 - INFO - app - STEP = 792 | |
| 10/17/2023 17:16:37 - INFO - app - STEP = 793 | |
| 10/17/2023 17:16:38 - INFO - app - STEP = 794 | |
| 10/17/2023 17:16:39 - INFO - app - STEP = 795 | |
| 10/17/2023 17:16:40 - INFO - app - STEP = 796 | |
| 10/17/2023 17:16:41 - INFO - app - STEP = 797 | |
| 10/17/2023 17:16:42 - INFO - app - STEP = 798 | |
| 10/17/2023 17:16:43 - INFO - app - STEP = 799 | |
| 10/17/2023 17:16:44 - INFO - app - STEP = 800 | |
| 10/17/2023 17:16:46 - INFO - app - STEP = 801 | |
| 10/17/2023 17:16:47 - INFO - app - STEP = 802 | |
| 10/17/2023 17:16:48 - INFO - app - STEP = 803 | |
| 10/17/2023 17:16:49 - INFO - app - STEP = 804 | |
| 10/17/2023 17:16:50 - INFO - app - STEP = 805 | |
| 10/17/2023 17:16:51 - INFO - app - STEP = 806 | |
| 10/17/2023 17:16:52 - INFO - app - STEP = 807 | |
| 10/17/2023 17:16:53 - INFO - app - STEP = 808 | |
| 10/17/2023 17:16:54 - INFO - app - STEP = 809 | |
| 10/17/2023 17:16:55 - INFO - app - STEP = 810 | |
| 10/17/2023 17:16:56 - INFO - app - STEP = 811 | |
| 10/17/2023 17:16:57 - INFO - app - STEP = 812 | |
| 10/17/2023 17:16:58 - INFO - app - STEP = 813 | |
| 10/17/2023 17:16:59 - INFO - app - STEP = 814 | |
| 10/17/2023 17:17:00 - INFO - app - STEP = 815 | |
| 10/17/2023 17:17:01 - INFO - app - STEP = 816 | |
| 10/17/2023 17:17:02 - INFO - app - STEP = 817 | |
| 10/17/2023 17:17:03 - INFO - app - STEP = 818 | |
| 10/17/2023 17:17:04 - INFO - app - STEP = 819 | |
| 10/17/2023 17:17:05 - INFO - app - STEP = 820 | |
| 10/17/2023 17:17:06 - INFO - app - STEP = 821 | |
| 10/17/2023 17:17:07 - INFO - app - STEP = 822 | |
| 10/17/2023 17:17:08 - INFO - app - STEP = 823 | |
| 10/17/2023 17:17:09 - INFO - app - STEP = 824 | |
| 10/17/2023 17:17:10 - INFO - app - STEP = 825 | |
| 10/17/2023 17:17:11 - INFO - app - STEP = 826 | |
| 10/17/2023 17:17:12 - INFO - app - STEP = 827 | |
| 10/17/2023 17:17:13 - INFO - app - STEP = 828 | |
| 10/17/2023 17:17:14 - INFO - app - STEP = 829 | |
| 10/17/2023 17:17:15 - INFO - app - STEP = 830 | |
| 10/17/2023 17:17:17 - INFO - app - STEP = 831 | |
| 10/17/2023 17:17:18 - INFO - app - STEP = 832 | |
| 10/17/2023 17:17:19 - INFO - app - STEP = 833 | |
| 10/17/2023 17:17:20 - INFO - app - STEP = 834 | |
| 10/17/2023 17:17:21 - INFO - accelerate.accelerator - Saving current state to models/zee-test/checkpoint-500 | |
| 10/17/2023 17:17:21 - INFO - accelerate.checkpointing - Optimizer state saved in models/zee-test/checkpoint-500/optimizer.bin | |
| 10/17/2023 17:17:21 - INFO - accelerate.checkpointing - Scheduler state saved in models/zee-test/checkpoint-500/scheduler.bin | |
| 10/17/2023 17:17:21 - INFO - accelerate.checkpointing - Random states saved in models/zee-test/checkpoint-500/random_states_0.pkl | |
| 10/17/2023 17:17:21 - INFO - app - Saved state to models/zee-test/checkpoint-500 | |
| 10/17/2023 17:17:21 - INFO - app - STEP = 835 | |
| 10/17/2023 17:17:22 - INFO - app - STEP = 836 | |
| 10/17/2023 17:17:23 - INFO - app - STEP = 837 | |
| 10/17/2023 17:17:24 - INFO - app - STEP = 838 | |
| 10/17/2023 17:17:25 - INFO - app - STEP = 839 | |
| 10/17/2023 17:17:26 - INFO - app - STEP = 840 | |
| 10/17/2023 17:17:27 - INFO - app - STEP = 841 | |
| 10/17/2023 17:17:28 - INFO - app - STEP = 842 | |
| 10/17/2023 17:17:29 - INFO - app - STEP = 843 | |
| 10/17/2023 17:17:30 - INFO - app - STEP = 844 | |
| 10/17/2023 17:17:31 - INFO - app - STEP = 845 | |
| 10/17/2023 17:17:32 - INFO - app - STEP = 846 | |
| 10/17/2023 17:17:33 - INFO - app - STEP = 847 | |
| 10/17/2023 17:17:34 - INFO - app - STEP = 848 | |
| 10/17/2023 17:17:35 - INFO - app - STEP = 849 | |
| 10/17/2023 17:17:36 - INFO - app - STEP = 850 | |
| 10/17/2023 17:17:37 - INFO - app - STEP = 851 | |
| 10/17/2023 17:17:39 - INFO - app - STEP = 852 | |
| 10/17/2023 17:17:40 - INFO - app - STEP = 853 | |
| 10/17/2023 17:17:41 - INFO - app - STEP = 854 | |
| 10/17/2023 17:17:42 - INFO - app - STEP = 855 | |
| 10/17/2023 17:17:43 - INFO - app - STEP = 856 | |
| 10/17/2023 17:17:44 - INFO - app - STEP = 857 | |
| 10/17/2023 17:17:45 - INFO - app - STEP = 858 | |
| 10/17/2023 17:17:46 - INFO - app - STEP = 859 | |
| 10/17/2023 17:17:47 - INFO - app - STEP = 860 | |
| 10/17/2023 17:17:48 - INFO - app - STEP = 861 | |
| 10/17/2023 17:17:49 - INFO - app - STEP = 862 | |
| 10/17/2023 17:17:50 - INFO - app - STEP = 863 | |
| 10/17/2023 17:17:51 - INFO - app - STEP = 864 | |
| 10/17/2023 17:17:52 - INFO - app - STEP = 865 | |
| 10/17/2023 17:17:53 - INFO - app - STEP = 866 | |
| 10/17/2023 17:17:54 - INFO - app - STEP = 867 | |
| 10/17/2023 17:17:55 - INFO - app - STEP = 868 | |
| 10/17/2023 17:17:56 - INFO - app - STEP = 869 | |
| 10/17/2023 17:17:57 - INFO - app - STEP = 870 | |
| 10/17/2023 17:17:58 - INFO - app - STEP = 871 | |
| 10/17/2023 17:17:59 - INFO - app - STEP = 872 | |
| 10/17/2023 17:18:00 - INFO - app - STEP = 873 | |
| 10/17/2023 17:18:01 - INFO - app - STEP = 874 | |
| 10/17/2023 17:18:02 - INFO - app - STEP = 875 | |
| 10/17/2023 17:18:03 - INFO - app - STEP = 876 | |
| 10/17/2023 17:18:04 - INFO - app - STEP = 877 | |
| 10/17/2023 17:18:06 - INFO - app - STEP = 878 | |
| 10/17/2023 17:18:07 - INFO - app - STEP = 879 | |
| 10/17/2023 17:18:08 - INFO - app - STEP = 880 | |
| 10/17/2023 17:18:08 - INFO - app - Running validation... | |
| Generating 4 images with prompt: A photo of sks dog. | |
| 10/17/2023 17:18:35 - INFO - app - STEP = 881 | |
| 10/17/2023 17:18:36 - INFO - app - STEP = 882 | |
| 10/17/2023 17:18:37 - INFO - app - STEP = 883 | |
| 10/17/2023 17:18:38 - INFO - app - STEP = 884 | |
| 10/17/2023 17:18:39 - INFO - app - STEP = 885 | |
| 10/17/2023 17:18:40 - INFO - app - STEP = 886 | |
| 10/17/2023 17:18:41 - INFO - app - STEP = 887 | |
| 10/17/2023 17:18:42 - INFO - app - STEP = 888 | |
| 10/17/2023 17:18:43 - INFO - app - STEP = 889 | |
| 10/17/2023 17:18:44 - INFO - app - STEP = 890 | |
| 10/17/2023 17:18:45 - INFO - app - STEP = 891 | |
| 10/17/2023 17:18:46 - INFO - app - STEP = 892 | |
| 10/17/2023 17:18:47 - INFO - app - STEP = 893 | |
| 10/17/2023 17:18:48 - INFO - app - STEP = 894 | |
| 10/17/2023 17:18:49 - INFO - app - STEP = 895 | |
| 10/17/2023 17:18:51 - INFO - app - STEP = 896 | |
| 10/17/2023 17:18:52 - INFO - app - STEP = 897 | |
| 10/17/2023 17:18:53 - INFO - app - STEP = 898 | |
| 10/17/2023 17:18:54 - INFO - app - STEP = 899 | |
| 10/17/2023 17:18:55 - INFO - app - STEP = 900 | |
| 10/17/2023 17:18:56 - INFO - app - STEP = 901 | |
| 10/17/2023 17:18:57 - INFO - app - STEP = 902 | |
| 10/17/2023 17:18:58 - INFO - app - STEP = 903 | |
| 10/17/2023 17:18:59 - INFO - app - STEP = 904 | |
| 10/17/2023 17:19:00 - INFO - app - STEP = 905 | |
| 10/17/2023 17:19:01 - INFO - app - STEP = 906 | |
| 10/17/2023 17:19:02 - INFO - app - STEP = 907 | |
| 10/17/2023 17:19:03 - INFO - app - STEP = 908 | |
| 10/17/2023 17:19:04 - INFO - app - STEP = 909 | |
| 10/17/2023 17:19:05 - INFO - app - STEP = 910 | |
| 10/17/2023 17:19:06 - INFO - app - STEP = 911 | |
| 10/17/2023 17:19:07 - INFO - app - STEP = 912 | |
| 10/17/2023 17:19:08 - INFO - app - STEP = 913 | |
| 10/17/2023 17:19:09 - INFO - app - STEP = 914 | |
| 10/17/2023 17:19:10 - INFO - app - STEP = 915 | |
| 10/17/2023 17:19:11 - INFO - app - STEP = 916 | |
| 10/17/2023 17:19:12 - INFO - app - STEP = 917 | |
| 10/17/2023 17:19:13 - INFO - app - STEP = 918 | |
| 10/17/2023 17:19:14 - INFO - app - STEP = 919 | |
| 10/17/2023 17:19:15 - INFO - app - STEP = 920 | |
| 10/17/2023 17:19:16 - INFO - app - STEP = 921 | |
| 10/17/2023 17:19:17 - INFO - app - STEP = 922 | |
| 10/17/2023 17:19:18 - INFO - app - STEP = 923 | |
| 10/17/2023 17:19:19 - INFO - app - STEP = 924 | |
| 10/17/2023 17:19:20 - INFO - app - STEP = 925 | |
| 10/17/2023 17:19:22 - INFO - app - STEP = 926 | |
| 10/17/2023 17:19:23 - INFO - app - STEP = 927 | |
| 10/17/2023 17:19:24 - INFO - app - STEP = 928 | |
| 10/17/2023 17:19:25 - INFO - app - STEP = 929 | |
| 10/17/2023 17:19:26 - INFO - app - STEP = 930 | |
| 10/17/2023 17:19:27 - INFO - app - STEP = 931 | |
| 10/17/2023 17:19:28 - INFO - app - STEP = 932 | |
| 10/17/2023 17:19:29 - INFO - app - STEP = 933 | |
| 10/17/2023 17:19:30 - INFO - app - STEP = 934 | |
| 10/17/2023 17:19:31 - INFO - app - STEP = 935 | |
| 10/17/2023 17:19:32 - INFO - app - STEP = 936 | |
| 10/17/2023 17:19:33 - INFO - app - STEP = 937 | |
| 10/17/2023 17:19:34 - INFO - app - STEP = 938 | |
| 10/17/2023 17:19:35 - INFO - app - STEP = 939 | |
| 10/17/2023 17:19:36 - INFO - app - STEP = 940 | |
| 10/17/2023 17:19:37 - INFO - app - STEP = 941 | |
| 10/17/2023 17:19:38 - INFO - app - STEP = 942 | |
| 10/17/2023 17:19:39 - INFO - app - STEP = 943 | |
| 10/17/2023 17:19:40 - INFO - app - STEP = 944 | |
| 10/17/2023 17:19:41 - INFO - app - STEP = 945 | |
| 10/17/2023 17:19:42 - INFO - app - STEP = 946 | |
| 10/17/2023 17:19:43 - INFO - app - STEP = 947 | |
| 10/17/2023 17:19:44 - INFO - app - STEP = 948 | |
| 10/17/2023 17:19:45 - INFO - app - STEP = 949 | |
| 10/17/2023 17:19:46 - INFO - app - STEP = 950 | |
| 10/17/2023 17:19:47 - INFO - app - STEP = 951 | |
| 10/17/2023 17:19:49 - INFO - app - STEP = 952 | |
| 10/17/2023 17:19:50 - INFO - app - STEP = 953 | |
| 10/17/2023 17:19:51 - INFO - app - STEP = 954 | |
| 10/17/2023 17:19:51 - INFO - app - STEP = 955 | |
| 10/17/2023 17:19:53 - INFO - app - STEP = 956 | |
| 10/17/2023 17:19:54 - INFO - app - STEP = 957 | |
| 10/17/2023 17:19:55 - INFO - app - STEP = 958 | |
| 10/17/2023 17:19:56 - INFO - app - STEP = 959 | |
| 10/17/2023 17:19:57 - INFO - app - STEP = 960 | |
| 10/17/2023 17:19:58 - INFO - app - STEP = 961 | |
| 10/17/2023 17:19:59 - INFO - app - STEP = 962 | |
| 10/17/2023 17:20:00 - INFO - app - STEP = 963 | |
| 10/17/2023 17:20:01 - INFO - app - STEP = 964 | |
| 10/17/2023 17:20:02 - INFO - app - STEP = 965 | |
| 10/17/2023 17:20:03 - INFO - app - STEP = 966 | |
| 10/17/2023 17:20:04 - INFO - app - STEP = 967 | |
| 10/17/2023 17:20:05 - INFO - app - STEP = 968 | |
| 10/17/2023 17:20:06 - INFO - app - STEP = 969 | |
| 10/17/2023 17:20:07 - INFO - app - STEP = 970 | |
| 10/17/2023 17:20:08 - INFO - app - STEP = 971 | |
| 10/17/2023 17:20:09 - INFO - app - STEP = 972 | |
| 10/17/2023 17:20:10 - INFO - app - STEP = 973 | |
| 10/17/2023 17:20:11 - INFO - app - STEP = 974 | |
| 10/17/2023 17:20:12 - INFO - app - STEP = 975 | |
| 10/17/2023 17:20:13 - INFO - app - STEP = 976 | |
| 10/17/2023 17:20:14 - INFO - app - STEP = 977 | |
| 10/17/2023 17:20:15 - INFO - app - STEP = 978 | |
| 10/17/2023 17:20:16 - INFO - app - STEP = 979 | |
| 10/17/2023 17:20:17 - INFO - app - STEP = 980 | |
| 10/17/2023 17:20:18 - INFO - app - STEP = 981 | |
| 10/17/2023 17:20:20 - INFO - app - STEP = 982 | |
| 10/17/2023 17:20:21 - INFO - app - STEP = 983 | |
| 10/17/2023 17:20:22 - INFO - app - STEP = 984 | |
| 10/17/2023 17:20:23 - INFO - app - STEP = 985 | |
| 10/17/2023 17:20:24 - INFO - app - STEP = 986 | |
| 10/17/2023 17:20:25 - INFO - app - STEP = 987 | |
| 10/17/2023 17:20:26 - INFO - app - STEP = 988 | |
| 10/17/2023 17:20:27 - INFO - app - STEP = 989 | |
| 10/17/2023 17:20:28 - INFO - app - STEP = 990 | |
| 10/17/2023 17:20:29 - INFO - app - STEP = 991 | |
| 10/17/2023 17:20:30 - INFO - app - STEP = 992 | |
| 10/17/2023 17:20:31 - INFO - app - STEP = 993 | |
| 10/17/2023 17:20:32 - INFO - app - STEP = 994 | |
| 10/17/2023 17:20:33 - INFO - app - STEP = 995 | |
| 10/17/2023 17:20:34 - INFO - app - STEP = 996 | |
| 10/17/2023 17:20:35 - INFO - app - STEP = 997 | |
| 10/17/2023 17:20:36 - INFO - app - STEP = 998 | |
| 10/17/2023 17:20:37 - INFO - app - STEP = 999 | |
| 10/17/2023 17:20:38 - INFO - app - STEP = 1000 | |
| 10/17/2023 17:20:39 - INFO - app - STEP = 1001 | |
| 10/17/2023 17:20:40 - INFO - app - STEP = 1002 | |
| 10/17/2023 17:20:41 - INFO - app - STEP = 1003 | |
| 10/17/2023 17:20:42 - INFO - app - STEP = 1004 | |
| 10/17/2023 17:20:43 - INFO - app - STEP = 1005 | |
| 10/17/2023 17:20:44 - INFO - app - Running validation... | |
| Generating 4 images with prompt: A photo of sks dog. | |
| 10/17/2023 17:21:11 - INFO - app - STEP = 1006 | |
| 10/17/2023 17:21:12 - INFO - app - STEP = 1007 | |
| 10/17/2023 17:21:13 - INFO - app - STEP = 1008 | |
| 10/17/2023 17:21:14 - INFO - app - STEP = 1009 | |
| 10/17/2023 17:21:15 - INFO - app - STEP = 1010 | |
| 10/17/2023 17:21:16 - INFO - app - STEP = 1011 | |
| 10/17/2023 17:21:17 - INFO - app - STEP = 1012 | |
| 10/17/2023 17:21:18 - INFO - app - STEP = 1013 | |
| 10/17/2023 17:21:20 - INFO - app - STEP = 1014 | |
| 10/17/2023 17:21:20 - INFO - app - STEP = 1015 | |
| 10/17/2023 17:21:22 - INFO - app - STEP = 1016 | |
| 10/17/2023 17:21:23 - INFO - app - STEP = 1017 | |
| 10/17/2023 17:21:24 - INFO - app - STEP = 1018 | |
| 10/17/2023 17:21:25 - INFO - app - STEP = 1019 | |
| 10/17/2023 17:21:26 - INFO - app - STEP = 1020 | |
| 10/17/2023 17:21:27 - INFO - app - STEP = 1021 | |
| 10/17/2023 17:21:28 - INFO - app - STEP = 1022 | |
| 10/17/2023 17:21:29 - INFO - app - STEP = 1023 | |
| 10/17/2023 17:21:30 - INFO - app - STEP = 1024 | |
| 10/17/2023 17:21:31 - INFO - app - STEP = 1025 | |
| 10/17/2023 17:21:33 - INFO - app - STEP = 1026 | |
| 10/17/2023 17:21:34 - INFO - app - STEP = 1027 | |
| 10/17/2023 17:21:35 - INFO - app - STEP = 1028 | |
| 10/17/2023 17:21:36 - INFO - app - STEP = 1029 | |
| 10/17/2023 17:21:37 - INFO - app - STEP = 1030 | |
| 10/17/2023 17:21:38 - INFO - app - STEP = 1031 | |
| 10/17/2023 17:21:39 - INFO - app - STEP = 1032 | |
| 10/17/2023 17:21:40 - INFO - app - STEP = 1033 | |
| 10/17/2023 17:21:41 - INFO - app - STEP = 1034 | |
| 10/17/2023 17:21:42 - INFO - app - STEP = 1035 | |
| 10/17/2023 17:21:43 - INFO - app - STEP = 1036 | |
| 10/17/2023 17:21:44 - INFO - app - STEP = 1037 | |
| 10/17/2023 17:21:45 - INFO - app - STEP = 1038 | |
| 10/17/2023 17:21:47 - INFO - app - STEP = 1039 | |
| 10/17/2023 17:21:48 - INFO - app - STEP = 1040 | |
| 10/17/2023 17:21:49 - INFO - app - STEP = 1041 | |
| 10/17/2023 17:21:50 - INFO - app - STEP = 1042 | |
| 10/17/2023 17:21:51 - INFO - app - STEP = 1043 | |
| 10/17/2023 17:21:52 - INFO - app - STEP = 1044 | |
| 10/17/2023 17:21:53 - INFO - app - STEP = 1045 | |
| 10/17/2023 17:21:55 - INFO - app - STEP = 1046 | |
| 10/17/2023 17:21:56 - INFO - app - STEP = 1047 | |
| 10/17/2023 17:21:57 - INFO - app - STEP = 1048 | |
| 10/17/2023 17:21:58 - INFO - app - STEP = 1049 | |
| 10/17/2023 17:21:59 - INFO - app - STEP = 1050 | |
| 10/17/2023 17:22:00 - INFO - app - STEP = 1051 | |
| 10/17/2023 17:22:01 - INFO - app - STEP = 1052 | |
| 10/17/2023 17:22:02 - INFO - app - STEP = 1053 | |
| 10/17/2023 17:22:03 - INFO - app - STEP = 1054 | |
| 10/17/2023 17:22:04 - INFO - app - STEP = 1055 | |
| 10/17/2023 17:22:06 - INFO - app - STEP = 1056 | |
| 10/17/2023 17:22:07 - INFO - app - STEP = 1057 | |
| 10/17/2023 17:22:08 - INFO - app - STEP = 1058 | |
| 10/17/2023 17:22:09 - INFO - app - STEP = 1059 | |
| 10/17/2023 17:22:10 - INFO - app - STEP = 1060 | |
| 10/17/2023 17:22:11 - INFO - app - STEP = 1061 | |
| 10/17/2023 17:22:12 - INFO - app - STEP = 1062 | |
| 10/17/2023 17:22:14 - INFO - app - STEP = 1063 | |
| 10/17/2023 17:22:15 - INFO - app - STEP = 1064 | |
| 10/17/2023 17:22:16 - INFO - app - STEP = 1065 | |
| 10/17/2023 17:22:17 - INFO - app - STEP = 1066 | |
| 10/17/2023 17:22:18 - INFO - app - STEP = 1067 | |
| 10/17/2023 17:22:19 - INFO - app - STEP = 1068 | |
| 10/17/2023 17:22:20 - INFO - app - STEP = 1069 | |
| 10/17/2023 17:22:21 - INFO - app - STEP = 1070 | |
| 10/17/2023 17:22:22 - INFO - app - STEP = 1071 | |
| 10/17/2023 17:22:23 - INFO - app - STEP = 1072 | |
| 10/17/2023 17:22:24 - INFO - app - STEP = 1073 | |
| 10/17/2023 17:22:25 - INFO - app - STEP = 1074 | |
| 10/17/2023 17:22:26 - INFO - app - STEP = 1075 | |
| 10/17/2023 17:22:27 - INFO - app - STEP = 1076 | |
| 10/17/2023 17:22:28 - INFO - app - STEP = 1077 | |
| 10/17/2023 17:22:29 - INFO - app - STEP = 1078 | |
| 10/17/2023 17:22:30 - INFO - app - STEP = 1079 | |
| 10/17/2023 17:22:31 - INFO - app - STEP = 1080 | |
| 10/17/2023 17:22:32 - INFO - app - STEP = 1081 | |
| 10/17/2023 17:22:33 - INFO - app - STEP = 1082 | |
| 10/17/2023 17:22:34 - INFO - app - STEP = 1083 | |
| 10/17/2023 17:22:35 - INFO - app - STEP = 1084 | |
| 10/17/2023 17:22:36 - INFO - app - STEP = 1085 | |
| 10/17/2023 17:22:37 - INFO - app - STEP = 1086 | |
| 10/17/2023 17:22:38 - INFO - app - STEP = 1087 | |
| 10/17/2023 17:22:39 - INFO - app - STEP = 1088 | |
| 10/17/2023 17:22:40 - INFO - app - STEP = 1089 | |
| 10/17/2023 17:22:41 - INFO - app - STEP = 1090 | |
| 10/17/2023 17:22:42 - INFO - app - STEP = 1091 | |
| 10/17/2023 17:22:43 - INFO - app - STEP = 1092 | |
| 10/17/2023 17:22:44 - INFO - app - STEP = 1093 | |
| 10/17/2023 17:22:46 - INFO - app - STEP = 1094 | |
| 10/17/2023 17:22:46 - INFO - app - STEP = 1095 | |
| 10/17/2023 17:22:48 - INFO - app - STEP = 1096 | |
| 10/17/2023 17:22:49 - INFO - app - STEP = 1097 | |
| 10/17/2023 17:22:50 - INFO - app - STEP = 1098 | |
| 10/17/2023 17:22:51 - INFO - app - STEP = 1099 | |
| 10/17/2023 17:22:52 - INFO - app - STEP = 1100 | |
| 10/17/2023 17:22:53 - INFO - app - STEP = 1101 | |
| 10/17/2023 17:22:54 - INFO - app - STEP = 1102 | |
| 10/17/2023 17:22:55 - INFO - app - STEP = 1103 | |
| 10/17/2023 17:22:56 - INFO - app - STEP = 1104 | |
| 10/17/2023 17:22:57 - INFO - app - STEP = 1105 | |
| 10/17/2023 17:22:58 - INFO - app - STEP = 1106 | |
| 10/17/2023 17:22:59 - INFO - app - STEP = 1107 | |
| 10/17/2023 17:23:00 - INFO - app - STEP = 1108 | |
| 10/17/2023 17:23:01 - INFO - app - STEP = 1109 | |
| 10/17/2023 17:23:02 - INFO - app - STEP = 1110 | |
| 10/17/2023 17:23:03 - INFO - app - STEP = 1111 | |
| 10/17/2023 17:23:04 - INFO - app - STEP = 1112 | |
| 10/17/2023 17:23:05 - INFO - app - STEP = 1113 | |
| 10/17/2023 17:23:06 - INFO - app - STEP = 1114 | |
| 10/17/2023 17:23:07 - INFO - app - STEP = 1115 | |
| 10/17/2023 17:23:08 - INFO - app - STEP = 1116 | |
| 10/17/2023 17:23:09 - INFO - app - STEP = 1117 | |
| 10/17/2023 17:23:10 - INFO - app - STEP = 1118 | |
| 10/17/2023 17:23:11 - INFO - app - STEP = 1119 | |
| 10/17/2023 17:23:12 - INFO - app - STEP = 1120 | |
| 10/17/2023 17:23:13 - INFO - app - STEP = 1121 | |
| 10/17/2023 17:23:14 - INFO - app - STEP = 1122 | |
| 10/17/2023 17:23:15 - INFO - app - STEP = 1123 | |
| 10/17/2023 17:23:16 - INFO - app - STEP = 1124 | |
| 10/17/2023 17:23:17 - INFO - app - STEP = 1125 | |
| 10/17/2023 17:23:18 - INFO - app - STEP = 1126 | |
| 10/17/2023 17:23:20 - INFO - app - STEP = 1127 | |
| 10/17/2023 17:23:21 - INFO - app - STEP = 1128 | |
| 10/17/2023 17:23:22 - INFO - app - STEP = 1129 | |
| 10/17/2023 17:23:23 - INFO - app - STEP = 1130 | |
| 10/17/2023 17:23:24 - INFO - app - Running validation... | |
| Generating 4 images with prompt: A photo of sks dog. | |
| 10/17/2023 17:23:50 - INFO - app - STEP = 1131 | |
| 10/17/2023 17:23:51 - INFO - app - STEP = 1132 | |
| 10/17/2023 17:23:52 - INFO - app - STEP = 1133 | |
| 10/17/2023 17:23:53 - INFO - app - STEP = 1134 | |
| 10/17/2023 17:23:54 - INFO - app - STEP = 1135 | |
| 10/17/2023 17:23:55 - INFO - app - STEP = 1136 | |
| 10/17/2023 17:23:56 - INFO - app - STEP = 1137 | |
| 10/17/2023 17:23:57 - INFO - app - STEP = 1138 | |
| 10/17/2023 17:23:58 - INFO - app - STEP = 1139 | |
| 10/17/2023 17:23:59 - INFO - app - STEP = 1140 | |
| 10/17/2023 17:24:00 - INFO - app - STEP = 1141 | |
| 10/17/2023 17:24:01 - INFO - app - STEP = 1142 | |
| 10/17/2023 17:24:03 - INFO - app - STEP = 1143 | |
| 10/17/2023 17:24:04 - INFO - app - STEP = 1144 | |
| 10/17/2023 17:24:05 - INFO - app - STEP = 1145 | |
| 10/17/2023 17:24:06 - INFO - app - STEP = 1146 | |
| 10/17/2023 17:24:07 - INFO - app - STEP = 1147 | |
| 10/17/2023 17:24:08 - INFO - app - STEP = 1148 | |
| 10/17/2023 17:24:09 - INFO - app - STEP = 1149 | |
| 10/17/2023 17:24:10 - INFO - app - STEP = 1150 | |
| 10/17/2023 17:24:11 - INFO - app - STEP = 1151 | |
| 10/17/2023 17:24:12 - INFO - app - STEP = 1152 | |
| 10/17/2023 17:24:13 - INFO - app - STEP = 1153 | |
| 10/17/2023 17:24:14 - INFO - app - STEP = 1154 | |
| 10/17/2023 17:24:15 - INFO - app - STEP = 1155 | |
| 10/17/2023 17:24:16 - INFO - app - STEP = 1156 | |
| 10/17/2023 17:24:17 - INFO - app - STEP = 1157 | |
| 10/17/2023 17:24:18 - INFO - app - STEP = 1158 | |
| 10/17/2023 17:24:19 - INFO - app - STEP = 1159 | |
| 10/17/2023 17:24:20 - INFO - app - STEP = 1160 | |
| 10/17/2023 17:24:21 - INFO - app - STEP = 1161 | |
| 10/17/2023 17:24:22 - INFO - app - STEP = 1162 | |
| 10/17/2023 17:24:23 - INFO - app - STEP = 1163 | |
| 10/17/2023 17:24:24 - INFO - app - STEP = 1164 | |
| 10/17/2023 17:24:25 - INFO - app - STEP = 1165 | |
| 10/17/2023 17:24:26 - INFO - app - STEP = 1166 | |
| 10/17/2023 17:24:27 - INFO - app - STEP = 1167 | |
| 10/17/2023 17:24:28 - INFO - app - STEP = 1168 | |
| 10/17/2023 17:24:29 - INFO - app - STEP = 1169 | |
| 10/17/2023 17:24:30 - INFO - app - STEP = 1170 | |
| 10/17/2023 17:24:32 - INFO - app - STEP = 1171 | |
| 10/17/2023 17:24:33 - INFO - app - STEP = 1172 | |
| 10/17/2023 17:24:34 - INFO - app - STEP = 1173 | |
| 10/17/2023 17:24:35 - INFO - app - STEP = 1174 | |
| 10/17/2023 17:24:36 - INFO - app - STEP = 1175 | |
| 10/17/2023 17:24:37 - INFO - app - STEP = 1176 | |
| 10/17/2023 17:24:38 - INFO - app - STEP = 1177 | |
| 10/17/2023 17:24:39 - INFO - app - STEP = 1178 | |
| 10/17/2023 17:24:40 - INFO - app - STEP = 1179 | |
| 10/17/2023 17:24:41 - INFO - app - STEP = 1180 | |
| 10/17/2023 17:24:42 - INFO - app - STEP = 1181 | |
| 10/17/2023 17:24:43 - INFO - app - STEP = 1182 | |
| 10/17/2023 17:24:44 - INFO - app - STEP = 1183 | |
| 10/17/2023 17:24:45 - INFO - app - STEP = 1184 | |
| 10/17/2023 17:24:46 - INFO - app - STEP = 1185 | |
| 10/17/2023 17:24:47 - INFO - app - STEP = 1186 | |
| 10/17/2023 17:24:48 - INFO - app - STEP = 1187 | |
| 10/17/2023 17:24:49 - INFO - app - STEP = 1188 | |
| 10/17/2023 17:24:50 - INFO - app - STEP = 1189 | |
| 10/17/2023 17:24:51 - INFO - app - STEP = 1190 | |
| 10/17/2023 17:24:52 - INFO - app - STEP = 1191 | |
| 10/17/2023 17:24:53 - INFO - app - STEP = 1192 | |
| 10/17/2023 17:24:54 - INFO - app - STEP = 1193 | |
| 10/17/2023 17:24:55 - INFO - app - STEP = 1194 | |
| 10/17/2023 17:24:56 - INFO - app - STEP = 1195 | |
| 10/17/2023 17:24:57 - INFO - app - STEP = 1196 | |
| 10/17/2023 17:24:58 - INFO - app - STEP = 1197 | |
| 10/17/2023 17:24:59 - INFO - app - STEP = 1198 | |
| 10/17/2023 17:25:00 - INFO - app - STEP = 1199 | |
| 10/17/2023 17:25:01 - INFO - app - STEP = 1200 | |
| 10/17/2023 17:25:03 - INFO - app - STEP = 1201 | |
| 10/17/2023 17:25:04 - INFO - app - STEP = 1202 | |
| 10/17/2023 17:25:05 - INFO - app - STEP = 1203 | |
| 10/17/2023 17:25:06 - INFO - app - STEP = 1204 | |
| 10/17/2023 17:25:07 - INFO - app - STEP = 1205 | |
| 10/17/2023 17:25:08 - INFO - app - STEP = 1206 | |
| 10/17/2023 17:25:09 - INFO - app - STEP = 1207 | |
| 10/17/2023 17:25:10 - INFO - app - STEP = 1208 | |
| 10/17/2023 17:25:11 - INFO - app - STEP = 1209 | |
| 10/17/2023 17:25:12 - INFO - app - STEP = 1210 | |
| 10/17/2023 17:25:13 - INFO - app - STEP = 1211 | |
| 10/17/2023 17:25:14 - INFO - app - STEP = 1212 | |
| 10/17/2023 17:25:15 - INFO - app - STEP = 1213 | |
| 10/17/2023 17:25:16 - INFO - app - STEP = 1214 | |
| 10/17/2023 17:25:17 - INFO - app - STEP = 1215 | |
| 10/17/2023 17:25:18 - INFO - app - STEP = 1216 | |
| 10/17/2023 17:25:19 - INFO - app - STEP = 1217 | |
| 10/17/2023 17:25:20 - INFO - app - STEP = 1218 | |
| 10/17/2023 17:25:21 - INFO - app - STEP = 1219 | |
| 10/17/2023 17:25:22 - INFO - app - STEP = 1220 | |
| 10/17/2023 17:25:23 - INFO - app - STEP = 1221 | |
| 10/17/2023 17:25:24 - INFO - app - STEP = 1222 | |
| 10/17/2023 17:25:25 - INFO - app - STEP = 1223 | |
| 10/17/2023 17:25:26 - INFO - app - STEP = 1224 | |
| 10/17/2023 17:25:27 - INFO - app - STEP = 1225 | |
| 10/17/2023 17:25:28 - INFO - app - STEP = 1226 | |
| 10/17/2023 17:25:29 - INFO - app - STEP = 1227 | |
| 10/17/2023 17:25:31 - INFO - app - STEP = 1228 | |
| 10/17/2023 17:25:32 - INFO - app - STEP = 1229 | |
| 10/17/2023 17:25:32 - INFO - app - STEP = 1230 | |
| 10/17/2023 17:25:34 - INFO - app - STEP = 1231 | |
| 10/17/2023 17:25:35 - INFO - app - STEP = 1232 | |
| 10/17/2023 17:25:36 - INFO - app - STEP = 1233 | |
| 10/17/2023 17:25:37 - INFO - app - STEP = 1234 | |
| 10/17/2023 17:25:38 - INFO - app - STEP = 1235 | |
| 10/17/2023 17:25:39 - INFO - app - STEP = 1236 | |
| 10/17/2023 17:25:40 - INFO - app - STEP = 1237 | |
| 10/17/2023 17:25:41 - INFO - app - STEP = 1238 | |
| 10/17/2023 17:25:42 - INFO - app - STEP = 1239 | |
| 10/17/2023 17:25:43 - INFO - app - STEP = 1240 | |
| 10/17/2023 17:25:44 - INFO - app - STEP = 1241 | |
| 10/17/2023 17:25:45 - INFO - app - STEP = 1242 | |
| 10/17/2023 17:25:46 - INFO - app - STEP = 1243 | |
| 10/17/2023 17:25:47 - INFO - app - STEP = 1244 | |
| 10/17/2023 17:25:48 - INFO - app - STEP = 1245 | |
| 10/17/2023 17:25:49 - INFO - app - STEP = 1246 | |
| 10/17/2023 17:25:50 - INFO - app - STEP = 1247 | |
| 10/17/2023 17:25:51 - INFO - app - STEP = 1248 | |
| 10/17/2023 17:25:52 - INFO - app - STEP = 1249 | |
| 10/17/2023 17:25:53 - INFO - app - STEP = 1250 | |
| 10/17/2023 17:25:54 - INFO - accelerate.accelerator - Saving current state to models/zee-test/checkpoint-750 | |
| 10/17/2023 17:25:54 - INFO - accelerate.checkpointing - Optimizer state saved in models/zee-test/checkpoint-750/optimizer.bin | |
| 10/17/2023 17:25:54 - INFO - accelerate.checkpointing - Scheduler state saved in models/zee-test/checkpoint-750/scheduler.bin | |
| 10/17/2023 17:25:54 - INFO - accelerate.checkpointing - Random states saved in models/zee-test/checkpoint-750/random_states_0.pkl | |
| 10/17/2023 17:25:54 - INFO - app - Saved state to models/zee-test/checkpoint-750 | |