File size: 62,372 Bytes
e6a8982 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 801 802 803 804 805 806 807 808 809 810 811 812 813 814 815 816 817 818 819 820 821 822 823 824 825 826 827 828 829 830 831 832 833 834 835 836 837 838 839 840 841 842 843 844 845 846 847 848 849 850 851 852 853 854 855 856 857 858 859 860 861 862 863 864 865 866 867 868 869 870 871 872 873 874 875 876 877 878 879 880 881 882 883 884 885 886 887 888 889 890 891 892 893 894 895 896 897 898 899 900 901 902 903 904 905 906 907 908 909 910 911 912 913 914 915 916 917 918 919 920 921 922 923 924 925 926 927 928 929 930 931 932 933 934 935 936 937 938 939 940 941 942 943 944 945 946 947 948 949 950 951 952 953 954 955 956 957 958 959 960 961 962 963 964 965 966 967 968 969 970 971 972 973 974 975 976 977 978 979 980 981 982 983 984 985 986 987 988 989 990 991 992 993 994 995 996 997 998 999 1000 1001 1002 1003 1004 1005 1006 1007 1008 1009 1010 1011 1012 1013 1014 1015 1016 1017 1018 1019 1020 1021 1022 1023 1024 1025 1026 1027 1028 1029 1030 1031 1032 1033 1034 1035 1036 1037 1038 1039 1040 1041 1042 1043 1044 1045 1046 1047 1048 1049 1050 1051 1052 1053 1054 1055 1056 1057 1058 1059 1060 1061 1062 1063 1064 1065 1066 1067 1068 1069 1070 1071 1072 1073 1074 1075 1076 1077 1078 1079 1080 1081 1082 1083 1084 1085 1086 1087 1088 1089 1090 1091 1092 1093 1094 1095 1096 1097 1098 1099 1100 1101 1102 1103 1104 1105 1106 1107 1108 1109 1110 1111 1112 1113 1114 1115 1116 1117 1118 1119 1120 1121 1122 1123 1124 1125 1126 1127 1128 1129 1130 1131 1132 1133 1134 1135 1136 1137 1138 1139 1140 1141 1142 1143 1144 1145 1146 1147 1148 1149 1150 1151 1152 1153 1154 1155 1156 1157 1158 1159 1160 1161 1162 1163 1164 1165 1166 1167 1168 1169 1170 1171 1172 1173 1174 1175 1176 1177 1178 1179 1180 1181 1182 1183 1184 1185 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201 1202 1203 1204 1205 1206 1207 1208 1209 1210 1211 1212 1213 1214 1215 1216 1217 1218 1219 1220 1221 1222 1223 1224 1225 1226 1227 1228 1229 1230 1231 1232 1233 1234 1235 1236 1237 1238 1239 1240 1241 1242 1243 1244 1245 1246 1247 1248 1249 1250 1251 1252 1253 1254 1255 1256 1257 1258 1259 1260 1261 1262 1263 1264 1265 1266 1267 1268 1269 1270 1271 1272 1273 1274 1275 1276 1277 1278 1279 1280 1281 1282 1283 1284 1285 1286 1287 1288 1289 1290 1291 1292 1293 1294 1295 1296 1297 1298 1299 1300 1301 |
10/17/2023 16:59:41 - INFO - app - Distributed environment: NO
Num processes: 1
Process index: 0
Local process index: 0
Device: cuda
Mixed precision type: no
10/17/2023 16:59:46 - INFO - app - Num examples = 10
10/17/2023 16:59:46 - INFO - app - Num batches each epoch = 5
10/17/2023 16:59:46 - INFO - app - Num Epochs = 250
10/17/2023 16:59:46 - INFO - app - Instantaneous batch size per device = 2
10/17/2023 16:59:46 - INFO - app - Total train batch size (w. parallel, distributed & accumulation) = 4
10/17/2023 16:59:46 - INFO - app - Gradient Accumulation steps = 2
10/17/2023 16:59:46 - INFO - app - Training Steps = 750
10/17/2023 16:59:46 - INFO - app - STEP = 1
10/17/2023 16:59:49 - INFO - app - STEP = 2
10/17/2023 16:59:50 - INFO - app - STEP = 3
10/17/2023 16:59:51 - INFO - app - STEP = 4
10/17/2023 16:59:51 - INFO - app - STEP = 5
10/17/2023 16:59:52 - INFO - app - Running validation...
Generating 4 images with prompt: A photo of sks dog.
10/17/2023 17:00:19 - INFO - app - STEP = 6
10/17/2023 17:00:20 - INFO - app - STEP = 7
10/17/2023 17:00:21 - INFO - app - STEP = 8
10/17/2023 17:00:22 - INFO - app - STEP = 9
10/17/2023 17:00:23 - INFO - app - STEP = 10
10/17/2023 17:00:24 - INFO - app - STEP = 11
10/17/2023 17:00:25 - INFO - app - STEP = 12
10/17/2023 17:00:26 - INFO - app - STEP = 13
10/17/2023 17:00:27 - INFO - app - STEP = 14
10/17/2023 17:00:28 - INFO - app - STEP = 15
10/17/2023 17:00:29 - INFO - app - STEP = 16
10/17/2023 17:00:30 - INFO - app - STEP = 17
10/17/2023 17:00:31 - INFO - app - STEP = 18
10/17/2023 17:00:32 - INFO - app - STEP = 19
10/17/2023 17:00:33 - INFO - app - STEP = 20
10/17/2023 17:00:34 - INFO - app - STEP = 21
10/17/2023 17:00:35 - INFO - app - STEP = 22
10/17/2023 17:00:36 - INFO - app - STEP = 23
10/17/2023 17:00:37 - INFO - app - STEP = 24
10/17/2023 17:00:38 - INFO - app - STEP = 25
10/17/2023 17:00:39 - INFO - app - STEP = 26
10/17/2023 17:00:40 - INFO - app - STEP = 27
10/17/2023 17:00:41 - INFO - app - STEP = 28
10/17/2023 17:00:42 - INFO - app - STEP = 29
10/17/2023 17:00:43 - INFO - app - STEP = 30
10/17/2023 17:00:44 - INFO - app - STEP = 31
10/17/2023 17:00:45 - INFO - app - STEP = 32
10/17/2023 17:00:46 - INFO - app - STEP = 33
10/17/2023 17:00:47 - INFO - app - STEP = 34
10/17/2023 17:00:48 - INFO - app - STEP = 35
10/17/2023 17:00:50 - INFO - app - STEP = 36
10/17/2023 17:00:51 - INFO - app - STEP = 37
10/17/2023 17:00:52 - INFO - app - STEP = 38
10/17/2023 17:00:53 - INFO - app - STEP = 39
10/17/2023 17:00:54 - INFO - app - STEP = 40
10/17/2023 17:00:55 - INFO - app - STEP = 41
10/17/2023 17:00:56 - INFO - app - STEP = 42
10/17/2023 17:00:57 - INFO - app - STEP = 43
10/17/2023 17:00:58 - INFO - app - STEP = 44
10/17/2023 17:00:59 - INFO - app - STEP = 45
10/17/2023 17:01:00 - INFO - app - STEP = 46
10/17/2023 17:01:01 - INFO - app - STEP = 47
10/17/2023 17:01:02 - INFO - app - STEP = 48
10/17/2023 17:01:03 - INFO - app - STEP = 49
10/17/2023 17:01:04 - INFO - app - STEP = 50
10/17/2023 17:01:05 - INFO - app - STEP = 51
10/17/2023 17:01:06 - INFO - app - STEP = 52
10/17/2023 17:01:07 - INFO - app - STEP = 53
10/17/2023 17:01:08 - INFO - app - STEP = 54
10/17/2023 17:01:09 - INFO - app - STEP = 55
10/17/2023 17:01:10 - INFO - app - STEP = 56
10/17/2023 17:01:11 - INFO - app - STEP = 57
10/17/2023 17:01:12 - INFO - app - STEP = 58
10/17/2023 17:01:13 - INFO - app - STEP = 59
10/17/2023 17:01:14 - INFO - app - STEP = 60
10/17/2023 17:01:15 - INFO - app - STEP = 61
10/17/2023 17:01:16 - INFO - app - STEP = 62
10/17/2023 17:01:17 - INFO - app - STEP = 63
10/17/2023 17:01:18 - INFO - app - STEP = 64
10/17/2023 17:01:19 - INFO - app - STEP = 65
10/17/2023 17:01:20 - INFO - app - STEP = 66
10/17/2023 17:01:21 - INFO - app - STEP = 67
10/17/2023 17:01:22 - INFO - app - STEP = 68
10/17/2023 17:01:23 - INFO - app - STEP = 69
10/17/2023 17:01:24 - INFO - app - STEP = 70
10/17/2023 17:01:26 - INFO - app - STEP = 71
10/17/2023 17:01:27 - INFO - app - STEP = 72
10/17/2023 17:01:28 - INFO - app - STEP = 73
10/17/2023 17:01:29 - INFO - app - STEP = 74
10/17/2023 17:01:30 - INFO - app - STEP = 75
10/17/2023 17:01:31 - INFO - app - STEP = 76
10/17/2023 17:01:32 - INFO - app - STEP = 77
10/17/2023 17:01:33 - INFO - app - STEP = 78
10/17/2023 17:01:34 - INFO - app - STEP = 79
10/17/2023 17:01:35 - INFO - app - STEP = 80
10/17/2023 17:01:36 - INFO - app - STEP = 81
10/17/2023 17:01:37 - INFO - app - STEP = 82
10/17/2023 17:01:38 - INFO - app - STEP = 83
10/17/2023 17:01:39 - INFO - app - STEP = 84
10/17/2023 17:01:40 - INFO - app - STEP = 85
10/17/2023 17:01:41 - INFO - app - STEP = 86
10/17/2023 17:01:42 - INFO - app - STEP = 87
10/17/2023 17:01:43 - INFO - app - STEP = 88
10/17/2023 17:01:44 - INFO - app - STEP = 89
10/17/2023 17:01:45 - INFO - app - STEP = 90
10/17/2023 17:01:46 - INFO - app - STEP = 91
10/17/2023 17:01:47 - INFO - app - STEP = 92
10/17/2023 17:01:48 - INFO - app - STEP = 93
10/17/2023 17:01:49 - INFO - app - STEP = 94
10/17/2023 17:01:50 - INFO - app - STEP = 95
10/17/2023 17:01:51 - INFO - app - STEP = 96
10/17/2023 17:01:53 - INFO - app - STEP = 97
10/17/2023 17:01:54 - INFO - app - STEP = 98
10/17/2023 17:01:55 - INFO - app - STEP = 99
10/17/2023 17:01:56 - INFO - app - STEP = 100
10/17/2023 17:01:57 - INFO - app - STEP = 101
10/17/2023 17:01:58 - INFO - app - STEP = 102
10/17/2023 17:01:59 - INFO - app - STEP = 103
10/17/2023 17:02:00 - INFO - app - STEP = 104
10/17/2023 17:02:01 - INFO - app - STEP = 105
10/17/2023 17:02:02 - INFO - app - STEP = 106
10/17/2023 17:02:03 - INFO - app - STEP = 107
10/17/2023 17:02:04 - INFO - app - STEP = 108
10/17/2023 17:02:05 - INFO - app - STEP = 109
10/17/2023 17:02:06 - INFO - app - STEP = 110
10/17/2023 17:02:07 - INFO - app - STEP = 111
10/17/2023 17:02:08 - INFO - app - STEP = 112
10/17/2023 17:02:09 - INFO - app - STEP = 113
10/17/2023 17:02:10 - INFO - app - STEP = 114
10/17/2023 17:02:11 - INFO - app - STEP = 115
10/17/2023 17:02:12 - INFO - app - STEP = 116
10/17/2023 17:02:13 - INFO - app - STEP = 117
10/17/2023 17:02:14 - INFO - app - STEP = 118
10/17/2023 17:02:15 - INFO - app - STEP = 119
10/17/2023 17:02:16 - INFO - app - STEP = 120
10/17/2023 17:02:17 - INFO - app - STEP = 121
10/17/2023 17:02:19 - INFO - app - STEP = 122
10/17/2023 17:02:20 - INFO - app - STEP = 123
10/17/2023 17:02:21 - INFO - app - STEP = 124
10/17/2023 17:02:22 - INFO - app - STEP = 125
10/17/2023 17:02:23 - INFO - app - STEP = 126
10/17/2023 17:02:24 - INFO - app - STEP = 127
10/17/2023 17:02:25 - INFO - app - STEP = 128
10/17/2023 17:02:26 - INFO - app - STEP = 129
10/17/2023 17:02:27 - INFO - app - STEP = 130
10/17/2023 17:02:28 - INFO - app - Running validation...
Generating 4 images with prompt: A photo of sks dog.
10/17/2023 17:02:54 - INFO - app - STEP = 131
10/17/2023 17:02:55 - INFO - app - STEP = 132
10/17/2023 17:02:56 - INFO - app - STEP = 133
10/17/2023 17:02:57 - INFO - app - STEP = 134
10/17/2023 17:02:58 - INFO - app - STEP = 135
10/17/2023 17:03:00 - INFO - app - STEP = 136
10/17/2023 17:03:01 - INFO - app - STEP = 137
10/17/2023 17:03:02 - INFO - app - STEP = 138
10/17/2023 17:03:03 - INFO - app - STEP = 139
10/17/2023 17:03:04 - INFO - app - STEP = 140
10/17/2023 17:03:05 - INFO - app - STEP = 141
10/17/2023 17:03:06 - INFO - app - STEP = 142
10/17/2023 17:03:07 - INFO - app - STEP = 143
10/17/2023 17:03:08 - INFO - app - STEP = 144
10/17/2023 17:03:09 - INFO - app - STEP = 145
10/17/2023 17:03:10 - INFO - app - STEP = 146
10/17/2023 17:03:11 - INFO - app - STEP = 147
10/17/2023 17:03:12 - INFO - app - STEP = 148
10/17/2023 17:03:13 - INFO - app - STEP = 149
10/17/2023 17:03:14 - INFO - app - STEP = 150
10/17/2023 17:03:15 - INFO - app - STEP = 151
10/17/2023 17:03:16 - INFO - app - STEP = 152
10/17/2023 17:03:17 - INFO - app - STEP = 153
10/17/2023 17:03:18 - INFO - app - STEP = 154
10/17/2023 17:03:19 - INFO - app - STEP = 155
10/17/2023 17:03:20 - INFO - app - STEP = 156
10/17/2023 17:03:21 - INFO - app - STEP = 157
10/17/2023 17:03:22 - INFO - app - STEP = 158
10/17/2023 17:03:23 - INFO - app - STEP = 159
10/17/2023 17:03:24 - INFO - app - STEP = 160
10/17/2023 17:03:25 - INFO - app - STEP = 161
10/17/2023 17:03:26 - INFO - app - STEP = 162
10/17/2023 17:03:28 - INFO - app - STEP = 163
10/17/2023 17:03:29 - INFO - app - STEP = 164
10/17/2023 17:03:30 - INFO - app - STEP = 165
10/17/2023 17:03:31 - INFO - app - STEP = 166
10/17/2023 17:03:32 - INFO - app - STEP = 167
10/17/2023 17:03:33 - INFO - app - STEP = 168
10/17/2023 17:03:34 - INFO - app - STEP = 169
10/17/2023 17:03:35 - INFO - app - STEP = 170
10/17/2023 17:03:36 - INFO - app - STEP = 171
10/17/2023 17:03:37 - INFO - app - STEP = 172
10/17/2023 17:03:38 - INFO - app - STEP = 173
10/17/2023 17:03:39 - INFO - app - STEP = 174
10/17/2023 17:03:40 - INFO - app - STEP = 175
10/17/2023 17:03:41 - INFO - app - STEP = 176
10/17/2023 17:03:42 - INFO - app - STEP = 177
10/17/2023 17:03:43 - INFO - app - STEP = 178
10/17/2023 17:03:44 - INFO - app - STEP = 179
10/17/2023 17:03:45 - INFO - app - STEP = 180
10/17/2023 17:03:46 - INFO - app - STEP = 181
10/17/2023 17:03:47 - INFO - app - STEP = 182
10/17/2023 17:03:48 - INFO - app - STEP = 183
10/17/2023 17:03:49 - INFO - app - STEP = 184
10/17/2023 17:03:50 - INFO - app - STEP = 185
10/17/2023 17:03:51 - INFO - app - STEP = 186
10/17/2023 17:03:52 - INFO - app - STEP = 187
10/17/2023 17:03:53 - INFO - app - STEP = 188
10/17/2023 17:03:54 - INFO - app - STEP = 189
10/17/2023 17:03:55 - INFO - app - STEP = 190
10/17/2023 17:03:57 - INFO - app - STEP = 191
10/17/2023 17:03:58 - INFO - app - STEP = 192
10/17/2023 17:03:59 - INFO - app - STEP = 193
10/17/2023 17:04:00 - INFO - app - STEP = 194
10/17/2023 17:04:01 - INFO - app - STEP = 195
10/17/2023 17:04:02 - INFO - app - STEP = 196
10/17/2023 17:04:03 - INFO - app - STEP = 197
10/17/2023 17:04:04 - INFO - app - STEP = 198
10/17/2023 17:04:05 - INFO - app - STEP = 199
10/17/2023 17:04:06 - INFO - app - STEP = 200
10/17/2023 17:04:07 - INFO - app - STEP = 201
10/17/2023 17:04:08 - INFO - app - STEP = 202
10/17/2023 17:04:09 - INFO - app - STEP = 203
10/17/2023 17:04:10 - INFO - app - STEP = 204
10/17/2023 17:04:11 - INFO - app - STEP = 205
10/17/2023 17:04:12 - INFO - app - STEP = 206
10/17/2023 17:04:13 - INFO - app - STEP = 207
10/17/2023 17:04:14 - INFO - app - STEP = 208
10/17/2023 17:04:15 - INFO - app - STEP = 209
10/17/2023 17:04:16 - INFO - app - STEP = 210
10/17/2023 17:04:17 - INFO - app - STEP = 211
10/17/2023 17:04:18 - INFO - app - STEP = 212
10/17/2023 17:04:19 - INFO - app - STEP = 213
10/17/2023 17:04:20 - INFO - app - STEP = 214
10/17/2023 17:04:21 - INFO - app - STEP = 215
10/17/2023 17:04:23 - INFO - app - STEP = 216
10/17/2023 17:04:24 - INFO - app - STEP = 217
10/17/2023 17:04:25 - INFO - app - STEP = 218
10/17/2023 17:04:26 - INFO - app - STEP = 219
10/17/2023 17:04:27 - INFO - app - STEP = 220
10/17/2023 17:04:28 - INFO - app - STEP = 221
10/17/2023 17:04:29 - INFO - app - STEP = 222
10/17/2023 17:04:30 - INFO - app - STEP = 223
10/17/2023 17:04:31 - INFO - app - STEP = 224
10/17/2023 17:04:32 - INFO - app - STEP = 225
10/17/2023 17:04:33 - INFO - app - STEP = 226
10/17/2023 17:04:34 - INFO - app - STEP = 227
10/17/2023 17:04:35 - INFO - app - STEP = 228
10/17/2023 17:04:36 - INFO - app - STEP = 229
10/17/2023 17:04:37 - INFO - app - STEP = 230
10/17/2023 17:04:38 - INFO - app - STEP = 231
10/17/2023 17:04:39 - INFO - app - STEP = 232
10/17/2023 17:04:40 - INFO - app - STEP = 233
10/17/2023 17:04:41 - INFO - app - STEP = 234
10/17/2023 17:04:42 - INFO - app - STEP = 235
10/17/2023 17:04:43 - INFO - app - STEP = 236
10/17/2023 17:04:44 - INFO - app - STEP = 237
10/17/2023 17:04:45 - INFO - app - STEP = 238
10/17/2023 17:04:46 - INFO - app - STEP = 239
10/17/2023 17:04:47 - INFO - app - STEP = 240
10/17/2023 17:04:49 - INFO - app - STEP = 241
10/17/2023 17:04:50 - INFO - app - STEP = 242
10/17/2023 17:04:51 - INFO - app - STEP = 243
10/17/2023 17:04:52 - INFO - app - STEP = 244
10/17/2023 17:04:53 - INFO - app - STEP = 245
10/17/2023 17:04:54 - INFO - app - STEP = 246
10/17/2023 17:04:55 - INFO - app - STEP = 247
10/17/2023 17:04:56 - INFO - app - STEP = 248
10/17/2023 17:04:57 - INFO - app - STEP = 249
10/17/2023 17:04:58 - INFO - app - STEP = 250
10/17/2023 17:04:59 - INFO - app - STEP = 251
10/17/2023 17:05:00 - INFO - app - STEP = 252
10/17/2023 17:05:01 - INFO - app - STEP = 253
10/17/2023 17:05:02 - INFO - app - STEP = 254
10/17/2023 17:05:03 - INFO - app - STEP = 255
10/17/2023 17:05:04 - INFO - app - Running validation...
Generating 4 images with prompt: A photo of sks dog.
10/17/2023 17:05:30 - INFO - app - STEP = 256
10/17/2023 17:05:32 - INFO - app - STEP = 257
10/17/2023 17:05:33 - INFO - app - STEP = 258
10/17/2023 17:05:34 - INFO - app - STEP = 259
10/17/2023 17:05:35 - INFO - app - STEP = 260
10/17/2023 17:05:36 - INFO - app - STEP = 261
10/17/2023 17:05:37 - INFO - app - STEP = 262
10/17/2023 17:05:38 - INFO - app - STEP = 263
10/17/2023 17:05:39 - INFO - app - STEP = 264
10/17/2023 17:05:40 - INFO - app - STEP = 265
10/17/2023 17:05:41 - INFO - app - STEP = 266
10/17/2023 17:05:42 - INFO - app - STEP = 267
10/17/2023 17:05:43 - INFO - app - STEP = 268
10/17/2023 17:05:44 - INFO - app - STEP = 269
10/17/2023 17:05:45 - INFO - app - STEP = 270
10/17/2023 17:05:46 - INFO - app - STEP = 271
10/17/2023 17:05:47 - INFO - app - STEP = 272
10/17/2023 17:05:48 - INFO - app - STEP = 273
10/17/2023 17:05:49 - INFO - app - STEP = 274
10/17/2023 17:05:50 - INFO - app - STEP = 275
10/17/2023 17:05:51 - INFO - app - STEP = 276
10/17/2023 17:05:52 - INFO - app - STEP = 277
10/17/2023 17:05:53 - INFO - app - STEP = 278
10/17/2023 17:05:54 - INFO - app - STEP = 279
10/17/2023 17:05:55 - INFO - app - STEP = 280
10/17/2023 17:05:57 - INFO - app - STEP = 281
10/17/2023 17:05:58 - INFO - app - STEP = 282
10/17/2023 17:05:59 - INFO - app - STEP = 283
10/17/2023 17:06:00 - INFO - app - STEP = 284
10/17/2023 17:06:01 - INFO - app - STEP = 285
10/17/2023 17:06:02 - INFO - app - STEP = 286
10/17/2023 17:06:03 - INFO - app - STEP = 287
10/17/2023 17:06:04 - INFO - app - STEP = 288
10/17/2023 17:06:05 - INFO - app - STEP = 289
10/17/2023 17:06:06 - INFO - app - STEP = 290
10/17/2023 17:06:07 - INFO - app - STEP = 291
10/17/2023 17:06:08 - INFO - app - STEP = 292
10/17/2023 17:06:09 - INFO - app - STEP = 293
10/17/2023 17:06:10 - INFO - app - STEP = 294
10/17/2023 17:06:11 - INFO - app - STEP = 295
10/17/2023 17:06:12 - INFO - app - STEP = 296
10/17/2023 17:06:13 - INFO - app - STEP = 297
10/17/2023 17:06:14 - INFO - app - STEP = 298
10/17/2023 17:06:15 - INFO - app - STEP = 299
10/17/2023 17:06:16 - INFO - app - STEP = 300
10/17/2023 17:06:17 - INFO - app - STEP = 301
10/17/2023 17:06:18 - INFO - app - STEP = 302
10/17/2023 17:06:19 - INFO - app - STEP = 303
10/17/2023 17:06:21 - INFO - app - STEP = 304
10/17/2023 17:06:21 - INFO - app - STEP = 305
10/17/2023 17:06:23 - INFO - app - STEP = 306
10/17/2023 17:06:24 - INFO - app - STEP = 307
10/17/2023 17:06:25 - INFO - app - STEP = 308
10/17/2023 17:06:26 - INFO - app - STEP = 309
10/17/2023 17:06:27 - INFO - app - STEP = 310
10/17/2023 17:06:28 - INFO - app - STEP = 311
10/17/2023 17:06:29 - INFO - app - STEP = 312
10/17/2023 17:06:30 - INFO - app - STEP = 313
10/17/2023 17:06:31 - INFO - app - STEP = 314
10/17/2023 17:06:32 - INFO - app - STEP = 315
10/17/2023 17:06:33 - INFO - app - STEP = 316
10/17/2023 17:06:34 - INFO - app - STEP = 317
10/17/2023 17:06:35 - INFO - app - STEP = 318
10/17/2023 17:06:36 - INFO - app - STEP = 319
10/17/2023 17:06:37 - INFO - app - STEP = 320
10/17/2023 17:06:38 - INFO - app - STEP = 321
10/17/2023 17:06:39 - INFO - app - STEP = 322
10/17/2023 17:06:40 - INFO - app - STEP = 323
10/17/2023 17:06:41 - INFO - app - STEP = 324
10/17/2023 17:06:42 - INFO - app - STEP = 325
10/17/2023 17:06:43 - INFO - app - STEP = 326
10/17/2023 17:06:44 - INFO - app - STEP = 327
10/17/2023 17:06:45 - INFO - app - STEP = 328
10/17/2023 17:06:46 - INFO - app - STEP = 329
10/17/2023 17:06:47 - INFO - app - STEP = 330
10/17/2023 17:06:49 - INFO - app - STEP = 331
10/17/2023 17:06:50 - INFO - app - STEP = 332
10/17/2023 17:06:51 - INFO - app - STEP = 333
10/17/2023 17:06:52 - INFO - app - STEP = 334
10/17/2023 17:06:53 - INFO - app - STEP = 335
10/17/2023 17:06:54 - INFO - app - STEP = 336
10/17/2023 17:06:55 - INFO - app - STEP = 337
10/17/2023 17:06:56 - INFO - app - STEP = 338
10/17/2023 17:06:57 - INFO - app - STEP = 339
10/17/2023 17:06:58 - INFO - app - STEP = 340
10/17/2023 17:06:59 - INFO - app - STEP = 341
10/17/2023 17:07:00 - INFO - app - STEP = 342
10/17/2023 17:07:01 - INFO - app - STEP = 343
10/17/2023 17:07:02 - INFO - app - STEP = 344
10/17/2023 17:07:03 - INFO - app - STEP = 345
10/17/2023 17:07:04 - INFO - app - STEP = 346
10/17/2023 17:07:05 - INFO - app - STEP = 347
10/17/2023 17:07:06 - INFO - app - STEP = 348
10/17/2023 17:07:07 - INFO - app - STEP = 349
10/17/2023 17:07:08 - INFO - app - STEP = 350
10/17/2023 17:07:09 - INFO - app - STEP = 351
10/17/2023 17:07:10 - INFO - app - STEP = 352
10/17/2023 17:07:11 - INFO - app - STEP = 353
10/17/2023 17:07:12 - INFO - app - STEP = 354
10/17/2023 17:07:13 - INFO - app - STEP = 355
10/17/2023 17:07:14 - INFO - app - STEP = 356
10/17/2023 17:07:16 - INFO - app - STEP = 357
10/17/2023 17:07:17 - INFO - app - STEP = 358
10/17/2023 17:07:18 - INFO - app - STEP = 359
10/17/2023 17:07:19 - INFO - app - STEP = 360
10/17/2023 17:07:20 - INFO - app - STEP = 361
10/17/2023 17:07:21 - INFO - app - STEP = 362
10/17/2023 17:07:22 - INFO - app - STEP = 363
10/17/2023 17:07:23 - INFO - app - STEP = 364
10/17/2023 17:07:24 - INFO - app - STEP = 365
10/17/2023 17:07:25 - INFO - app - STEP = 366
10/17/2023 17:07:26 - INFO - app - STEP = 367
10/17/2023 17:07:27 - INFO - app - STEP = 368
10/17/2023 17:07:28 - INFO - app - STEP = 369
10/17/2023 17:07:29 - INFO - app - STEP = 370
10/17/2023 17:07:30 - INFO - app - STEP = 371
10/17/2023 17:07:31 - INFO - app - STEP = 372
10/17/2023 17:07:32 - INFO - app - STEP = 373
10/17/2023 17:07:33 - INFO - app - STEP = 374
10/17/2023 17:07:34 - INFO - app - STEP = 375
10/17/2023 17:07:35 - INFO - app - STEP = 376
10/17/2023 17:07:36 - INFO - app - STEP = 377
10/17/2023 17:07:37 - INFO - app - STEP = 378
10/17/2023 17:07:38 - INFO - app - STEP = 379
10/17/2023 17:07:39 - INFO - app - STEP = 380
10/17/2023 17:07:40 - INFO - app - Running validation...
Generating 4 images with prompt: A photo of sks dog.
10/17/2023 17:08:07 - INFO - app - STEP = 381
10/17/2023 17:08:08 - INFO - app - STEP = 382
10/17/2023 17:08:09 - INFO - app - STEP = 383
10/17/2023 17:08:10 - INFO - app - STEP = 384
10/17/2023 17:08:11 - INFO - app - STEP = 385
10/17/2023 17:08:12 - INFO - app - STEP = 386
10/17/2023 17:08:13 - INFO - app - STEP = 387
10/17/2023 17:08:14 - INFO - app - STEP = 388
10/17/2023 17:08:15 - INFO - app - STEP = 389
10/17/2023 17:08:16 - INFO - app - STEP = 390
10/17/2023 17:08:17 - INFO - app - STEP = 391
10/17/2023 17:08:18 - INFO - app - STEP = 392
10/17/2023 17:08:19 - INFO - app - STEP = 393
10/17/2023 17:08:21 - INFO - app - STEP = 394
10/17/2023 17:08:22 - INFO - app - STEP = 395
10/17/2023 17:08:23 - INFO - app - STEP = 396
10/17/2023 17:08:24 - INFO - app - STEP = 397
10/17/2023 17:08:25 - INFO - app - STEP = 398
10/17/2023 17:08:26 - INFO - app - STEP = 399
10/17/2023 17:08:27 - INFO - app - STEP = 400
10/17/2023 17:08:28 - INFO - app - STEP = 401
10/17/2023 17:08:29 - INFO - app - STEP = 402
10/17/2023 17:08:30 - INFO - app - STEP = 403
10/17/2023 17:08:31 - INFO - app - STEP = 404
10/17/2023 17:08:32 - INFO - app - STEP = 405
10/17/2023 17:08:34 - INFO - app - STEP = 406
10/17/2023 17:08:35 - INFO - app - STEP = 407
10/17/2023 17:08:36 - INFO - app - STEP = 408
10/17/2023 17:08:37 - INFO - app - STEP = 409
10/17/2023 17:08:38 - INFO - app - STEP = 410
10/17/2023 17:08:39 - INFO - app - STEP = 411
10/17/2023 17:08:40 - INFO - app - STEP = 412
10/17/2023 17:08:41 - INFO - app - STEP = 413
10/17/2023 17:08:42 - INFO - app - STEP = 414
10/17/2023 17:08:43 - INFO - app - STEP = 415
10/17/2023 17:08:44 - INFO - app - STEP = 416
10/17/2023 17:08:46 - INFO - app - STEP = 417
10/17/2023 17:08:47 - INFO - accelerate.accelerator - Saving current state to models/zee-test/checkpoint-250
10/17/2023 17:08:47 - INFO - accelerate.checkpointing - Optimizer state saved in models/zee-test/checkpoint-250/optimizer.bin
10/17/2023 17:08:47 - INFO - accelerate.checkpointing - Scheduler state saved in models/zee-test/checkpoint-250/scheduler.bin
10/17/2023 17:08:47 - INFO - accelerate.checkpointing - Random states saved in models/zee-test/checkpoint-250/random_states_0.pkl
10/17/2023 17:08:47 - INFO - app - Saved state to models/zee-test/checkpoint-250
10/17/2023 17:08:47 - INFO - app - STEP = 418
10/17/2023 17:08:48 - INFO - app - STEP = 419
10/17/2023 17:08:49 - INFO - app - STEP = 420
10/17/2023 17:08:50 - INFO - app - STEP = 421
10/17/2023 17:08:51 - INFO - app - STEP = 422
10/17/2023 17:08:52 - INFO - app - STEP = 423
10/17/2023 17:08:53 - INFO - app - STEP = 424
10/17/2023 17:08:54 - INFO - app - STEP = 425
10/17/2023 17:08:55 - INFO - app - STEP = 426
10/17/2023 17:08:56 - INFO - app - STEP = 427
10/17/2023 17:08:57 - INFO - app - STEP = 428
10/17/2023 17:08:58 - INFO - app - STEP = 429
10/17/2023 17:08:59 - INFO - app - STEP = 430
10/17/2023 17:09:00 - INFO - app - STEP = 431
10/17/2023 17:09:01 - INFO - app - STEP = 432
10/17/2023 17:09:02 - INFO - app - STEP = 433
10/17/2023 17:09:04 - INFO - app - STEP = 434
10/17/2023 17:09:04 - INFO - app - STEP = 435
10/17/2023 17:09:06 - INFO - app - STEP = 436
10/17/2023 17:09:07 - INFO - app - STEP = 437
10/17/2023 17:09:08 - INFO - app - STEP = 438
10/17/2023 17:09:09 - INFO - app - STEP = 439
10/17/2023 17:09:10 - INFO - app - STEP = 440
10/17/2023 17:09:11 - INFO - app - STEP = 441
10/17/2023 17:09:12 - INFO - app - STEP = 442
10/17/2023 17:09:13 - INFO - app - STEP = 443
10/17/2023 17:09:14 - INFO - app - STEP = 444
10/17/2023 17:09:15 - INFO - app - STEP = 445
10/17/2023 17:09:16 - INFO - app - STEP = 446
10/17/2023 17:09:17 - INFO - app - STEP = 447
10/17/2023 17:09:18 - INFO - app - STEP = 448
10/17/2023 17:09:19 - INFO - app - STEP = 449
10/17/2023 17:09:20 - INFO - app - STEP = 450
10/17/2023 17:09:21 - INFO - app - STEP = 451
10/17/2023 17:09:22 - INFO - app - STEP = 452
10/17/2023 17:09:23 - INFO - app - STEP = 453
10/17/2023 17:09:24 - INFO - app - STEP = 454
10/17/2023 17:09:25 - INFO - app - STEP = 455
10/17/2023 17:09:26 - INFO - app - STEP = 456
10/17/2023 17:09:27 - INFO - app - STEP = 457
10/17/2023 17:09:28 - INFO - app - STEP = 458
10/17/2023 17:09:29 - INFO - app - STEP = 459
10/17/2023 17:09:30 - INFO - app - STEP = 460
10/17/2023 17:09:32 - INFO - app - STEP = 461
10/17/2023 17:09:33 - INFO - app - STEP = 462
10/17/2023 17:09:34 - INFO - app - STEP = 463
10/17/2023 17:09:35 - INFO - app - STEP = 464
10/17/2023 17:09:36 - INFO - app - STEP = 465
10/17/2023 17:09:37 - INFO - app - STEP = 466
10/17/2023 17:09:38 - INFO - app - STEP = 467
10/17/2023 17:09:39 - INFO - app - STEP = 468
10/17/2023 17:09:40 - INFO - app - STEP = 469
10/17/2023 17:09:41 - INFO - app - STEP = 470
10/17/2023 17:09:42 - INFO - app - STEP = 471
10/17/2023 17:09:43 - INFO - app - STEP = 472
10/17/2023 17:09:44 - INFO - app - STEP = 473
10/17/2023 17:09:45 - INFO - app - STEP = 474
10/17/2023 17:09:46 - INFO - app - STEP = 475
10/17/2023 17:09:47 - INFO - app - STEP = 476
10/17/2023 17:09:48 - INFO - app - STEP = 477
10/17/2023 17:09:49 - INFO - app - STEP = 478
10/17/2023 17:09:50 - INFO - app - STEP = 479
10/17/2023 17:09:51 - INFO - app - STEP = 480
10/17/2023 17:09:52 - INFO - app - STEP = 481
10/17/2023 17:09:53 - INFO - app - STEP = 482
10/17/2023 17:09:54 - INFO - app - STEP = 483
10/17/2023 17:09:55 - INFO - app - STEP = 484
10/17/2023 17:09:56 - INFO - app - STEP = 485
10/17/2023 17:09:57 - INFO - app - STEP = 486
10/17/2023 17:09:58 - INFO - app - STEP = 487
10/17/2023 17:09:59 - INFO - app - STEP = 488
10/17/2023 17:10:01 - INFO - app - STEP = 489
10/17/2023 17:10:01 - INFO - app - STEP = 490
10/17/2023 17:10:03 - INFO - app - STEP = 491
10/17/2023 17:10:04 - INFO - app - STEP = 492
10/17/2023 17:10:05 - INFO - app - STEP = 493
10/17/2023 17:10:06 - INFO - app - STEP = 494
10/17/2023 17:10:07 - INFO - app - STEP = 495
10/17/2023 17:10:08 - INFO - app - STEP = 496
10/17/2023 17:10:09 - INFO - app - STEP = 497
10/17/2023 17:10:10 - INFO - app - STEP = 498
10/17/2023 17:10:11 - INFO - app - STEP = 499
10/17/2023 17:10:12 - INFO - app - STEP = 500
10/17/2023 17:10:13 - INFO - app - STEP = 501
10/17/2023 17:10:14 - INFO - app - STEP = 502
10/17/2023 17:10:15 - INFO - app - STEP = 503
10/17/2023 17:10:16 - INFO - app - STEP = 504
10/17/2023 17:10:17 - INFO - app - STEP = 505
10/17/2023 17:10:18 - INFO - app - Running validation...
Generating 4 images with prompt: A photo of sks dog.
10/17/2023 17:10:44 - INFO - app - STEP = 506
10/17/2023 17:10:45 - INFO - app - STEP = 507
10/17/2023 17:10:47 - INFO - app - STEP = 508
10/17/2023 17:10:48 - INFO - app - STEP = 509
10/17/2023 17:10:49 - INFO - app - STEP = 510
10/17/2023 17:10:50 - INFO - app - STEP = 511
10/17/2023 17:10:51 - INFO - app - STEP = 512
10/17/2023 17:10:52 - INFO - app - STEP = 513
10/17/2023 17:10:53 - INFO - app - STEP = 514
10/17/2023 17:10:54 - INFO - app - STEP = 515
10/17/2023 17:10:55 - INFO - app - STEP = 516
10/17/2023 17:10:56 - INFO - app - STEP = 517
10/17/2023 17:10:57 - INFO - app - STEP = 518
10/17/2023 17:10:58 - INFO - app - STEP = 519
10/17/2023 17:10:59 - INFO - app - STEP = 520
10/17/2023 17:11:01 - INFO - app - STEP = 521
10/17/2023 17:11:02 - INFO - app - STEP = 522
10/17/2023 17:11:03 - INFO - app - STEP = 523
10/17/2023 17:11:04 - INFO - app - STEP = 524
10/17/2023 17:11:05 - INFO - app - STEP = 525
10/17/2023 17:11:06 - INFO - app - STEP = 526
10/17/2023 17:11:07 - INFO - app - STEP = 527
10/17/2023 17:11:08 - INFO - app - STEP = 528
10/17/2023 17:11:09 - INFO - app - STEP = 529
10/17/2023 17:11:10 - INFO - app - STEP = 530
10/17/2023 17:11:11 - INFO - app - STEP = 531
10/17/2023 17:11:12 - INFO - app - STEP = 532
10/17/2023 17:11:13 - INFO - app - STEP = 533
10/17/2023 17:11:14 - INFO - app - STEP = 534
10/17/2023 17:11:15 - INFO - app - STEP = 535
10/17/2023 17:11:16 - INFO - app - STEP = 536
10/17/2023 17:11:17 - INFO - app - STEP = 537
10/17/2023 17:11:18 - INFO - app - STEP = 538
10/17/2023 17:11:19 - INFO - app - STEP = 539
10/17/2023 17:11:20 - INFO - app - STEP = 540
10/17/2023 17:11:21 - INFO - app - STEP = 541
10/17/2023 17:11:22 - INFO - app - STEP = 542
10/17/2023 17:11:23 - INFO - app - STEP = 543
10/17/2023 17:11:25 - INFO - app - STEP = 544
10/17/2023 17:11:26 - INFO - app - STEP = 545
10/17/2023 17:11:27 - INFO - app - STEP = 546
10/17/2023 17:11:28 - INFO - app - STEP = 547
10/17/2023 17:11:29 - INFO - app - STEP = 548
10/17/2023 17:11:30 - INFO - app - STEP = 549
10/17/2023 17:11:31 - INFO - app - STEP = 550
10/17/2023 17:11:33 - INFO - app - STEP = 551
10/17/2023 17:11:34 - INFO - app - STEP = 552
10/17/2023 17:11:35 - INFO - app - STEP = 553
10/17/2023 17:11:36 - INFO - app - STEP = 554
10/17/2023 17:11:37 - INFO - app - STEP = 555
10/17/2023 17:11:38 - INFO - app - STEP = 556
10/17/2023 17:11:39 - INFO - app - STEP = 557
10/17/2023 17:11:40 - INFO - app - STEP = 558
10/17/2023 17:11:41 - INFO - app - STEP = 559
10/17/2023 17:11:42 - INFO - app - STEP = 560
10/17/2023 17:11:44 - INFO - app - STEP = 561
10/17/2023 17:11:45 - INFO - app - STEP = 562
10/17/2023 17:11:46 - INFO - app - STEP = 563
10/17/2023 17:11:47 - INFO - app - STEP = 564
10/17/2023 17:11:48 - INFO - app - STEP = 565
10/17/2023 17:11:49 - INFO - app - STEP = 566
10/17/2023 17:11:50 - INFO - app - STEP = 567
10/17/2023 17:11:51 - INFO - app - STEP = 568
10/17/2023 17:11:52 - INFO - app - STEP = 569
10/17/2023 17:11:53 - INFO - app - STEP = 570
10/17/2023 17:11:54 - INFO - app - STEP = 571
10/17/2023 17:11:55 - INFO - app - STEP = 572
10/17/2023 17:11:56 - INFO - app - STEP = 573
10/17/2023 17:11:57 - INFO - app - STEP = 574
10/17/2023 17:11:58 - INFO - app - STEP = 575
10/17/2023 17:11:59 - INFO - app - STEP = 576
10/17/2023 17:12:00 - INFO - app - STEP = 577
10/17/2023 17:12:01 - INFO - app - STEP = 578
10/17/2023 17:12:02 - INFO - app - STEP = 579
10/17/2023 17:12:03 - INFO - app - STEP = 580
10/17/2023 17:12:04 - INFO - app - STEP = 581
10/17/2023 17:12:06 - INFO - app - STEP = 582
10/17/2023 17:12:07 - INFO - app - STEP = 583
10/17/2023 17:12:08 - INFO - app - STEP = 584
10/17/2023 17:12:09 - INFO - app - STEP = 585
10/17/2023 17:12:10 - INFO - app - STEP = 586
10/17/2023 17:12:11 - INFO - app - STEP = 587
10/17/2023 17:12:12 - INFO - app - STEP = 588
10/17/2023 17:12:13 - INFO - app - STEP = 589
10/17/2023 17:12:14 - INFO - app - STEP = 590
10/17/2023 17:12:15 - INFO - app - STEP = 591
10/17/2023 17:12:16 - INFO - app - STEP = 592
10/17/2023 17:12:17 - INFO - app - STEP = 593
10/17/2023 17:12:18 - INFO - app - STEP = 594
10/17/2023 17:12:19 - INFO - app - STEP = 595
10/17/2023 17:12:20 - INFO - app - STEP = 596
10/17/2023 17:12:21 - INFO - app - STEP = 597
10/17/2023 17:12:22 - INFO - app - STEP = 598
10/17/2023 17:12:23 - INFO - app - STEP = 599
10/17/2023 17:12:24 - INFO - app - STEP = 600
10/17/2023 17:12:25 - INFO - app - STEP = 601
10/17/2023 17:12:26 - INFO - app - STEP = 602
10/17/2023 17:12:27 - INFO - app - STEP = 603
10/17/2023 17:12:28 - INFO - app - STEP = 604
10/17/2023 17:12:29 - INFO - app - STEP = 605
10/17/2023 17:12:30 - INFO - app - STEP = 606
10/17/2023 17:12:31 - INFO - app - STEP = 607
10/17/2023 17:12:32 - INFO - app - STEP = 608
10/17/2023 17:12:33 - INFO - app - STEP = 609
10/17/2023 17:12:34 - INFO - app - STEP = 610
10/17/2023 17:12:35 - INFO - app - STEP = 611
10/17/2023 17:12:37 - INFO - app - STEP = 612
10/17/2023 17:12:38 - INFO - app - STEP = 613
10/17/2023 17:12:39 - INFO - app - STEP = 614
10/17/2023 17:12:40 - INFO - app - STEP = 615
10/17/2023 17:12:41 - INFO - app - STEP = 616
10/17/2023 17:12:42 - INFO - app - STEP = 617
10/17/2023 17:12:43 - INFO - app - STEP = 618
10/17/2023 17:12:44 - INFO - app - STEP = 619
10/17/2023 17:12:45 - INFO - app - STEP = 620
10/17/2023 17:12:46 - INFO - app - STEP = 621
10/17/2023 17:12:47 - INFO - app - STEP = 622
10/17/2023 17:12:48 - INFO - app - STEP = 623
10/17/2023 17:12:49 - INFO - app - STEP = 624
10/17/2023 17:12:50 - INFO - app - STEP = 625
10/17/2023 17:12:51 - INFO - app - STEP = 626
10/17/2023 17:12:52 - INFO - app - STEP = 627
10/17/2023 17:12:53 - INFO - app - STEP = 628
10/17/2023 17:12:54 - INFO - app - STEP = 629
10/17/2023 17:12:55 - INFO - app - STEP = 630
10/17/2023 17:12:56 - INFO - app - Running validation...
Generating 4 images with prompt: A photo of sks dog.
10/17/2023 17:13:23 - INFO - app - STEP = 631
10/17/2023 17:13:24 - INFO - app - STEP = 632
10/17/2023 17:13:25 - INFO - app - STEP = 633
10/17/2023 17:13:26 - INFO - app - STEP = 634
10/17/2023 17:13:27 - INFO - app - STEP = 635
10/17/2023 17:13:28 - INFO - app - STEP = 636
10/17/2023 17:13:29 - INFO - app - STEP = 637
10/17/2023 17:13:30 - INFO - app - STEP = 638
10/17/2023 17:13:31 - INFO - app - STEP = 639
10/17/2023 17:13:32 - INFO - app - STEP = 640
10/17/2023 17:13:33 - INFO - app - STEP = 641
10/17/2023 17:13:34 - INFO - app - STEP = 642
10/17/2023 17:13:35 - INFO - app - STEP = 643
10/17/2023 17:13:36 - INFO - app - STEP = 644
10/17/2023 17:13:37 - INFO - app - STEP = 645
10/17/2023 17:13:38 - INFO - app - STEP = 646
10/17/2023 17:13:39 - INFO - app - STEP = 647
10/17/2023 17:13:40 - INFO - app - STEP = 648
10/17/2023 17:13:41 - INFO - app - STEP = 649
10/17/2023 17:13:42 - INFO - app - STEP = 650
10/17/2023 17:13:43 - INFO - app - STEP = 651
10/17/2023 17:13:44 - INFO - app - STEP = 652
10/17/2023 17:13:46 - INFO - app - STEP = 653
10/17/2023 17:13:47 - INFO - app - STEP = 654
10/17/2023 17:13:47 - INFO - app - STEP = 655
10/17/2023 17:13:49 - INFO - app - STEP = 656
10/17/2023 17:13:50 - INFO - app - STEP = 657
10/17/2023 17:13:51 - INFO - app - STEP = 658
10/17/2023 17:13:52 - INFO - app - STEP = 659
10/17/2023 17:13:53 - INFO - app - STEP = 660
10/17/2023 17:13:54 - INFO - app - STEP = 661
10/17/2023 17:13:55 - INFO - app - STEP = 662
10/17/2023 17:13:56 - INFO - app - STEP = 663
10/17/2023 17:13:57 - INFO - app - STEP = 664
10/17/2023 17:13:58 - INFO - app - STEP = 665
10/17/2023 17:13:59 - INFO - app - STEP = 666
10/17/2023 17:14:00 - INFO - app - STEP = 667
10/17/2023 17:14:01 - INFO - app - STEP = 668
10/17/2023 17:14:02 - INFO - app - STEP = 669
10/17/2023 17:14:03 - INFO - app - STEP = 670
10/17/2023 17:14:04 - INFO - app - STEP = 671
10/17/2023 17:14:05 - INFO - app - STEP = 672
10/17/2023 17:14:06 - INFO - app - STEP = 673
10/17/2023 17:14:07 - INFO - app - STEP = 674
10/17/2023 17:14:08 - INFO - app - STEP = 675
10/17/2023 17:14:09 - INFO - app - STEP = 676
10/17/2023 17:14:10 - INFO - app - STEP = 677
10/17/2023 17:14:11 - INFO - app - STEP = 678
10/17/2023 17:14:12 - INFO - app - STEP = 679
10/17/2023 17:14:13 - INFO - app - STEP = 680
10/17/2023 17:14:14 - INFO - app - STEP = 681
10/17/2023 17:14:16 - INFO - app - STEP = 682
10/17/2023 17:14:17 - INFO - app - STEP = 683
10/17/2023 17:14:18 - INFO - app - STEP = 684
10/17/2023 17:14:19 - INFO - app - STEP = 685
10/17/2023 17:14:20 - INFO - app - STEP = 686
10/17/2023 17:14:21 - INFO - app - STEP = 687
10/17/2023 17:14:22 - INFO - app - STEP = 688
10/17/2023 17:14:23 - INFO - app - STEP = 689
10/17/2023 17:14:24 - INFO - app - STEP = 690
10/17/2023 17:14:25 - INFO - app - STEP = 691
10/17/2023 17:14:26 - INFO - app - STEP = 692
10/17/2023 17:14:27 - INFO - app - STEP = 693
10/17/2023 17:14:28 - INFO - app - STEP = 694
10/17/2023 17:14:29 - INFO - app - STEP = 695
10/17/2023 17:14:30 - INFO - app - STEP = 696
10/17/2023 17:14:31 - INFO - app - STEP = 697
10/17/2023 17:14:32 - INFO - app - STEP = 698
10/17/2023 17:14:33 - INFO - app - STEP = 699
10/17/2023 17:14:34 - INFO - app - STEP = 700
10/17/2023 17:14:35 - INFO - app - STEP = 701
10/17/2023 17:14:36 - INFO - app - STEP = 702
10/17/2023 17:14:37 - INFO - app - STEP = 703
10/17/2023 17:14:38 - INFO - app - STEP = 704
10/17/2023 17:14:39 - INFO - app - STEP = 705
10/17/2023 17:14:40 - INFO - app - STEP = 706
10/17/2023 17:14:41 - INFO - app - STEP = 707
10/17/2023 17:14:42 - INFO - app - STEP = 708
10/17/2023 17:14:43 - INFO - app - STEP = 709
10/17/2023 17:14:44 - INFO - app - STEP = 710
10/17/2023 17:14:45 - INFO - app - STEP = 711
10/17/2023 17:14:47 - INFO - app - STEP = 712
10/17/2023 17:14:48 - INFO - app - STEP = 713
10/17/2023 17:14:49 - INFO - app - STEP = 714
10/17/2023 17:14:50 - INFO - app - STEP = 715
10/17/2023 17:14:51 - INFO - app - STEP = 716
10/17/2023 17:14:52 - INFO - app - STEP = 717
10/17/2023 17:14:53 - INFO - app - STEP = 718
10/17/2023 17:14:54 - INFO - app - STEP = 719
10/17/2023 17:14:55 - INFO - app - STEP = 720
10/17/2023 17:14:56 - INFO - app - STEP = 721
10/17/2023 17:14:57 - INFO - app - STEP = 722
10/17/2023 17:14:58 - INFO - app - STEP = 723
10/17/2023 17:14:59 - INFO - app - STEP = 724
10/17/2023 17:15:00 - INFO - app - STEP = 725
10/17/2023 17:15:01 - INFO - app - STEP = 726
10/17/2023 17:15:02 - INFO - app - STEP = 727
10/17/2023 17:15:03 - INFO - app - STEP = 728
10/17/2023 17:15:04 - INFO - app - STEP = 729
10/17/2023 17:15:05 - INFO - app - STEP = 730
10/17/2023 17:15:06 - INFO - app - STEP = 731
10/17/2023 17:15:07 - INFO - app - STEP = 732
10/17/2023 17:15:08 - INFO - app - STEP = 733
10/17/2023 17:15:09 - INFO - app - STEP = 734
10/17/2023 17:15:10 - INFO - app - STEP = 735
10/17/2023 17:15:11 - INFO - app - STEP = 736
10/17/2023 17:15:12 - INFO - app - STEP = 737
10/17/2023 17:15:13 - INFO - app - STEP = 738
10/17/2023 17:15:14 - INFO - app - STEP = 739
10/17/2023 17:15:15 - INFO - app - STEP = 740
10/17/2023 17:15:17 - INFO - app - STEP = 741
10/17/2023 17:15:18 - INFO - app - STEP = 742
10/17/2023 17:15:19 - INFO - app - STEP = 743
10/17/2023 17:15:20 - INFO - app - STEP = 744
10/17/2023 17:15:21 - INFO - app - STEP = 745
10/17/2023 17:15:22 - INFO - app - STEP = 746
10/17/2023 17:15:23 - INFO - app - STEP = 747
10/17/2023 17:15:24 - INFO - app - STEP = 748
10/17/2023 17:15:25 - INFO - app - STEP = 749
10/17/2023 17:15:26 - INFO - app - STEP = 750
10/17/2023 17:15:27 - INFO - app - STEP = 751
10/17/2023 17:15:28 - INFO - app - STEP = 752
10/17/2023 17:15:29 - INFO - app - STEP = 753
10/17/2023 17:15:30 - INFO - app - STEP = 754
10/17/2023 17:15:31 - INFO - app - STEP = 755
10/17/2023 17:15:32 - INFO - app - Running validation...
Generating 4 images with prompt: A photo of sks dog.
10/17/2023 17:15:59 - INFO - app - STEP = 756
10/17/2023 17:16:00 - INFO - app - STEP = 757
10/17/2023 17:16:01 - INFO - app - STEP = 758
10/17/2023 17:16:02 - INFO - app - STEP = 759
10/17/2023 17:16:03 - INFO - app - STEP = 760
10/17/2023 17:16:04 - INFO - app - STEP = 761
10/17/2023 17:16:05 - INFO - app - STEP = 762
10/17/2023 17:16:06 - INFO - app - STEP = 763
10/17/2023 17:16:07 - INFO - app - STEP = 764
10/17/2023 17:16:08 - INFO - app - STEP = 765
10/17/2023 17:16:09 - INFO - app - STEP = 766
10/17/2023 17:16:10 - INFO - app - STEP = 767
10/17/2023 17:16:11 - INFO - app - STEP = 768
10/17/2023 17:16:12 - INFO - app - STEP = 769
10/17/2023 17:16:13 - INFO - app - STEP = 770
10/17/2023 17:16:14 - INFO - app - STEP = 771
10/17/2023 17:16:15 - INFO - app - STEP = 772
10/17/2023 17:16:16 - INFO - app - STEP = 773
10/17/2023 17:16:17 - INFO - app - STEP = 774
10/17/2023 17:16:18 - INFO - app - STEP = 775
10/17/2023 17:16:20 - INFO - app - STEP = 776
10/17/2023 17:16:21 - INFO - app - STEP = 777
10/17/2023 17:16:22 - INFO - app - STEP = 778
10/17/2023 17:16:23 - INFO - app - STEP = 779
10/17/2023 17:16:24 - INFO - app - STEP = 780
10/17/2023 17:16:25 - INFO - app - STEP = 781
10/17/2023 17:16:26 - INFO - app - STEP = 782
10/17/2023 17:16:27 - INFO - app - STEP = 783
10/17/2023 17:16:28 - INFO - app - STEP = 784
10/17/2023 17:16:29 - INFO - app - STEP = 785
10/17/2023 17:16:30 - INFO - app - STEP = 786
10/17/2023 17:16:31 - INFO - app - STEP = 787
10/17/2023 17:16:32 - INFO - app - STEP = 788
10/17/2023 17:16:33 - INFO - app - STEP = 789
10/17/2023 17:16:34 - INFO - app - STEP = 790
10/17/2023 17:16:35 - INFO - app - STEP = 791
10/17/2023 17:16:36 - INFO - app - STEP = 792
10/17/2023 17:16:37 - INFO - app - STEP = 793
10/17/2023 17:16:38 - INFO - app - STEP = 794
10/17/2023 17:16:39 - INFO - app - STEP = 795
10/17/2023 17:16:40 - INFO - app - STEP = 796
10/17/2023 17:16:41 - INFO - app - STEP = 797
10/17/2023 17:16:42 - INFO - app - STEP = 798
10/17/2023 17:16:43 - INFO - app - STEP = 799
10/17/2023 17:16:44 - INFO - app - STEP = 800
10/17/2023 17:16:46 - INFO - app - STEP = 801
10/17/2023 17:16:47 - INFO - app - STEP = 802
10/17/2023 17:16:48 - INFO - app - STEP = 803
10/17/2023 17:16:49 - INFO - app - STEP = 804
10/17/2023 17:16:50 - INFO - app - STEP = 805
10/17/2023 17:16:51 - INFO - app - STEP = 806
10/17/2023 17:16:52 - INFO - app - STEP = 807
10/17/2023 17:16:53 - INFO - app - STEP = 808
10/17/2023 17:16:54 - INFO - app - STEP = 809
10/17/2023 17:16:55 - INFO - app - STEP = 810
10/17/2023 17:16:56 - INFO - app - STEP = 811
10/17/2023 17:16:57 - INFO - app - STEP = 812
10/17/2023 17:16:58 - INFO - app - STEP = 813
10/17/2023 17:16:59 - INFO - app - STEP = 814
10/17/2023 17:17:00 - INFO - app - STEP = 815
10/17/2023 17:17:01 - INFO - app - STEP = 816
10/17/2023 17:17:02 - INFO - app - STEP = 817
10/17/2023 17:17:03 - INFO - app - STEP = 818
10/17/2023 17:17:04 - INFO - app - STEP = 819
10/17/2023 17:17:05 - INFO - app - STEP = 820
10/17/2023 17:17:06 - INFO - app - STEP = 821
10/17/2023 17:17:07 - INFO - app - STEP = 822
10/17/2023 17:17:08 - INFO - app - STEP = 823
10/17/2023 17:17:09 - INFO - app - STEP = 824
10/17/2023 17:17:10 - INFO - app - STEP = 825
10/17/2023 17:17:11 - INFO - app - STEP = 826
10/17/2023 17:17:12 - INFO - app - STEP = 827
10/17/2023 17:17:13 - INFO - app - STEP = 828
10/17/2023 17:17:14 - INFO - app - STEP = 829
10/17/2023 17:17:15 - INFO - app - STEP = 830
10/17/2023 17:17:17 - INFO - app - STEP = 831
10/17/2023 17:17:18 - INFO - app - STEP = 832
10/17/2023 17:17:19 - INFO - app - STEP = 833
10/17/2023 17:17:20 - INFO - app - STEP = 834
10/17/2023 17:17:21 - INFO - accelerate.accelerator - Saving current state to models/zee-test/checkpoint-500
10/17/2023 17:17:21 - INFO - accelerate.checkpointing - Optimizer state saved in models/zee-test/checkpoint-500/optimizer.bin
10/17/2023 17:17:21 - INFO - accelerate.checkpointing - Scheduler state saved in models/zee-test/checkpoint-500/scheduler.bin
10/17/2023 17:17:21 - INFO - accelerate.checkpointing - Random states saved in models/zee-test/checkpoint-500/random_states_0.pkl
10/17/2023 17:17:21 - INFO - app - Saved state to models/zee-test/checkpoint-500
10/17/2023 17:17:21 - INFO - app - STEP = 835
10/17/2023 17:17:22 - INFO - app - STEP = 836
10/17/2023 17:17:23 - INFO - app - STEP = 837
10/17/2023 17:17:24 - INFO - app - STEP = 838
10/17/2023 17:17:25 - INFO - app - STEP = 839
10/17/2023 17:17:26 - INFO - app - STEP = 840
10/17/2023 17:17:27 - INFO - app - STEP = 841
10/17/2023 17:17:28 - INFO - app - STEP = 842
10/17/2023 17:17:29 - INFO - app - STEP = 843
10/17/2023 17:17:30 - INFO - app - STEP = 844
10/17/2023 17:17:31 - INFO - app - STEP = 845
10/17/2023 17:17:32 - INFO - app - STEP = 846
10/17/2023 17:17:33 - INFO - app - STEP = 847
10/17/2023 17:17:34 - INFO - app - STEP = 848
10/17/2023 17:17:35 - INFO - app - STEP = 849
10/17/2023 17:17:36 - INFO - app - STEP = 850
10/17/2023 17:17:37 - INFO - app - STEP = 851
10/17/2023 17:17:39 - INFO - app - STEP = 852
10/17/2023 17:17:40 - INFO - app - STEP = 853
10/17/2023 17:17:41 - INFO - app - STEP = 854
10/17/2023 17:17:42 - INFO - app - STEP = 855
10/17/2023 17:17:43 - INFO - app - STEP = 856
10/17/2023 17:17:44 - INFO - app - STEP = 857
10/17/2023 17:17:45 - INFO - app - STEP = 858
10/17/2023 17:17:46 - INFO - app - STEP = 859
10/17/2023 17:17:47 - INFO - app - STEP = 860
10/17/2023 17:17:48 - INFO - app - STEP = 861
10/17/2023 17:17:49 - INFO - app - STEP = 862
10/17/2023 17:17:50 - INFO - app - STEP = 863
10/17/2023 17:17:51 - INFO - app - STEP = 864
10/17/2023 17:17:52 - INFO - app - STEP = 865
10/17/2023 17:17:53 - INFO - app - STEP = 866
10/17/2023 17:17:54 - INFO - app - STEP = 867
10/17/2023 17:17:55 - INFO - app - STEP = 868
10/17/2023 17:17:56 - INFO - app - STEP = 869
10/17/2023 17:17:57 - INFO - app - STEP = 870
10/17/2023 17:17:58 - INFO - app - STEP = 871
10/17/2023 17:17:59 - INFO - app - STEP = 872
10/17/2023 17:18:00 - INFO - app - STEP = 873
10/17/2023 17:18:01 - INFO - app - STEP = 874
10/17/2023 17:18:02 - INFO - app - STEP = 875
10/17/2023 17:18:03 - INFO - app - STEP = 876
10/17/2023 17:18:04 - INFO - app - STEP = 877
10/17/2023 17:18:06 - INFO - app - STEP = 878
10/17/2023 17:18:07 - INFO - app - STEP = 879
10/17/2023 17:18:08 - INFO - app - STEP = 880
10/17/2023 17:18:08 - INFO - app - Running validation...
Generating 4 images with prompt: A photo of sks dog.
10/17/2023 17:18:35 - INFO - app - STEP = 881
10/17/2023 17:18:36 - INFO - app - STEP = 882
10/17/2023 17:18:37 - INFO - app - STEP = 883
10/17/2023 17:18:38 - INFO - app - STEP = 884
10/17/2023 17:18:39 - INFO - app - STEP = 885
10/17/2023 17:18:40 - INFO - app - STEP = 886
10/17/2023 17:18:41 - INFO - app - STEP = 887
10/17/2023 17:18:42 - INFO - app - STEP = 888
10/17/2023 17:18:43 - INFO - app - STEP = 889
10/17/2023 17:18:44 - INFO - app - STEP = 890
10/17/2023 17:18:45 - INFO - app - STEP = 891
10/17/2023 17:18:46 - INFO - app - STEP = 892
10/17/2023 17:18:47 - INFO - app - STEP = 893
10/17/2023 17:18:48 - INFO - app - STEP = 894
10/17/2023 17:18:49 - INFO - app - STEP = 895
10/17/2023 17:18:51 - INFO - app - STEP = 896
10/17/2023 17:18:52 - INFO - app - STEP = 897
10/17/2023 17:18:53 - INFO - app - STEP = 898
10/17/2023 17:18:54 - INFO - app - STEP = 899
10/17/2023 17:18:55 - INFO - app - STEP = 900
10/17/2023 17:18:56 - INFO - app - STEP = 901
10/17/2023 17:18:57 - INFO - app - STEP = 902
10/17/2023 17:18:58 - INFO - app - STEP = 903
10/17/2023 17:18:59 - INFO - app - STEP = 904
10/17/2023 17:19:00 - INFO - app - STEP = 905
10/17/2023 17:19:01 - INFO - app - STEP = 906
10/17/2023 17:19:02 - INFO - app - STEP = 907
10/17/2023 17:19:03 - INFO - app - STEP = 908
10/17/2023 17:19:04 - INFO - app - STEP = 909
10/17/2023 17:19:05 - INFO - app - STEP = 910
10/17/2023 17:19:06 - INFO - app - STEP = 911
10/17/2023 17:19:07 - INFO - app - STEP = 912
10/17/2023 17:19:08 - INFO - app - STEP = 913
10/17/2023 17:19:09 - INFO - app - STEP = 914
10/17/2023 17:19:10 - INFO - app - STEP = 915
10/17/2023 17:19:11 - INFO - app - STEP = 916
10/17/2023 17:19:12 - INFO - app - STEP = 917
10/17/2023 17:19:13 - INFO - app - STEP = 918
10/17/2023 17:19:14 - INFO - app - STEP = 919
10/17/2023 17:19:15 - INFO - app - STEP = 920
10/17/2023 17:19:16 - INFO - app - STEP = 921
10/17/2023 17:19:17 - INFO - app - STEP = 922
10/17/2023 17:19:18 - INFO - app - STEP = 923
10/17/2023 17:19:19 - INFO - app - STEP = 924
10/17/2023 17:19:20 - INFO - app - STEP = 925
10/17/2023 17:19:22 - INFO - app - STEP = 926
10/17/2023 17:19:23 - INFO - app - STEP = 927
10/17/2023 17:19:24 - INFO - app - STEP = 928
10/17/2023 17:19:25 - INFO - app - STEP = 929
10/17/2023 17:19:26 - INFO - app - STEP = 930
10/17/2023 17:19:27 - INFO - app - STEP = 931
10/17/2023 17:19:28 - INFO - app - STEP = 932
10/17/2023 17:19:29 - INFO - app - STEP = 933
10/17/2023 17:19:30 - INFO - app - STEP = 934
10/17/2023 17:19:31 - INFO - app - STEP = 935
10/17/2023 17:19:32 - INFO - app - STEP = 936
10/17/2023 17:19:33 - INFO - app - STEP = 937
10/17/2023 17:19:34 - INFO - app - STEP = 938
10/17/2023 17:19:35 - INFO - app - STEP = 939
10/17/2023 17:19:36 - INFO - app - STEP = 940
10/17/2023 17:19:37 - INFO - app - STEP = 941
10/17/2023 17:19:38 - INFO - app - STEP = 942
10/17/2023 17:19:39 - INFO - app - STEP = 943
10/17/2023 17:19:40 - INFO - app - STEP = 944
10/17/2023 17:19:41 - INFO - app - STEP = 945
10/17/2023 17:19:42 - INFO - app - STEP = 946
10/17/2023 17:19:43 - INFO - app - STEP = 947
10/17/2023 17:19:44 - INFO - app - STEP = 948
10/17/2023 17:19:45 - INFO - app - STEP = 949
10/17/2023 17:19:46 - INFO - app - STEP = 950
10/17/2023 17:19:47 - INFO - app - STEP = 951
10/17/2023 17:19:49 - INFO - app - STEP = 952
10/17/2023 17:19:50 - INFO - app - STEP = 953
10/17/2023 17:19:51 - INFO - app - STEP = 954
10/17/2023 17:19:51 - INFO - app - STEP = 955
10/17/2023 17:19:53 - INFO - app - STEP = 956
10/17/2023 17:19:54 - INFO - app - STEP = 957
10/17/2023 17:19:55 - INFO - app - STEP = 958
10/17/2023 17:19:56 - INFO - app - STEP = 959
10/17/2023 17:19:57 - INFO - app - STEP = 960
10/17/2023 17:19:58 - INFO - app - STEP = 961
10/17/2023 17:19:59 - INFO - app - STEP = 962
10/17/2023 17:20:00 - INFO - app - STEP = 963
10/17/2023 17:20:01 - INFO - app - STEP = 964
10/17/2023 17:20:02 - INFO - app - STEP = 965
10/17/2023 17:20:03 - INFO - app - STEP = 966
10/17/2023 17:20:04 - INFO - app - STEP = 967
10/17/2023 17:20:05 - INFO - app - STEP = 968
10/17/2023 17:20:06 - INFO - app - STEP = 969
10/17/2023 17:20:07 - INFO - app - STEP = 970
10/17/2023 17:20:08 - INFO - app - STEP = 971
10/17/2023 17:20:09 - INFO - app - STEP = 972
10/17/2023 17:20:10 - INFO - app - STEP = 973
10/17/2023 17:20:11 - INFO - app - STEP = 974
10/17/2023 17:20:12 - INFO - app - STEP = 975
10/17/2023 17:20:13 - INFO - app - STEP = 976
10/17/2023 17:20:14 - INFO - app - STEP = 977
10/17/2023 17:20:15 - INFO - app - STEP = 978
10/17/2023 17:20:16 - INFO - app - STEP = 979
10/17/2023 17:20:17 - INFO - app - STEP = 980
10/17/2023 17:20:18 - INFO - app - STEP = 981
10/17/2023 17:20:20 - INFO - app - STEP = 982
10/17/2023 17:20:21 - INFO - app - STEP = 983
10/17/2023 17:20:22 - INFO - app - STEP = 984
10/17/2023 17:20:23 - INFO - app - STEP = 985
10/17/2023 17:20:24 - INFO - app - STEP = 986
10/17/2023 17:20:25 - INFO - app - STEP = 987
10/17/2023 17:20:26 - INFO - app - STEP = 988
10/17/2023 17:20:27 - INFO - app - STEP = 989
10/17/2023 17:20:28 - INFO - app - STEP = 990
10/17/2023 17:20:29 - INFO - app - STEP = 991
10/17/2023 17:20:30 - INFO - app - STEP = 992
10/17/2023 17:20:31 - INFO - app - STEP = 993
10/17/2023 17:20:32 - INFO - app - STEP = 994
10/17/2023 17:20:33 - INFO - app - STEP = 995
10/17/2023 17:20:34 - INFO - app - STEP = 996
10/17/2023 17:20:35 - INFO - app - STEP = 997
10/17/2023 17:20:36 - INFO - app - STEP = 998
10/17/2023 17:20:37 - INFO - app - STEP = 999
10/17/2023 17:20:38 - INFO - app - STEP = 1000
10/17/2023 17:20:39 - INFO - app - STEP = 1001
10/17/2023 17:20:40 - INFO - app - STEP = 1002
10/17/2023 17:20:41 - INFO - app - STEP = 1003
10/17/2023 17:20:42 - INFO - app - STEP = 1004
10/17/2023 17:20:43 - INFO - app - STEP = 1005
10/17/2023 17:20:44 - INFO - app - Running validation...
Generating 4 images with prompt: A photo of sks dog.
10/17/2023 17:21:11 - INFO - app - STEP = 1006
10/17/2023 17:21:12 - INFO - app - STEP = 1007
10/17/2023 17:21:13 - INFO - app - STEP = 1008
10/17/2023 17:21:14 - INFO - app - STEP = 1009
10/17/2023 17:21:15 - INFO - app - STEP = 1010
10/17/2023 17:21:16 - INFO - app - STEP = 1011
10/17/2023 17:21:17 - INFO - app - STEP = 1012
10/17/2023 17:21:18 - INFO - app - STEP = 1013
10/17/2023 17:21:20 - INFO - app - STEP = 1014
10/17/2023 17:21:20 - INFO - app - STEP = 1015
10/17/2023 17:21:22 - INFO - app - STEP = 1016
10/17/2023 17:21:23 - INFO - app - STEP = 1017
10/17/2023 17:21:24 - INFO - app - STEP = 1018
10/17/2023 17:21:25 - INFO - app - STEP = 1019
10/17/2023 17:21:26 - INFO - app - STEP = 1020
10/17/2023 17:21:27 - INFO - app - STEP = 1021
10/17/2023 17:21:28 - INFO - app - STEP = 1022
10/17/2023 17:21:29 - INFO - app - STEP = 1023
10/17/2023 17:21:30 - INFO - app - STEP = 1024
10/17/2023 17:21:31 - INFO - app - STEP = 1025
10/17/2023 17:21:33 - INFO - app - STEP = 1026
10/17/2023 17:21:34 - INFO - app - STEP = 1027
10/17/2023 17:21:35 - INFO - app - STEP = 1028
10/17/2023 17:21:36 - INFO - app - STEP = 1029
10/17/2023 17:21:37 - INFO - app - STEP = 1030
10/17/2023 17:21:38 - INFO - app - STEP = 1031
10/17/2023 17:21:39 - INFO - app - STEP = 1032
10/17/2023 17:21:40 - INFO - app - STEP = 1033
10/17/2023 17:21:41 - INFO - app - STEP = 1034
10/17/2023 17:21:42 - INFO - app - STEP = 1035
10/17/2023 17:21:43 - INFO - app - STEP = 1036
10/17/2023 17:21:44 - INFO - app - STEP = 1037
10/17/2023 17:21:45 - INFO - app - STEP = 1038
10/17/2023 17:21:47 - INFO - app - STEP = 1039
10/17/2023 17:21:48 - INFO - app - STEP = 1040
10/17/2023 17:21:49 - INFO - app - STEP = 1041
10/17/2023 17:21:50 - INFO - app - STEP = 1042
10/17/2023 17:21:51 - INFO - app - STEP = 1043
10/17/2023 17:21:52 - INFO - app - STEP = 1044
10/17/2023 17:21:53 - INFO - app - STEP = 1045
10/17/2023 17:21:55 - INFO - app - STEP = 1046
10/17/2023 17:21:56 - INFO - app - STEP = 1047
10/17/2023 17:21:57 - INFO - app - STEP = 1048
10/17/2023 17:21:58 - INFO - app - STEP = 1049
10/17/2023 17:21:59 - INFO - app - STEP = 1050
10/17/2023 17:22:00 - INFO - app - STEP = 1051
10/17/2023 17:22:01 - INFO - app - STEP = 1052
10/17/2023 17:22:02 - INFO - app - STEP = 1053
10/17/2023 17:22:03 - INFO - app - STEP = 1054
10/17/2023 17:22:04 - INFO - app - STEP = 1055
10/17/2023 17:22:06 - INFO - app - STEP = 1056
10/17/2023 17:22:07 - INFO - app - STEP = 1057
10/17/2023 17:22:08 - INFO - app - STEP = 1058
10/17/2023 17:22:09 - INFO - app - STEP = 1059
10/17/2023 17:22:10 - INFO - app - STEP = 1060
10/17/2023 17:22:11 - INFO - app - STEP = 1061
10/17/2023 17:22:12 - INFO - app - STEP = 1062
10/17/2023 17:22:14 - INFO - app - STEP = 1063
10/17/2023 17:22:15 - INFO - app - STEP = 1064
10/17/2023 17:22:16 - INFO - app - STEP = 1065
10/17/2023 17:22:17 - INFO - app - STEP = 1066
10/17/2023 17:22:18 - INFO - app - STEP = 1067
10/17/2023 17:22:19 - INFO - app - STEP = 1068
10/17/2023 17:22:20 - INFO - app - STEP = 1069
10/17/2023 17:22:21 - INFO - app - STEP = 1070
10/17/2023 17:22:22 - INFO - app - STEP = 1071
10/17/2023 17:22:23 - INFO - app - STEP = 1072
10/17/2023 17:22:24 - INFO - app - STEP = 1073
10/17/2023 17:22:25 - INFO - app - STEP = 1074
10/17/2023 17:22:26 - INFO - app - STEP = 1075
10/17/2023 17:22:27 - INFO - app - STEP = 1076
10/17/2023 17:22:28 - INFO - app - STEP = 1077
10/17/2023 17:22:29 - INFO - app - STEP = 1078
10/17/2023 17:22:30 - INFO - app - STEP = 1079
10/17/2023 17:22:31 - INFO - app - STEP = 1080
10/17/2023 17:22:32 - INFO - app - STEP = 1081
10/17/2023 17:22:33 - INFO - app - STEP = 1082
10/17/2023 17:22:34 - INFO - app - STEP = 1083
10/17/2023 17:22:35 - INFO - app - STEP = 1084
10/17/2023 17:22:36 - INFO - app - STEP = 1085
10/17/2023 17:22:37 - INFO - app - STEP = 1086
10/17/2023 17:22:38 - INFO - app - STEP = 1087
10/17/2023 17:22:39 - INFO - app - STEP = 1088
10/17/2023 17:22:40 - INFO - app - STEP = 1089
10/17/2023 17:22:41 - INFO - app - STEP = 1090
10/17/2023 17:22:42 - INFO - app - STEP = 1091
10/17/2023 17:22:43 - INFO - app - STEP = 1092
10/17/2023 17:22:44 - INFO - app - STEP = 1093
10/17/2023 17:22:46 - INFO - app - STEP = 1094
10/17/2023 17:22:46 - INFO - app - STEP = 1095
10/17/2023 17:22:48 - INFO - app - STEP = 1096
10/17/2023 17:22:49 - INFO - app - STEP = 1097
10/17/2023 17:22:50 - INFO - app - STEP = 1098
10/17/2023 17:22:51 - INFO - app - STEP = 1099
10/17/2023 17:22:52 - INFO - app - STEP = 1100
10/17/2023 17:22:53 - INFO - app - STEP = 1101
10/17/2023 17:22:54 - INFO - app - STEP = 1102
10/17/2023 17:22:55 - INFO - app - STEP = 1103
10/17/2023 17:22:56 - INFO - app - STEP = 1104
10/17/2023 17:22:57 - INFO - app - STEP = 1105
10/17/2023 17:22:58 - INFO - app - STEP = 1106
10/17/2023 17:22:59 - INFO - app - STEP = 1107
10/17/2023 17:23:00 - INFO - app - STEP = 1108
10/17/2023 17:23:01 - INFO - app - STEP = 1109
10/17/2023 17:23:02 - INFO - app - STEP = 1110
10/17/2023 17:23:03 - INFO - app - STEP = 1111
10/17/2023 17:23:04 - INFO - app - STEP = 1112
10/17/2023 17:23:05 - INFO - app - STEP = 1113
10/17/2023 17:23:06 - INFO - app - STEP = 1114
10/17/2023 17:23:07 - INFO - app - STEP = 1115
10/17/2023 17:23:08 - INFO - app - STEP = 1116
10/17/2023 17:23:09 - INFO - app - STEP = 1117
10/17/2023 17:23:10 - INFO - app - STEP = 1118
10/17/2023 17:23:11 - INFO - app - STEP = 1119
10/17/2023 17:23:12 - INFO - app - STEP = 1120
10/17/2023 17:23:13 - INFO - app - STEP = 1121
10/17/2023 17:23:14 - INFO - app - STEP = 1122
10/17/2023 17:23:15 - INFO - app - STEP = 1123
10/17/2023 17:23:16 - INFO - app - STEP = 1124
10/17/2023 17:23:17 - INFO - app - STEP = 1125
10/17/2023 17:23:18 - INFO - app - STEP = 1126
10/17/2023 17:23:20 - INFO - app - STEP = 1127
10/17/2023 17:23:21 - INFO - app - STEP = 1128
10/17/2023 17:23:22 - INFO - app - STEP = 1129
10/17/2023 17:23:23 - INFO - app - STEP = 1130
10/17/2023 17:23:24 - INFO - app - Running validation...
Generating 4 images with prompt: A photo of sks dog.
10/17/2023 17:23:50 - INFO - app - STEP = 1131
10/17/2023 17:23:51 - INFO - app - STEP = 1132
10/17/2023 17:23:52 - INFO - app - STEP = 1133
10/17/2023 17:23:53 - INFO - app - STEP = 1134
10/17/2023 17:23:54 - INFO - app - STEP = 1135
10/17/2023 17:23:55 - INFO - app - STEP = 1136
10/17/2023 17:23:56 - INFO - app - STEP = 1137
10/17/2023 17:23:57 - INFO - app - STEP = 1138
10/17/2023 17:23:58 - INFO - app - STEP = 1139
10/17/2023 17:23:59 - INFO - app - STEP = 1140
10/17/2023 17:24:00 - INFO - app - STEP = 1141
10/17/2023 17:24:01 - INFO - app - STEP = 1142
10/17/2023 17:24:03 - INFO - app - STEP = 1143
10/17/2023 17:24:04 - INFO - app - STEP = 1144
10/17/2023 17:24:05 - INFO - app - STEP = 1145
10/17/2023 17:24:06 - INFO - app - STEP = 1146
10/17/2023 17:24:07 - INFO - app - STEP = 1147
10/17/2023 17:24:08 - INFO - app - STEP = 1148
10/17/2023 17:24:09 - INFO - app - STEP = 1149
10/17/2023 17:24:10 - INFO - app - STEP = 1150
10/17/2023 17:24:11 - INFO - app - STEP = 1151
10/17/2023 17:24:12 - INFO - app - STEP = 1152
10/17/2023 17:24:13 - INFO - app - STEP = 1153
10/17/2023 17:24:14 - INFO - app - STEP = 1154
10/17/2023 17:24:15 - INFO - app - STEP = 1155
10/17/2023 17:24:16 - INFO - app - STEP = 1156
10/17/2023 17:24:17 - INFO - app - STEP = 1157
10/17/2023 17:24:18 - INFO - app - STEP = 1158
10/17/2023 17:24:19 - INFO - app - STEP = 1159
10/17/2023 17:24:20 - INFO - app - STEP = 1160
10/17/2023 17:24:21 - INFO - app - STEP = 1161
10/17/2023 17:24:22 - INFO - app - STEP = 1162
10/17/2023 17:24:23 - INFO - app - STEP = 1163
10/17/2023 17:24:24 - INFO - app - STEP = 1164
10/17/2023 17:24:25 - INFO - app - STEP = 1165
10/17/2023 17:24:26 - INFO - app - STEP = 1166
10/17/2023 17:24:27 - INFO - app - STEP = 1167
10/17/2023 17:24:28 - INFO - app - STEP = 1168
10/17/2023 17:24:29 - INFO - app - STEP = 1169
10/17/2023 17:24:30 - INFO - app - STEP = 1170
10/17/2023 17:24:32 - INFO - app - STEP = 1171
10/17/2023 17:24:33 - INFO - app - STEP = 1172
10/17/2023 17:24:34 - INFO - app - STEP = 1173
10/17/2023 17:24:35 - INFO - app - STEP = 1174
10/17/2023 17:24:36 - INFO - app - STEP = 1175
10/17/2023 17:24:37 - INFO - app - STEP = 1176
10/17/2023 17:24:38 - INFO - app - STEP = 1177
10/17/2023 17:24:39 - INFO - app - STEP = 1178
10/17/2023 17:24:40 - INFO - app - STEP = 1179
10/17/2023 17:24:41 - INFO - app - STEP = 1180
10/17/2023 17:24:42 - INFO - app - STEP = 1181
10/17/2023 17:24:43 - INFO - app - STEP = 1182
10/17/2023 17:24:44 - INFO - app - STEP = 1183
10/17/2023 17:24:45 - INFO - app - STEP = 1184
10/17/2023 17:24:46 - INFO - app - STEP = 1185
10/17/2023 17:24:47 - INFO - app - STEP = 1186
10/17/2023 17:24:48 - INFO - app - STEP = 1187
10/17/2023 17:24:49 - INFO - app - STEP = 1188
10/17/2023 17:24:50 - INFO - app - STEP = 1189
10/17/2023 17:24:51 - INFO - app - STEP = 1190
10/17/2023 17:24:52 - INFO - app - STEP = 1191
10/17/2023 17:24:53 - INFO - app - STEP = 1192
10/17/2023 17:24:54 - INFO - app - STEP = 1193
10/17/2023 17:24:55 - INFO - app - STEP = 1194
10/17/2023 17:24:56 - INFO - app - STEP = 1195
10/17/2023 17:24:57 - INFO - app - STEP = 1196
10/17/2023 17:24:58 - INFO - app - STEP = 1197
10/17/2023 17:24:59 - INFO - app - STEP = 1198
10/17/2023 17:25:00 - INFO - app - STEP = 1199
10/17/2023 17:25:01 - INFO - app - STEP = 1200
10/17/2023 17:25:03 - INFO - app - STEP = 1201
10/17/2023 17:25:04 - INFO - app - STEP = 1202
10/17/2023 17:25:05 - INFO - app - STEP = 1203
10/17/2023 17:25:06 - INFO - app - STEP = 1204
10/17/2023 17:25:07 - INFO - app - STEP = 1205
10/17/2023 17:25:08 - INFO - app - STEP = 1206
10/17/2023 17:25:09 - INFO - app - STEP = 1207
10/17/2023 17:25:10 - INFO - app - STEP = 1208
10/17/2023 17:25:11 - INFO - app - STEP = 1209
10/17/2023 17:25:12 - INFO - app - STEP = 1210
10/17/2023 17:25:13 - INFO - app - STEP = 1211
10/17/2023 17:25:14 - INFO - app - STEP = 1212
10/17/2023 17:25:15 - INFO - app - STEP = 1213
10/17/2023 17:25:16 - INFO - app - STEP = 1214
10/17/2023 17:25:17 - INFO - app - STEP = 1215
10/17/2023 17:25:18 - INFO - app - STEP = 1216
10/17/2023 17:25:19 - INFO - app - STEP = 1217
10/17/2023 17:25:20 - INFO - app - STEP = 1218
10/17/2023 17:25:21 - INFO - app - STEP = 1219
10/17/2023 17:25:22 - INFO - app - STEP = 1220
10/17/2023 17:25:23 - INFO - app - STEP = 1221
10/17/2023 17:25:24 - INFO - app - STEP = 1222
10/17/2023 17:25:25 - INFO - app - STEP = 1223
10/17/2023 17:25:26 - INFO - app - STEP = 1224
10/17/2023 17:25:27 - INFO - app - STEP = 1225
10/17/2023 17:25:28 - INFO - app - STEP = 1226
10/17/2023 17:25:29 - INFO - app - STEP = 1227
10/17/2023 17:25:31 - INFO - app - STEP = 1228
10/17/2023 17:25:32 - INFO - app - STEP = 1229
10/17/2023 17:25:32 - INFO - app - STEP = 1230
10/17/2023 17:25:34 - INFO - app - STEP = 1231
10/17/2023 17:25:35 - INFO - app - STEP = 1232
10/17/2023 17:25:36 - INFO - app - STEP = 1233
10/17/2023 17:25:37 - INFO - app - STEP = 1234
10/17/2023 17:25:38 - INFO - app - STEP = 1235
10/17/2023 17:25:39 - INFO - app - STEP = 1236
10/17/2023 17:25:40 - INFO - app - STEP = 1237
10/17/2023 17:25:41 - INFO - app - STEP = 1238
10/17/2023 17:25:42 - INFO - app - STEP = 1239
10/17/2023 17:25:43 - INFO - app - STEP = 1240
10/17/2023 17:25:44 - INFO - app - STEP = 1241
10/17/2023 17:25:45 - INFO - app - STEP = 1242
10/17/2023 17:25:46 - INFO - app - STEP = 1243
10/17/2023 17:25:47 - INFO - app - STEP = 1244
10/17/2023 17:25:48 - INFO - app - STEP = 1245
10/17/2023 17:25:49 - INFO - app - STEP = 1246
10/17/2023 17:25:50 - INFO - app - STEP = 1247
10/17/2023 17:25:51 - INFO - app - STEP = 1248
10/17/2023 17:25:52 - INFO - app - STEP = 1249
10/17/2023 17:25:53 - INFO - app - STEP = 1250
10/17/2023 17:25:54 - INFO - accelerate.accelerator - Saving current state to models/zee-test/checkpoint-750
10/17/2023 17:25:54 - INFO - accelerate.checkpointing - Optimizer state saved in models/zee-test/checkpoint-750/optimizer.bin
10/17/2023 17:25:54 - INFO - accelerate.checkpointing - Scheduler state saved in models/zee-test/checkpoint-750/scheduler.bin
10/17/2023 17:25:54 - INFO - accelerate.checkpointing - Random states saved in models/zee-test/checkpoint-750/random_states_0.pkl
10/17/2023 17:25:54 - INFO - app - Saved state to models/zee-test/checkpoint-750
|