Update README.md
Browse files
README.md
CHANGED
@@ -62,55 +62,30 @@ accelerate launch --num_cpu_threads_per_process 4 flux_train_network.py --networ
|
|
62 |
```
|
63 |
|
64 |
--Continued training from sumeshi flux.1s v002E--
|
65 |
-
|
66 |
1. remove double blocks 18 / single blocks 34,35,36,37 / guidance_in (sumeshi flux.1s has zero tensor)
|
67 |
-
|
68 |
2. 3,893images (res1024 bs2 /res512 bs8 acc2 warmup50 --lr_scheduler="cosine_with_restarts" --lr_scheduler_num_cycles 1 --discrete_flow_shift 1.8) 4epochs
|
69 |
-
|
70 |
3. merged into model
|
71 |
-
|
72 |
4. remove double blocks 16,17 / single blocks 32,33
|
73 |
-
|
74 |
5. 3,893images (res1024 bs2 /res512 bs8 acc1 warmup50 --lr_scheduler="cosine_with_restarts" --lr_scheduler_num_cycles 2 --discrete_flow_shift 1.8) 2epochs
|
75 |
-
|
76 |
-
6. merged into model
|
77 |
-
|
78 |
7. remove double blocks 14,15 / single blocks 28,29,30,31
|
79 |
-
|
80 |
8. 3,893images (res1024 bs2 /res512 bs8 acc2 warmup50 --lr_scheduler="cosine_with_restarts" --lr_scheduler_num_cycles 2 --discrete_flow_shift 1.8) 2epochs
|
81 |
-
|
82 |
9. merged into model
|
83 |
-
|
84 |
10. remove double blocks 12,13 / single blocks 24,25,26,27
|
85 |
-
|
86 |
11. 3,893images (res1024 bs2 /res512 bs8 acc2 warmup50 --lr_scheduler="cosine_with_restarts" --lr_scheduler_num_cycles 2 --discrete_flow_shift 1.8) 2epochs
|
87 |
-
|
88 |
12. merged into model
|
89 |
-
|
90 |
13. 3,893images (Full-finetuned res1024 bs1 acc1 afafactor --optimizer_args "relative_step=False" "scale_parameter=False" "warmup_init=False" lr5e-6 warmup100 max_grad_norm 0.0 discrete_flow_shift 2) 2epochs
|
91 |
-
|
92 |
14. 12,000images (res1024 bs2 acc5 warmup100 --discrete_flow_shift 2) 1epochs
|
93 |
-
|
94 |
15. 12,000images (res1024 bs2 acc3 warmup100 --discrete_flow_shift 2) 2epochs
|
95 |
-
|
96 |
16. merged into model
|
97 |
-
|
98 |
17. 12,000images (res1024 bs2 acc3 warmup100 --discrete_flow_shift 2.5) 3epochs
|
99 |
-
|
100 |
18. 12,000images (res1024 bs2 acc3 warmup100 --discrete_flow_shift 2.5) 3epochs
|
101 |
-
|
102 |
19. 12,000images (res512 bs8 acc1 warmup100 timestep_sampling flux_shift(fixed ver.) ) 12epochs
|
103 |
-
|
104 |
20. merged into model
|
105 |
-
|
106 |
21. 12,000images (res512 bs4 acc1 warmup100 timesteps_sampling sigmoid sigmoid_scale 0.75) 7epochs
|
107 |
-
|
108 |
22. 3,893images (res512 bs4 acc1 warmup100 timesteps_sampling sigmoid sigmoid_scale 0.6 --caption_dropout_rate 0.1) 16epochs
|
109 |
-
|
110 |
23. merged into model
|
111 |
-
|
112 |
24. 3,893images (res1024 bs2 / res512 bs4 acc2 warmup100 unet_lr1e-4 te_lr5e-5 timesteps_sampling sigmoid sigmoid_scale 0.6 --caption_dropout_rate 0.1) 6epochs
|
113 |
-
|
114 |
25. merged into model and CLIP_L
|
115 |
|
116 |
## Resources (License)
|
|
|
62 |
```
|
63 |
|
64 |
--Continued training from sumeshi flux.1s v002E--
|
|
|
65 |
1. remove double blocks 18 / single blocks 34,35,36,37 / guidance_in (sumeshi flux.1s has zero tensor)
|
|
|
66 |
2. 3,893images (res1024 bs2 /res512 bs8 acc2 warmup50 --lr_scheduler="cosine_with_restarts" --lr_scheduler_num_cycles 1 --discrete_flow_shift 1.8) 4epochs
|
|
|
67 |
3. merged into model
|
|
|
68 |
4. remove double blocks 16,17 / single blocks 32,33
|
|
|
69 |
5. 3,893images (res1024 bs2 /res512 bs8 acc1 warmup50 --lr_scheduler="cosine_with_restarts" --lr_scheduler_num_cycles 2 --discrete_flow_shift 1.8) 2epochs
|
70 |
+
6. merged into model
|
|
|
|
|
71 |
7. remove double blocks 14,15 / single blocks 28,29,30,31
|
|
|
72 |
8. 3,893images (res1024 bs2 /res512 bs8 acc2 warmup50 --lr_scheduler="cosine_with_restarts" --lr_scheduler_num_cycles 2 --discrete_flow_shift 1.8) 2epochs
|
|
|
73 |
9. merged into model
|
|
|
74 |
10. remove double blocks 12,13 / single blocks 24,25,26,27
|
|
|
75 |
11. 3,893images (res1024 bs2 /res512 bs8 acc2 warmup50 --lr_scheduler="cosine_with_restarts" --lr_scheduler_num_cycles 2 --discrete_flow_shift 1.8) 2epochs
|
|
|
76 |
12. merged into model
|
|
|
77 |
13. 3,893images (Full-finetuned res1024 bs1 acc1 afafactor --optimizer_args "relative_step=False" "scale_parameter=False" "warmup_init=False" lr5e-6 warmup100 max_grad_norm 0.0 discrete_flow_shift 2) 2epochs
|
|
|
78 |
14. 12,000images (res1024 bs2 acc5 warmup100 --discrete_flow_shift 2) 1epochs
|
|
|
79 |
15. 12,000images (res1024 bs2 acc3 warmup100 --discrete_flow_shift 2) 2epochs
|
|
|
80 |
16. merged into model
|
|
|
81 |
17. 12,000images (res1024 bs2 acc3 warmup100 --discrete_flow_shift 2.5) 3epochs
|
|
|
82 |
18. 12,000images (res1024 bs2 acc3 warmup100 --discrete_flow_shift 2.5) 3epochs
|
|
|
83 |
19. 12,000images (res512 bs8 acc1 warmup100 timestep_sampling flux_shift(fixed ver.) ) 12epochs
|
|
|
84 |
20. merged into model
|
|
|
85 |
21. 12,000images (res512 bs4 acc1 warmup100 timesteps_sampling sigmoid sigmoid_scale 0.75) 7epochs
|
|
|
86 |
22. 3,893images (res512 bs4 acc1 warmup100 timesteps_sampling sigmoid sigmoid_scale 0.6 --caption_dropout_rate 0.1) 16epochs
|
|
|
87 |
23. merged into model
|
|
|
88 |
24. 3,893images (res1024 bs2 / res512 bs4 acc2 warmup100 unet_lr1e-4 te_lr5e-5 timesteps_sampling sigmoid sigmoid_scale 0.6 --caption_dropout_rate 0.1) 6epochs
|
|
|
89 |
25. merged into model and CLIP_L
|
90 |
|
91 |
## Resources (License)
|