Trained for 5 epochs and 176000 steps.

Trained with datasets ['text-embeds', 'text-embeds-extra', 'image-embeds', 'sports', 'mj-60', 'id-75k', 'celebrities', 'normalnudes', 'guys', 'signs', 'dalle3', 'sfwbooru', 'moviecollection', 'bookcovers', 'nijijourney', 'experimental', 'ethnic', 'gay', 'architecture', 'shutterstock', 'midjourney-v6-520k-raw', 'nijijourney-v6-520k-raw', 'cinemamix-1mp', 'nsfw-1024', 'anatomy', 'bg20k-1024', 'yoga', 'photo-aesthetics', 'text-1mp']
Learning rate 1e-06, batch size 8, and 1 gradient accumulation steps.
Used DDPM noise scheduler for training with epsilon prediction type and rescaled_betas_zero_snr=False
Using 'linspace' timestep spacing.
Base model: ptx0/pixart-900m-1024-ft-v0.7-stage1
VAE: ptx0/pixart-900m-1024-ft-v0.7-stage1

README.md

@@ -552,7 +552,7 @@ You may reuse the base model text encoder for inference.
 ## Training settings
 
 - Training epochs: 5
-- Training steps: 175000
+- Training steps: 176000
 - Learning rate: 1e-06
 - Effective batch size: 64
  - Micro-batch size: 8

optimizer.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6ae8fc730c6689a13da74b6deb0dcc5b94dbc40234c428db5f49ec81556c95d3
+oid sha256:407f1e61bb84f593e83ec9125cd8114a71ad38fbaae5e8e580bffabb760e4266
 size 5451415117

random_states_0.pkl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6355d6a3a84fb328082d75961308ef48affe650c2eaed84ce1ec729a7d6b0aa9
-size 16036
+oid sha256:4025b0d7f07bd0c1e3df76ad1145e2ede88ddfbba24ecfacc2e33383ca5d3745
+size 16100

scheduler.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:281dbfc5c4ad3ffb536c53c8ad99671b468925adf6574320595e53e218ea8650
+oid sha256:8b99b225cf3f84aecae377ca5f322b640f97b1ee5917629fe270d104c302d19a
 size 1000

training_state-dalle3.json

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:95071e7bcebf7154c2a754f4c735244af9d4c6773df5d75bebd723b9089f118f
-size 15062807
+oid sha256:6b045b9dc3b1f5526fb2627da6caeaf68abd7748454dbf7a40a2292f8fdbc937
+size 15113520

training_state-midjourney-v6-520k-raw.json

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ceddbf6554827b865081bc55e843e5114e6b3a03459c9a374dadc136ae90b54a
-size 2480314
+oid sha256:47a18d43cc7fccb3d9d5a97f2ad8016b2da4dc1150bc7ab1c3f750e68c64cae2
+size 2523562

training_state-nijijourney-v6-520k-raw.json

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9d650b4de06df4d35d7750feee71d155e898b2ae3e4be6aa3df49348740c306f
-size 2626858
+oid sha256:a03ea72d29304e6badc6ff32576b6be4da8d3287416046f924d2d1cada62eefc
+size 2670106

training_state.json

@@ -1 +1 @@
-{"global_step": 175000, "epoch_step": 175005, "epoch": 6, "exhausted_backends": ["signs", "guys", "nijijourney", "bookcovers", "celebrities", "normalnudes", "sports", "moviecollection", "gay", "experimental", "yoga", "cinemamix-1mp", "ethnic", "architecture", "shutterstock", "nsfw-1024"], "repeats": {"nijijourney": 0, "signs": 0, "guys": 0, "celebrities": 0, "bookcovers": 0, "normalnudes": 0, "moviecollection": 0, "sports": 0, "gay": 0, "experimental": 0, "yoga": 0, "ethnic": 0, "architecture": 0, "cinemamix-1mp": 0, "photo-aesthetics": 0, "anatomy": 0, "text-1mp": 1, "nsfw-1024": 0, "shutterstock": 0, "id-75k": 0, "bg20k-1024": 0, "mj-60": 0, "sfwbooru": 0, "midjourney-v6-520k-raw": 0, "nijijourney-v6-520k-raw": 0, "dalle3": 0}}
+{"global_step": 176000, "epoch_step": 176005, "epoch": 6, "exhausted_backends": ["signs", "guys", "nijijourney", "bookcovers", "celebrities", "normalnudes", "sports", "moviecollection", "gay", "experimental", "yoga", "cinemamix-1mp", "ethnic", "architecture", "shutterstock", "nsfw-1024", "photo-aesthetics"], "repeats": {"nijijourney": 0, "signs": 0, "guys": 0, "celebrities": 0, "bookcovers": 0, "normalnudes": 0, "moviecollection": 0, "sports": 0, "gay": 0, "experimental": 0, "yoga": 0, "ethnic": 0, "architecture": 0, "cinemamix-1mp": 0, "photo-aesthetics": 0, "anatomy": 0, "text-1mp": 2, "nsfw-1024": 0, "shutterstock": 0, "id-75k": 0, "bg20k-1024": 0, "mj-60": 0, "sfwbooru": 0, "midjourney-v6-520k-raw": 0, "nijijourney-v6-520k-raw": 0, "dalle3": 0}}

transformer/diffusion_pytorch_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f862773aa904b8191ed3f4841cd933454d8424be18a7222864f495791ddc4ccc
+oid sha256:7e42f9c9423df2215d21c1d127f8c7a3d80c8bbd27515b93c93eae87ec223edb
 size 1816969728