Trained for 0 epochs and 1000 steps.

Trained with datasets ['text-embeds-pixart-filter', 'photo-concept-bucket', 'midjourney-v6-520k-raw', 'sfwbooru', 'nijijourney-v6-520k-raw', 'dalle3']
Learning rate 1e-06, batch size 24, and 1 gradient accumulation steps.
Used DDPM noise scheduler for training with epsilon prediction type and rescaled_betas_zero_snr=False
Using 'trailing' timestep spacing.
Base model: terminusresearch/pixart-900m-1024-ft-v0.6
VAE: madebyollin/sdxl-vae-fp16-fix

README.md

@@ -0,0 +1,133 @@
+---
+license: creativeml-openrail-m
+base_model: "terminusresearch/pixart-900m-1024-ft-v0.6"
+tags:
+ - stable-diffusion
+ - stable-diffusion-diffusers
+ - text-to-image
+ - diffusers
+ - simpletuner
+ - full
+
+inference: true
+
+---
+
+# pixart-900m-1024-vpred-zsnr
+
+This is a full rank finetune derived from [terminusresearch/pixart-900m-1024-ft-v0.6](https://huggingface.co/terminusresearch/pixart-900m-1024-ft-v0.6).
+
+
+
+The main validation prompt used during training was:
+
+```
+ethnographic photography of teddy bear at a picnic, ears tucked behind a cozy hoodie looking darkly off to the stormy picnic skies
+```
+
+## Validation settings
+- CFG: `7.5`
+- CFG Rescale: `0.7`
+- Steps: `25`
+- Sampler: `None`
+- Seed: `42`
+- Resolutions: `1024x1024,1344x768,916x1152`
+
+Note: The validation settings are not necessarily the same as the [training settings](#training-settings).
+
+
+
+
+<Gallery />
+
+The text encoder **was not** trained.
+You may reuse the base model text encoder for inference.
+
+
+## Training settings
+
+- Training epochs: 0
+- Training steps: 1000
+- Learning rate: 1e-06
+- Effective batch size: 192
+ - Micro-batch size: 24
+ - Gradient accumulation steps: 1
+ - Number of GPUs: 8
+- Prediction type: epsilon
+- Rescaled betas zero SNR: False
+- Optimizer: AdamW, stochastic bf16
+- Precision: Pure BF16
+- Xformers: Not used
+
+
+## Datasets
+
+### photo-concept-bucket
+- Repeats: 0
+- Total number of images: ~567552
+- Total number of aspect buckets: 1
+- Resolution: 1.0 megapixels
+- Cropped: True
+- Crop style: random
+- Crop aspect: square
+### midjourney-v6-520k-raw
+- Repeats: 0
+- Total number of images: ~390912
+- Total number of aspect buckets: 1
+- Resolution: 1.0 megapixels
+- Cropped: True
+- Crop style: random
+- Crop aspect: square
+### sfwbooru
+- Repeats: 0
+- Total number of images: ~233664
+- Total number of aspect buckets: 1
+- Resolution: 1.0 megapixels
+- Cropped: True
+- Crop style: random
+- Crop aspect: square
+### nijijourney-v6-520k-raw
+- Repeats: 0
+- Total number of images: ~415680
+- Total number of aspect buckets: 1
+- Resolution: 1.0 megapixels
+- Cropped: True
+- Crop style: random
+- Crop aspect: square
+### dalle3
+- Repeats: 0
+- Total number of images: ~1121664
+- Total number of aspect buckets: 1
+- Resolution: 1.0 megapixels
+- Cropped: True
+- Crop style: random
+- Crop aspect: square
+
+
+## Inference
+
+
+```python
+import torch
+from diffusers import DiffusionPipeline
+
+model_id = 'pixart-900m-1024-vpred-zsnr'
+pipeline = DiffusionPipeline.from_pretrained(model_id)
+
+prompt = "ethnographic photography of teddy bear at a picnic, ears tucked behind a cozy hoodie looking darkly off to the stormy picnic skies"
+negative_prompt = "blurry, cropped, ugly"
+
+pipeline.to('cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu')
+image = pipeline(
+ prompt=prompt,
+ negative_prompt='blurry, cropped, ugly',
+ num_inference_steps=25,
+ generator=torch.Generator(device='cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu').manual_seed(1641421826),
+ width=1152,
+ height=768,
+ guidance_scale=7.5,
+ guidance_rescale=0.7,
+).images[0]
+image.save("output.png", format="PNG")
+```
+

optimizer.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4f9f9a3a3f5451c22635b16e8cc7a837edd9ec41c43c63d460e8bb889a7a3472
+size 5451415117

random_states_0.pkl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8f0edfc2c885f730ef911db10373dce0a3e814e4fdbb2de759c691606ecf21e3
+size 16100

scheduler.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:efff19450f55a9358b76f3e5170171942761d1c5b9128683028d0c09b8a24573
+size 1000

training_state.json

@@ -0,0 +1 @@
+{"global_step": 1000, "epoch_step": 1000, "epoch": 1, "exhausted_backends": [], "repeats": {}}

transformer/config.json

@@ -0,0 +1,30 @@
+{
+ "_class_name": "PixArtTransformer2DModel",
+ "_diffusers_version": "0.30.0.dev0",
+ "_name_or_path": "terminusresearch/pixart-900m-1024-ft-v0.6",
+ "activation_fn": "gelu-approximate",
+ "attention_bias": true,
+ "attention_head_dim": 72,
+ "attention_type": "default",
+ "caption_channels": 4096,
+ "cross_attention_dim": 1152,
+ "double_self_attention": false,
+ "dropout": 0.0,
+ "in_channels": 4,
+ "interpolation_scale": 2,
+ "norm_elementwise_affine": false,
+ "norm_eps": 1e-06,
+ "norm_num_groups": 32,
+ "norm_type": "ada_norm_single",
+ "num_attention_heads": 16,
+ "num_embeds_ada_norm": 1000,
+ "num_layers": 42,
+ "num_vector_embeds": null,
+ "only_cross_attention": false,
+ "out_channels": 8,
+ "patch_size": 2,
+ "sample_size": 128,
+ "upcast_attention": false,
+ "use_additional_conditions": false,
+ "use_linear_projection": false
+}

transformer/diffusion_pytorch_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5d877393a75fcacd20413a5c27afdd5bfce4ac8f15411d9236ef4ed7ced00081
+size 1816969728