--- license: creativeml-openrail-m base_model: "ptx0/pixart-900m-1024-ft-v0.7-stage1" tags: - stable-diffusion - stable-diffusion-diffusers - text-to-image - diffusers - simpletuner - full inference: true --- # pixart-900m-1024-ft-v0.7-stage1 This is a full rank finetune derived from [ptx0/pixart-900m-1024-ft-v0.7-stage1](https://huggingface.co/ptx0/pixart-900m-1024-ft-v0.7-stage1). The main validation prompt used during training was: ``` a cute anime character named toast, holding a sign that reads SOON ``` ## Validation settings - CFG: `4.0` - CFG Rescale: `0.7` - Steps: `30` - Sampler: `None` - Seed: `420420420` - Resolution: `1024x1024` Note: The validation settings are not necessarily the same as the [training settings](#training-settings). The text encoder **was not** trained. You may reuse the base model text encoder for inference. ## Training settings - Training epochs: 0 - Training steps: 500 - Learning rate: 1e-06 - Effective batch size: 32 - Micro-batch size: 4 - Gradient accumulation steps: 1 - Number of GPUs: 8 - Prediction type: epsilon - Rescaled betas zero SNR: False - Optimizer: AdamW, stochastic bf16 - Precision: Pure BF16 - Xformers: Enabled ## Datasets ### sports - Repeats: 0 - Total number of images: ~768 - Total number of aspect buckets: 3 - Resolution: 1.0 megapixels - Cropped: True - Crop style: random - Crop aspect: random ### mj-60 - Repeats: 0 - Total number of images: ~179136 - Total number of aspect buckets: 1 - Resolution: 1.0 megapixels - Cropped: True - Crop style: random - Crop aspect: random ### id-75k - Repeats: 0 - Total number of images: ~36128 - Total number of aspect buckets: 1 - Resolution: 1.0 megapixels - Cropped: False - Crop style: None - Crop aspect: None ### celebrities - Repeats: 0 - Total number of images: ~1152 - Total number of aspect buckets: 1 - Resolution: 1.0 megapixels - Cropped: True - Crop style: random - Crop aspect: random ### normalnudes - Repeats: 0 - Total number of images: ~1088 - Total number of aspect buckets: 3 - Resolution: 1.0 megapixels - Cropped: True - Crop style: random - Crop aspect: random ### guys - Repeats: 0 - Total number of images: ~320 - Total number of aspect buckets: 3 - Resolution: 1.0 megapixels - Cropped: True - Crop style: random - Crop aspect: random ### pixel-art - Repeats: 0 - Total number of images: ~992 - Total number of aspect buckets: 1 - Resolution: 1.0 megapixels - Cropped: True - Crop style: random - Crop aspect: random ### signs - Repeats: 0 - Total number of images: ~352 - Total number of aspect buckets: 3 - Resolution: 1.0 megapixels - Cropped: True - Crop style: random - Crop aspect: random ### dalle3 - Repeats: 0 - Total number of images: ~1126112 - Total number of aspect buckets: 38 - Resolution: 1.0 megapixels - Cropped: False - Crop style: None - Crop aspect: None ### sfwbooru - Repeats: 0 - Total number of images: ~491808 - Total number of aspect buckets: 74 - Resolution: 1.0 megapixels - Cropped: False - Crop style: None - Crop aspect: None ### moviecollection - Repeats: 0 - Total number of images: ~1824 - Total number of aspect buckets: 3 - Resolution: 1.0 megapixels - Cropped: True - Crop style: random - Crop aspect: random ### bookcovers - Repeats: 0 - Total number of images: ~768 - Total number of aspect buckets: 2 - Resolution: 1.0 megapixels - Cropped: True - Crop style: random - Crop aspect: random ### nijijourney - Repeats: 0 - Total number of images: ~512 - Total number of aspect buckets: 3 - Resolution: 1.0 megapixels - Cropped: True - Crop style: random - Crop aspect: random ### experimental - Repeats: 0 - Total number of images: ~2976 - Total number of aspect buckets: 3 - Resolution: 1.0 megapixels - Cropped: True - Crop style: random - Crop aspect: random ### ethnic - Repeats: 0 - Total number of images: ~3040 - Total number of aspect buckets: 3 - Resolution: 1.0 megapixels - Cropped: True - Crop style: random - Crop aspect: random ### gay - Repeats: 0 - Total number of images: ~1056 - Total number of aspect buckets: 3 - Resolution: 1.0 megapixels - Cropped: True - Crop style: random - Crop aspect: random ### architecture - Repeats: 0 - Total number of images: ~4320 - Total number of aspect buckets: 3 - Resolution: 1.0 megapixels - Cropped: True - Crop style: random - Crop aspect: random ### shutterstock - Repeats: 0 - Total number of images: ~21024 - Total number of aspect buckets: 3 - Resolution: 1.0 megapixels - Cropped: True - Crop style: random - Crop aspect: random ### midjourney-v6-520k-raw - Repeats: 0 - Total number of images: ~390976 - Total number of aspect buckets: 1 - Resolution: 1.0 megapixels - Cropped: True - Crop style: random - Crop aspect: square ### nijijourney-v6-520k-raw - Repeats: 0 - Total number of images: ~416064 - Total number of aspect buckets: 1 - Resolution: 1.0 megapixels - Cropped: True - Crop style: random - Crop aspect: square ### cinemamix-1mp - Repeats: 0 - Total number of images: ~7360 - Total number of aspect buckets: 3 - Resolution: 1.0 megapixels - Cropped: True - Crop style: random - Crop aspect: random ### nsfw-1024 - Repeats: 0 - Total number of images: ~10752 - Total number of aspect buckets: 3 - Resolution: 1.0 megapixels - Cropped: True - Crop style: random - Crop aspect: random ### anatomy - Repeats: 5 - Total number of images: ~16384 - Total number of aspect buckets: 3 - Resolution: 1.0 megapixels - Cropped: True - Crop style: random - Crop aspect: random ### bg20k-1024 - Repeats: 0 - Total number of images: ~89280 - Total number of aspect buckets: 3 - Resolution: 1.0 megapixels - Cropped: True - Crop style: random - Crop aspect: random ### yoga - Repeats: 0 - Total number of images: ~3584 - Total number of aspect buckets: 3 - Resolution: 1.0 megapixels - Cropped: True - Crop style: random - Crop aspect: random ### photo-aesthetics - Repeats: 0 - Total number of images: ~33088 - Total number of aspect buckets: 3 - Resolution: 1.0 megapixels - Cropped: True - Crop style: random - Crop aspect: random ### text-1mp - Repeats: 5 - Total number of images: ~13152 - Total number of aspect buckets: 3 - Resolution: 1.0 megapixels - Cropped: True - Crop style: random - Crop aspect: random ## Inference ```python import torch from diffusers import DiffusionPipeline model_id = 'pixart-900m-1024-ft-v0.7-stage1' pipeline = DiffusionPipeline.from_pretrained(model_id) prompt = "a cute anime character named toast, holding a sign that reads SOON" negative_prompt = "blurry, cropped, ugly" pipeline.to('cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu') image = pipeline( prompt=prompt, negative_prompt='blurry, cropped, ugly', num_inference_steps=30, generator=torch.Generator(device='cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu').manual_seed(1641421826), width=1152, height=768, guidance_scale=4.0, guidance_rescale=0.7, ).images[0] image.save("output.png", format="PNG") ```