Model card auto-generated by SimpleTuner

README.md

@@ -10,99 +10,104 @@ tags:
   - not-for-all-audiences
   - lora
   - template:sd-lora
-  - standard
+  - lycoris
 inference: true
 widget:
-- text: 'a picture of tommy chong'
+- text: 'unconditional (blank prompt)'
   parameters:
     negative_prompt: 'blurry, cropped, ugly'
   output:
     url: ./assets/image_0_0.png
-- text: 'young tommy chong'
+- text: 'a picture of tommy chong'
   parameters:
     negative_prompt: 'blurry, cropped, ugly'
   output:
     url: ./assets/image_1_0.png
-- text: 'a stoic photograph of tommy chong. he looks off into the distance, standing up against the railing of a ship. the sky is cloudy.'
+- text: 'young tommy chong'
   parameters:
     negative_prompt: 'blurry, cropped, ugly'
   output:
     url: ./assets/image_2_0.png
-- text: 'an elderly tommy chong as a contestant on Wheel of Fortune'
+- text: 'a stoic photograph of tommy chong. he looks off into the distance, standing up against the railing of a ship. the sky is cloudy.'
   parameters:
     negative_prompt: 'blurry, cropped, ugly'
   output:
     url: ./assets/image_3_0.png
-- text: 'tommy chong as a superhero in the style of studio ghibli. he wears a metal armor suit with glowing lights and power indicators.'
+- text: 'an elderly tommy chong as a contestant on Wheel of Fortune'
   parameters:
     negative_prompt: 'blurry, cropped, ugly'
   output:
     url: ./assets/image_4_0.png
-- text: 'tommy chong in a casket, dead. he is dead and it is a funeral. the text overhead says ''HE HAS NOT RISEN''.'
+- text: 'tommy chong as a superhero in the style of studio ghibli. he wears a metal armor suit with glowing lights and power indicators.'
   parameters:
     negative_prompt: 'blurry, cropped, ugly'
   output:
     url: ./assets/image_5_0.png
-- text: 'a picture of cheech marin'
+- text: 'tommy chong in a casket, dead. he is dead and it is a funeral. the text overhead says ''HE HAS NOT RISEN''.'
   parameters:
     negative_prompt: 'blurry, cropped, ugly'
   output:
     url: ./assets/image_6_0.png
-- text: 'young cheech marin'
+- text: 'a picture of cheech marin'
   parameters:
     negative_prompt: 'blurry, cropped, ugly'
   output:
     url: ./assets/image_7_0.png
-- text: 'a stoic photograph of cheech marin. he looks off into the distance, standing up against the railing of a ship. the sky is cloudy.'
+- text: 'young cheech marin'
   parameters:
     negative_prompt: 'blurry, cropped, ugly'
   output:
     url: ./assets/image_8_0.png
-- text: 'an elderly cheech marin as a contestant on Wheel of Fortune'
+- text: 'a stoic photograph of cheech marin. he looks off into the distance, standing up against the railing of a ship. the sky is cloudy.'
   parameters:
     negative_prompt: 'blurry, cropped, ugly'
   output:
     url: ./assets/image_9_0.png
-- text: 'cheech marin as a superhero in the style of studio ghibli. he wears a metal armor suit with glowing lights and power indicators.'
+- text: 'an elderly cheech marin as a contestant on Wheel of Fortune'
   parameters:
     negative_prompt: 'blurry, cropped, ugly'
   output:
     url: ./assets/image_10_0.png
-- text: 'cheech marin in a casket, dead. he is dead and it is a funeral. the text overhead says ''HE HAS NOT RISEN''.'
+- text: 'cheech marin as a superhero in the style of studio ghibli. he wears a metal armor suit with glowing lights and power indicators.'
   parameters:
     negative_prompt: 'blurry, cropped, ugly'
   output:
     url: ./assets/image_11_0.png
-- text: 'cheech marin sitting to the left of tommy chong on the set of a television interview'
+- text: 'cheech marin in a casket, dead. he is dead and it is a funeral. the text overhead says ''HE HAS NOT RISEN''.'
   parameters:
     negative_prompt: 'blurry, cropped, ugly'
   output:
     url: ./assets/image_12_0.png
-- text: 'cheech marin sitting to the right of tommy chong on the set of a television interview'
+- text: 'cheech marin sitting to the left of tommy chong on the set of a television interview'
   parameters:
     negative_prompt: 'blurry, cropped, ugly'
   output:
     url: ./assets/image_13_0.png
-- text: 'cheech and chong sitting together on the stoop of a new york apartment building, 1972'
+- text: 'cheech marin sitting to the right of tommy chong on the set of a television interview'
   parameters:
     negative_prompt: 'blurry, cropped, ugly'
   output:
     url: ./assets/image_14_0.png
-- text: 'the iconic duo cheech and chong on stage performing stand-up comedy together in 2008'
+- text: 'cheech and chong sitting together on the stoop of a new york apartment building, 1972'
   parameters:
     negative_prompt: 'blurry, cropped, ugly'
   output:
     url: ./assets/image_15_0.png
-- text: 'A photo-realistic image of a cat'
+- text: 'the iconic duo cheech and chong on stage performing stand-up comedy together in 2008'
   parameters:
     negative_prompt: 'blurry, cropped, ugly'
   output:
     url: ./assets/image_16_0.png
+- text: 'A photo-realistic image of a cat'
+  parameters:
+    negative_prompt: 'blurry, cropped, ugly'
+  output:
+    url: ./assets/image_17_0.png
 ---
 
 # sd3-cheechandchong-regularised
 
-This is a standard PEFT LoRA derived from [stabilityai/stable-diffusion-3.5-large](https://huggingface.co/stabilityai/stable-diffusion-3.5-large).
+This is a LyCORIS adapter derived from [stabilityai/stable-diffusion-3.5-large](https://huggingface.co/stabilityai/stable-diffusion-3.5-large).
 
 
 The main validation prompt used during training was:
@@ -136,7 +141,7 @@ You may reuse the base model text encoder for inference.
 
 - Training epochs: 0
 - Training steps: 100
-- Learning rate: 0.0001
+- Learning rate: 0.0004
 - Max grad norm: 0.01
 - Effective batch size: 12
   - Micro-batch size: 4
@@ -148,14 +153,52 @@ You may reuse the base model text encoder for inference.
 - Precision: Pure BF16
 - Quantised: Yes: int8-quanto
 - Xformers: Not used
-- LoRA Rank: 16
-- LoRA Alpha: 16.0
-- LoRA Dropout: 0.1
-- LoRA initialisation style: default
-    
+- LyCORIS Config:
+```json
+{
+    "bypass_mode": true,
+    "algo": "lokr",
+    "multiplier": 1.0,
+    "linear_dim": 10000,
+    "linear_alpha": 1,
+    "factor": 12,
+    "apply_preset": {
+        "target_module": [
+            "Attention",
+            "FeedForward"
+        ],
+        "module_algo_map": {
+            "Attention": {
+                "factor": 12
+            },
+            "FeedForward": {
+                "factor": 6
+            }
+        }
+    }
+}
+```
 
 ## Datasets
 
+### reg-512
+- Repeats: 0
+- Total number of images: ~288
+- Total number of aspect buckets: 3
+- Resolution: 0.262144 megapixels
+- Cropped: False
+- Crop style: None
+- Crop aspect: None
+- Used for regularisation data: Yes
+### reg-1024
+- Repeats: 0
+- Total number of images: ~291
+- Total number of aspect buckets: 9
+- Resolution: 1.048576 megapixels
+- Cropped: False
+- Crop style: None
+- Crop aspect: None
+- Used for regularisation data: Yes
 ### cheechandchong-uncropped-512
 - Repeats: 10
 - Total number of images: ~24
@@ -200,11 +243,13 @@ You may reuse the base model text encoder for inference.
 ```python
 import torch
 from diffusers import DiffusionPipeline
+from lycoris import create_lycoris_from_weights
 
 model_id = 'stabilityai/stable-diffusion-3.5-large'
-adapter_id = 'bghira/sd3-cheechandchong-regularised'
-pipeline = DiffusionPipeline.from_pretrained(model_id)
-pipeline.load_lora_weights(adapter_id)
+adapter_id = 'pytorch_lora_weights.safetensors' # you will have to download this manually
+lora_scale = 1.0
+wrapper, _ = create_lycoris_from_weights(lora_scale, adapter_id, pipeline.transformer)
+wrapper.merge_to()
 
 prompt = "A photo-realistic image of a cat"
 negative_prompt = 'blurry, cropped, ugly'