bghira commited on
Commit
5a2ce90
1 Parent(s): dac2fea

Model card auto-generated by SimpleTuner

Browse files
Files changed (1) hide show
  1. README.md +116 -37
README.md CHANGED
@@ -10,7 +10,7 @@ tags:
10
  - not-for-all-audiences
11
  - lora
12
  - template:sd-lora
13
- - lycoris
14
  inference: true
15
  widget:
16
  - text: 'unconditional (blank prompt)'
@@ -18,16 +18,116 @@ widget:
18
  negative_prompt: 'blurry, cropped, ugly'
19
  output:
20
  url: ./assets/image_0_0.png
21
- - text: 'A photo-realistic image of a cat'
22
  parameters:
23
  negative_prompt: 'blurry, cropped, ugly'
24
  output:
25
  url: ./assets/image_1_0.png
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
26
  ---
27
 
28
  # flux-beavisandbutthead-mgpu
29
 
30
- This is a LyCORIS adapter derived from [black-forest-labs/FLUX.1-dev](https://huggingface.co/black-forest-labs/FLUX.1-dev).
31
 
32
 
33
  The main validation prompt used during training was:
@@ -59,43 +159,24 @@ You may reuse the base model text encoder for inference.
59
 
60
  ## Training settings
61
 
62
- - Training epochs: 483
63
- - Training steps: 1500
64
  - Learning rate: 0.0002
65
- - Effective batch size: 64
66
- - Micro-batch size: 8
67
  - Gradient accumulation steps: 1
68
  - Number of GPUs: 8
69
  - Prediction type: flow-matching
70
  - Rescaled betas zero SNR: False
71
- - Optimizer: bnb-adamw8bit
72
  - Precision: Pure BF16
73
  - Quantised: Yes: fp8-torchao
74
  - Xformers: Not used
75
- - LyCORIS Config:
76
- ```json
77
- {
78
- "algo": "lokr",
79
- "multiplier": 1.0,
80
- "linear_dim": 10000,
81
- "linear_alpha": 1,
82
- "factor": 16,
83
- "apply_preset": {
84
- "target_module": [
85
- "Attention",
86
- "FeedForward"
87
- ],
88
- "module_algo_map": {
89
- "Attention": {
90
- "factor": 16
91
- },
92
- "FeedForward": {
93
- "factor": 8
94
- }
95
- }
96
- }
97
- }
98
- ```
99
 
100
  ## Datasets
101
 
@@ -115,13 +196,11 @@ You may reuse the base model text encoder for inference.
115
  ```python
116
  import torch
117
  from diffusers import DiffusionPipeline
118
- from lycoris import create_lycoris_from_weights
119
 
120
  model_id = 'black-forest-labs/FLUX.1-dev'
121
- adapter_id = 'pytorch_lora_weights.safetensors' # you will have to download this manually
122
- lora_scale = 1.0
123
- wrapper, _ = create_lycoris_from_weights(lora_scale, adapter_id, pipeline.transformer)
124
- wrapper.merge_to()
125
 
126
  prompt = "A photo-realistic image of a cat"
127
 
 
10
  - not-for-all-audiences
11
  - lora
12
  - template:sd-lora
13
+ - standard
14
  inference: true
15
  widget:
16
  - text: 'unconditional (blank prompt)'
 
18
  negative_prompt: 'blurry, cropped, ugly'
19
  output:
20
  url: ./assets/image_0_0.png
21
+ - text: 'Detailed Man Portrait'
22
  parameters:
23
  negative_prompt: 'blurry, cropped, ugly'
24
  output:
25
  url: ./assets/image_1_0.png
26
+ - text: 'A highly detailed portrait of a man resembling Beavis, with spiky blonde hair and a Metallica t-shirt, smirking expression, photorealistic, 8k resolution, dramatic lighting, oil painting style'
27
+ parameters:
28
+ negative_prompt: 'blurry, cropped, ugly'
29
+ output:
30
+ url: ./assets/image_2_0.png
31
+ - text: 'Elegant Woman Portrait'
32
+ parameters:
33
+ negative_prompt: 'blurry, cropped, ugly'
34
+ output:
35
+ url: ./assets/image_3_0.png
36
+ - text: 'A refined portrait of a woman in the Beavis and Butt-head universe, wearing stylish 90s attire, confident gaze, soft lighting, high resolution, intricate details, classic portrait style'
37
+ parameters:
38
+ negative_prompt: 'blurry, cropped, ugly'
39
+ output:
40
+ url: ./assets/image_4_0.png
41
+ - text: 'Beavis Character Study'
42
+ parameters:
43
+ negative_prompt: 'blurry, cropped, ugly'
44
+ output:
45
+ url: ./assets/image_5_0.png
46
+ - text: 'An in-depth depiction of Beavis, sitting on a couch with a remote control, mischievous grin, detailed background featuring their cluttered living room, ultra-realistic, 4k resolution'
47
+ parameters:
48
+ negative_prompt: 'blurry, cropped, ugly'
49
+ output:
50
+ url: ./assets/image_6_0.png
51
+ - text: 'Butt-head Character Study'
52
+ parameters:
53
+ negative_prompt: 'blurry, cropped, ugly'
54
+ output:
55
+ url: ./assets/image_7_0.png
56
+ - text: 'A comprehensive illustration of Butt-head, standing with arms crossed, wearing an AC/DC t-shirt, indifferent expression, high detail, photorealistic, 8k resolution, natural lighting'
57
+ parameters:
58
+ negative_prompt: 'blurry, cropped, ugly'
59
+ output:
60
+ url: ./assets/image_8_0.png
61
+ - text: 'Beavis and Butt-head Duo'
62
+ parameters:
63
+ negative_prompt: 'blurry, cropped, ugly'
64
+ output:
65
+ url: ./assets/image_9_0.png
66
+ - text: 'Beavis and Butt-head sitting together on their iconic couch, laughing hysterically'
67
+ parameters:
68
+ negative_prompt: 'blurry, cropped, ugly'
69
+ output:
70
+ url: ./assets/image_10_0.png
71
+ - text: 'Beavis and Butt-head Adventure'
72
+ parameters:
73
+ negative_prompt: 'blurry, cropped, ugly'
74
+ output:
75
+ url: ./assets/image_11_0.png
76
+ - text: 'An intricate scene of Beavis and Butt-head exploring a theme park at night, bright lights, roller coasters in the background, laughing and eating nachos, highly detailed, cinematic lighting, 8k resolution'
77
+ parameters:
78
+ negative_prompt: 'blurry, cropped, ugly'
79
+ output:
80
+ url: ./assets/image_12_0.png
81
+ - text: 'Daria Morgendorffer Portrait'
82
+ parameters:
83
+ negative_prompt: 'blurry, cropped, ugly'
84
+ output:
85
+ url: ./assets/image_13_0.png
86
+ - text: 'A detailed portrait of Daria, standing with a book in hand, wearing her signature glasses and monotone expression, high resolution, minimalist background, artistic style'
87
+ parameters:
88
+ negative_prompt: 'blurry, cropped, ugly'
89
+ output:
90
+ url: ./assets/image_14_0.png
91
+ - text: 'Beavis as The Great Cornholio'
92
+ parameters:
93
+ negative_prompt: 'blurry, cropped, ugly'
94
+ output:
95
+ url: ./assets/image_15_0.png
96
+ - text: 'Beavis transformed into The Great Cornholio, shirt pulled over his head, wild eyes, chaotic classroom setting, high detail, dynamic lighting, 4k resolution'
97
+ parameters:
98
+ negative_prompt: 'blurry, cropped, ugly'
99
+ output:
100
+ url: ./assets/image_16_0.png
101
+ - text: 'Beavis and Butt-head Concert'
102
+ parameters:
103
+ negative_prompt: 'blurry, cropped, ugly'
104
+ output:
105
+ url: ./assets/image_17_0.png
106
+ - text: 'Beavis and Butt-head attending a heavy metal concert, headbanging in the crowd, vibrant stage lights, energetic atmosphere, high-definition'
107
+ parameters:
108
+ negative_prompt: 'blurry, cropped, ugly'
109
+ output:
110
+ url: ./assets/image_18_0.png
111
+ - text: 'Retro Beavis and Butt-head Poster'
112
+ parameters:
113
+ negative_prompt: 'blurry, cropped, ugly'
114
+ output:
115
+ url: ./assets/image_19_0.png
116
+ - text: 'A retro-style poster featuring Beavis and Butt-head in a comedic pose, bold 90s colors, vintage fonts, high detail, artistic illustration, nostalgic aesthetic'
117
+ parameters:
118
+ negative_prompt: 'blurry, cropped, ugly'
119
+ output:
120
+ url: ./assets/image_20_0.png
121
+ - text: 'A photo-realistic image of a cat'
122
+ parameters:
123
+ negative_prompt: 'blurry, cropped, ugly'
124
+ output:
125
+ url: ./assets/image_21_0.png
126
  ---
127
 
128
  # flux-beavisandbutthead-mgpu
129
 
130
+ This is a standard PEFT LoRA derived from [black-forest-labs/FLUX.1-dev](https://huggingface.co/black-forest-labs/FLUX.1-dev).
131
 
132
 
133
  The main validation prompt used during training was:
 
159
 
160
  ## Training settings
161
 
162
+ - Training epochs: 4
163
+ - Training steps: 100
164
  - Learning rate: 0.0002
165
+ - Effective batch size: 8
166
+ - Micro-batch size: 1
167
  - Gradient accumulation steps: 1
168
  - Number of GPUs: 8
169
  - Prediction type: flow-matching
170
  - Rescaled betas zero SNR: False
171
+ - Optimizer: bnb-lion8bit
172
  - Precision: Pure BF16
173
  - Quantised: Yes: fp8-torchao
174
  - Xformers: Not used
175
+ - LoRA Rank: 16
176
+ - LoRA Alpha: 16.0
177
+ - LoRA Dropout: 0.1
178
+ - LoRA initialisation style: default
179
+
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
180
 
181
  ## Datasets
182
 
 
196
  ```python
197
  import torch
198
  from diffusers import DiffusionPipeline
 
199
 
200
  model_id = 'black-forest-labs/FLUX.1-dev'
201
+ adapter_id = 'bghira/flux-beavisandbutthead-mgpu'
202
+ pipeline = DiffusionPipeline.from_pretrained(model_id)
203
+ pipeline.load_lora_weights(adapter_id)
 
204
 
205
  prompt = "A photo-realistic image of a cat"
206