ossaili commited on
Commit
2651cc4
1 Parent(s): d4187f2

Model card auto-generated by SimpleTuner

Browse files
Files changed (1) hide show
  1. README.md +163 -0
README.md ADDED
@@ -0,0 +1,163 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ base_model: "black-forest-labs/FLUX.1-dev"
4
+ tags:
5
+ - flux
6
+ - flux-diffusers
7
+ - text-to-image
8
+ - diffusers
9
+ - simpletuner
10
+ - safe-for-work
11
+ - lora
12
+ - template:sd-lora
13
+ - lycoris
14
+ inference: true
15
+ widget:
16
+ - text: 'unconditional (blank prompt)'
17
+ parameters:
18
+ negative_prompt: 'blurry, cropped, ugly'
19
+ output:
20
+ url: ./assets/image_0_0.png
21
+ - text: 'This building in Saudi Arabia is a fine example of traditional desert architecture, characterized by its use of locally available materials such as sun-dried mud bricks and plaster, which provide natural insulation against the harsh climate. The tower, likely a watchtower or a minaret, showcases simple yet functional design, with narrow windows for ventilation and strategic visibility. The walls are robust and thick, demonstrating an emphasis on defense and durability. The flat roofs and crenelated parapets suggest the original grandeur and practical purposes of the structure, providing protection and elevated viewpoints. The craftsmanship reflects a deep understanding of the environmental demands, effectively merging form with function.'
22
+ parameters:
23
+ negative_prompt: 'blurry, cropped, ugly'
24
+ output:
25
+ url: ./assets/image_1_0.png
26
+ ---
27
+
28
+ # saudi-vernacular-flux-lora-v2
29
+
30
+ This is a LyCORIS adapter derived from [black-forest-labs/FLUX.1-dev](https://huggingface.co/black-forest-labs/FLUX.1-dev).
31
+
32
+
33
+ The main validation prompt used during training was:
34
+
35
+
36
+
37
+ ```
38
+ This building in Saudi Arabia is a fine example of traditional desert architecture, characterized by its use of locally available materials such as sun-dried mud bricks and plaster, which provide natural insulation against the harsh climate. The tower, likely a watchtower or a minaret, showcases simple yet functional design, with narrow windows for ventilation and strategic visibility. The walls are robust and thick, demonstrating an emphasis on defense and durability. The flat roofs and crenelated parapets suggest the original grandeur and practical purposes of the structure, providing protection and elevated viewpoints. The craftsmanship reflects a deep understanding of the environmental demands, effectively merging form with function.
39
+ ```
40
+
41
+ ## Validation settings
42
+ - CFG: `3.0`
43
+ - CFG Rescale: `0.0`
44
+ - Steps: `20`
45
+ - Sampler: `None`
46
+ - Seed: `42`
47
+ - Resolution: `1024x1024`
48
+
49
+ Note: The validation settings are not necessarily the same as the [training settings](#training-settings).
50
+
51
+ You can find some example images in the following gallery:
52
+
53
+
54
+ <Gallery />
55
+
56
+ The text encoder **was not** trained.
57
+ You may reuse the base model text encoder for inference.
58
+
59
+
60
+ ## Training settings
61
+
62
+ - Training epochs: 4
63
+ - Training steps: 5000
64
+ - Learning rate: 0.0001
65
+ - Effective batch size: 1
66
+ - Micro-batch size: 1
67
+ - Gradient accumulation steps: 1
68
+ - Number of GPUs: 1
69
+ - Prediction type: flow-matching
70
+ - Rescaled betas zero SNR: False
71
+ - Optimizer: adamw_bf16
72
+ - Precision: Pure BF16
73
+ - Quantised: No
74
+ - Xformers: Not used
75
+ - LyCORIS Config:
76
+ ```json
77
+ {
78
+ "algo": "lokr",
79
+ "multiplier": 1,
80
+ "linear_dim": 15000,
81
+ "linear_alpha": 1.25,
82
+ "factor": 4,
83
+ "apply_preset": {
84
+ "target_module": [
85
+ "Attention",
86
+ "FeedForward"
87
+ ],
88
+ "module_algo_map": {
89
+ "Attention": {
90
+ "factor": 4
91
+ },
92
+ "FeedForward": {
93
+ "factor": 4
94
+ }
95
+ }
96
+ }
97
+ }
98
+ ```
99
+
100
+ ## Datasets
101
+
102
+ ### my-dataset-512
103
+ - Repeats: 1
104
+ - Total number of images: 149
105
+ - Total number of aspect buckets: 2
106
+ - Resolution: 0.262144 megapixels
107
+ - Cropped: False
108
+ - Crop style: None
109
+ - Crop aspect: None
110
+ ### my-dataset-1024
111
+ - Repeats: 1
112
+ - Total number of images: 149
113
+ - Total number of aspect buckets: 2
114
+ - Resolution: 1.048576 megapixels
115
+ - Cropped: False
116
+ - Crop style: None
117
+ - Crop aspect: None
118
+ ### my-dataset-512-crop
119
+ - Repeats: 1
120
+ - Total number of images: 149
121
+ - Total number of aspect buckets: 1
122
+ - Resolution: 0.262144 megapixels
123
+ - Cropped: True
124
+ - Crop style: random
125
+ - Crop aspect: square
126
+ ### my-dataset-1024-crop
127
+ - Repeats: 1
128
+ - Total number of images: 149
129
+ - Total number of aspect buckets: 1
130
+ - Resolution: 1.048576 megapixels
131
+ - Cropped: True
132
+ - Crop style: random
133
+ - Crop aspect: square
134
+
135
+
136
+ ## Inference
137
+
138
+
139
+ ```python
140
+ import torch
141
+ from diffusers import DiffusionPipeline
142
+ from lycoris import create_lycoris_from_weights
143
+
144
+ model_id = 'black-forest-labs/FLUX.1-dev'
145
+ adapter_id = 'pytorch_lora_weights.safetensors' # you will have to download this manually
146
+ lora_scale = 1.0
147
+ wrapper, _ = create_lycoris_from_weights(lora_scale, adapter_id, pipeline.transformer)
148
+ wrapper.merge_to()
149
+
150
+ prompt = "This building in Saudi Arabia is a fine example of traditional desert architecture, characterized by its use of locally available materials such as sun-dried mud bricks and plaster, which provide natural insulation against the harsh climate. The tower, likely a watchtower or a minaret, showcases simple yet functional design, with narrow windows for ventilation and strategic visibility. The walls are robust and thick, demonstrating an emphasis on defense and durability. The flat roofs and crenelated parapets suggest the original grandeur and practical purposes of the structure, providing protection and elevated viewpoints. The craftsmanship reflects a deep understanding of the environmental demands, effectively merging form with function."
151
+
152
+ pipeline.to('cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu')
153
+ image = pipeline(
154
+ prompt=prompt,
155
+ num_inference_steps=20,
156
+ generator=torch.Generator(device='cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu').manual_seed(1641421826),
157
+ width=1024,
158
+ height=1024,
159
+ guidance_scale=3.0,
160
+ ).images[0]
161
+ image.save("output.png", format="PNG")
162
+ ```
163
+