AiAF
/

Text-to-Image
Diffusers
art
Not-For-All-Audiences
File size: 10,174 Bytes
11ed494
 
 
 
 
 
 
fe96d12
7b331e7
fe96d12
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
f362a73
58f66e6
 
e8c6ed1
 
 
 
 
adb7119
365738d
58f66e6
 
 
84a0dc5
d1dd97f
 
 
58f66e6
 
d1dd97f
 
58f66e6
 
 
 
 
d1dd97f
58f66e6
 
d1dd97f
58f66e6
d1dd97f
58f66e6
84a0dc5
58f66e6
84a0dc5
58f66e6
 
 
d1dd97f
58f66e6
 
 
 
 
d1dd97f
58f66e6
 
 
 
 
d1dd97f
58f66e6
 
 
d1dd97f
58f66e6
 
 
 
 
 
 
 
 
d1dd97f
58f66e6
d1dd97f
58f66e6
 
6d6db53
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
b58f6e9
6d6db53
 
58f66e6
 
b58f6e9
58f66e6
d1dd97f
58f66e6
 
 
d1dd97f
 
 
58f66e6
 
 
 
d1dd97f
58f66e6
 
 
d1dd97f
 
 
 
 
 
 
 
 
 
f8c5de9
fe96d12
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
---
license: cc0-1.0
datasets:
- AiAF/Lightsource-0Lightsource-OLS_PonyXL-LoRA_Dataset
pipeline_tag: text-to-image
tags:
- art
- not-for-all-audiences
widget:
- text: >-
    score_9, score_8_up, 1girl, Orochimaru \(lightsource\), tongue, tongue_out,
    heart, long_hair, black_hair, spoken_heart, eye slits,  huge breasts, silver
    earrings, purple skin, pale skin, yellow_eyes, solo, blush, rating:safe,
    looking_at_viewer, bare_shoulders, skirt, jewelry, collar, smile,
    open_mouth, :p, very_long_hair, teeth, white_background, black_dress,
    collarbone, silver ear_piercing, eyebrows_visible_through_hair, bangs,
    hair_between_eyes, miniskirt
  parameters:
    prompt: >-
      score_9, score_8_up, 1girl, Orochimaru \(lightsource\), tongue,
      tongue_out, heart, long_hair, black_hair, spoken_heart, eye slits,  huge
      breasts, silver earrings, purple skin, pale skin, yellow_eyes, solo,
      blush, rating:safe, looking_at_viewer, bare_shoulders, skirt, jewelry,
      collar, smile, open_mouth, :p, very_long_hair, teeth, white_background,
      black_dress, collarbone, silver ear_piercing,
      eyebrows_visible_through_hair, bangs, hair_between_eyes, miniskirt
    negative_prompt: >-
      score_4, score_5, score_6, bad anatomy, bad hands, bad feet, fewer digits,
      extra digits, deformed, mutant, signature, artist name
  output:
    url: >-
      https://cdn-uploads.huggingface.co/production/uploads/655ac90c6f460bf3291bf481/Snsi_ebQsRiC9Fblp6bWX.jpeg
- text: >-
    score_9, score_7_up, score_6_up,  lightsource \(Artist\), @0Lightsource,
    nipples, solo, tree, 1girl, shorts, sandals, nature, forest, black_hair,
    hair_bun, bangs, hands_on_hips, outdoors, looking_at_viewer, topless, day,
    navel, standing, red_eyes, smile, breasts, huge_breasts, full_body,
    dappled_sunlight, rating:questionable, closed_mouth, green_shorts,
    blunt_bangs, toes, tree_shade, blush, short_hair
  parameters:
    prompt: >-
      score_9, score_7_up, score_6_up,  lightsource \(Artist\), @0Lightsource,
      nipples, solo, tree, 1girl, shorts, sandals, nature, forest, black_hair,
      hair_bun, bangs, hands_on_hips, outdoors, looking_at_viewer, topless, day,
      navel, standing, red_eyes, smile, breasts, huge_breasts, full_body,
      dappled_sunlight, rating:questionable, closed_mouth, green_shorts,
      blunt_bangs, toes, tree_shade, blush, short_hair
    negative_prompt: >-
      (worst quality:1.4), (low quality:1.4), extra digits, bad eye, cropped,
      lowres , username, blurry, trademark, watermark, title, strabismus,
      clothing cutout, side slit,worst hand, (ugly face:1.2), extra leg, extra
      arm, bad foot, text, name, badhandv4,negative_hand, childish,
      unprofessional,extra fingers,bad tail, imperfect
  output:
    url: >-
      https://cdn-uploads.huggingface.co/production/uploads/655ac90c6f460bf3291bf481/c66vPHhV54sEVZgFfLQjg.jpeg
library_name: diffusers
---

# LoRA Showcase

<Gallery />





### Model Description

Style LoRA based on Lightsource's Style. ( https://x.com/0Lightsource)


Please let me know your thoughts!


- **License:** [Cretive Commons Zero UniversAL]
- **Finetuned from model [optional]:** [ponyDiffusionV6XL_v6StartWithThisOne.safetensors (https://civitai.com/models/257749?modelVersionId=290640) (https://huggingface.co/AiAF/ponyDiffusionV6XL_v6StartWithThisOne.safetensors)]

### Model Sources [optional]

<!-- Provide the basic links for the model. -->

- **Civitai Source:** [https://civitai.com/models/553464?modelVersionId=615931]


## Uses

Stable Diffusion Model indtended to work with PonyDiffsuionV6 and models finetuned off of it (models like AutismMix for example)

## Trigger Words:

lightsource \(Artist\), @0Lightsource, OLS \(Artist\)

### Out-of-Scope Use

Will not work well, if at all, with non-PonyV6 models or non-PonyV6-finetunes. Will not work at all witl SDXL 1.0, SD 1.5, etc. 

[More Information Needed]

## Bias, Risks, and Limitations

[Simi-important note: During the image tagging process, I accidentally mispelled Marasaki's name as "Marusaki" and didn't catch the mistake until towards the end of the training process. Unfortunately this means his appearance will only be accurately generated if its spelled "Maru" instead of the correct "Mara". I may correct this via training a new version in the future.]

### Recommendations

<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->

None

## How to Get Started with the Model

If on a local A1111 set up, use the standard <Lora:[name-of-LoRA-Goes-here]:[1]> prompt. If you're using this on an external service like Civitai then it should be self explanitory.

[More Information Needed]

## Training Details

### Training Data

<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->

[https://huggingface.co/datasets/AiAF/Lightsource-0Lightsource-OLS_PonyXL-LoRA_Dataset]

### Interrogation Data


{
    "ss_epoch": "10",
    "ss_bucket_no_upscale": "False",
    "ss_total_batch_size": "25",
    "ss_num_batches_per_epoch": "69",
    "ss_new_vae_hash": "63aeecb90ff7bc1c115395962d3e803571385b61938377bc7089b36e81e92e2e",
    "ss_tag_frequency": "{\"meta_lat.json\": {}}",
    "ss_min_snr_gamma": "3",
    "ss_caption_dropout_every_n_epochs": "0",
    "ss_sd_model_hash": "e577480d",
    "ss_max_token_length": "225",
    "ss_shuffle_caption": "False",
    "ss_seed": "4479",
    "ss_sd_model_name": "v6.safetensors",
    "ss_reg_dataset_dirs": "{}",
    "ss_flip_aug": "False",
    "ss_lr_warmup_steps": "0",
    "ss_resolution": "(1024, 1024)",
    "ss_caption_dropout_rate": "0.0",
    "ss_gradient_checkpointing": "True",
    "ss_bucket_info": "{\"buckets\": {\"0\": {\"resolution\": [320, 1024], \"count\": 4}, \"1\": {\"resolution\": [384, 1024], \"count\": 2}, \"2\": {\"resolution\": [448, 1024], \"count\": 16}, \"3\": {\"resolution\": [512, 1024], \"count\": 32}, \"4\": {\"resolution\": [576, 1024], \"count\": 72}, \"5\": {\"resolution\": [640, 1024], \"count\": 126}, \"6\": {\"resolution\": [704, 1024], \"count\": 240}, \"7\": {\"resolution\": [768, 1024], \"count\": 182}, \"8\": {\"resolution\": [832, 1024], \"count\": 164}, \"9\": {\"resolution\": [896, 1024], \"count\": 76}, \"10\": {\"resolution\": [960, 1024], \"count\": 38}, \"11\": {\"resolution\": [1024, 320], \"count\": 2}, \"12\": {\"resolution\": [1024, 384], \"count\": 4}, \"13\": {\"resolution\": [1024, 448], \"count\": 2}, \"14\": {\"resolution\": [1024, 512], \"count\": 2}, \"15\": {\"resolution\": [1024, 576], \"count\": 26}, \"16\": {\"resolution\": [1024, 640], \"count\": 42}, \"17\": {\"resolution\": [1024, 704], \"count\": 84}, \"18\": {\"resolution\": [1024, 768], \"count\": 72}, \"19\": {\"resolution\": [1024, 832], \"count\": 52}, \"20\": {\"resolution\": [1024, 896], \"count\": 42}, \"21\": {\"resolution\": [1024, 960], \"count\": 34}, \"22\": {\"resolution\": [1024, 1024], \"count\": 32}}, \"mean_img_ar_error\": 0.0}",
    "ss_full_fp16": "False",
    "ss_scale_weight_norms": "None",
    "ss_mixed_precision": "fp16",
    "ss_max_grad_norm": "0",
    "ss_enable_bucket": "True",
    "ss_network_dropout": "None",
    "ss_training_comment": "None",
    "ss_training_finished_at": "1720056618.6869428",
    "ss_multires_noise_iterations": "6",
    "ss_random_crop": "False",
    "ss_num_epochs": "10",
    "ss_num_reg_images": "0",
    "ss_network_dim": "32",
    "ss_network_args": "{\"conv_dim\": \"8\", \"conv_alpha\": \"1\"}",
    "ss_num_train_images": "1346",
    "ss_gradient_accumulation_steps": "1",
    "ss_face_crop_aug_range": "None",
    "ss_lowram": "False",
    "ss_vae_name": "sdxl_vae.safetensors",
    "ss_clip_skip": "None",
    "ss_max_bucket_reso": "None",
    "sshs_model_hash": "86886e99d8a83793fe63cc21287344330858888423015fd998cc133c69a18862",
    "ss_batch_size_per_device": "25",
    "ss_v2": "False",
    "ss_unet_lr": "None",
    "ss_keep_tokens": "0",
    "ss_color_aug": "False",
    "ss_noise_offset": "None",
    "ss_optimizer": "transformers.optimization.Adafactor(scale_parameter=False,relative_step=False,warmup_init=False)",
    "ss_caption_tag_dropout_rate": "0.0",
    "ss_base_model_version": "sdxl_base_v0-9",
    "ss_zero_terminal_snr": "False",
    "ss_max_train_steps": "690",
    "ss_multires_noise_discount": "0.3",
    "ss_learning_rate": "0.001",
    "ss_adaptive_noise_scale": "None",
    "ss_network_module": "networks.lora",
    "ss_steps": "690",
    "ss_vae_hash": "d636e597",
    "ss_training_started_at": "1720053253.286365",
    "ss_sd_scripts_commit_hash": "05811296f6dc987f67f194689e106a326017b9d4",
    "ss_min_bucket_reso": "None",
    "ss_output_name": "Lightsource | @0Lightsource | OLS[PonyXL]",
    "ss_network_alpha": "32",
    "ss_prior_loss_weight": "1.0",
    "ss_lr_scheduler": "constant",
    "ss_new_sd_model_hash": "67ab2fd8ec439a89b3fedb15cc65f54336af163c7eb5e4f2acc98f090a29b0b3",
    "ss_text_encoder_lr": "None",
    "ss_cache_latents": "False",
    "sshs_legacy_hash": "76a48373",
    "ss_dataset_dirs": "{\"meta_lat.json\": {\"n_repeats\": 2, \"img_count\": 673}}",
    "ss_session_id": "2268693806"
}

### Model Type

[SDXL / PonyXL]


#### Hardware (used for training)

[Nvidia T4, L4, or A100]

#### Software

[https://github.com/Linaqruf/kohya-trainer/blob/main/kohya-LoRA-dreambooth.ipynb]

- **Note:** Repo is in Archived Read-only state as of May 14th, 2024. Can still be git cloned but may be depricated in some areas now that it's not being actively maintained. Contact me if you have any questions. I may be able to assist if you run into any problmems (please provide stack traces)


## Model Card Authors [optional]

[AiAF]

## Model Card Contact

[Civitai: https://civitai.com/user/AI_Art_Factory

Discord: ai_art_factory

Twitter: AiArt Factory (@AiArtFactory) / X (twitter.com)

TikTok: https://www.tiktok.com/@ai_art_factory?_t=8cykD6v1PRu&_r=1

Instagram: https://instagram.com/aiart.factory?igshid=NGExMmI2YTkyZg==

Deviantart: https://www.deviantart.com/aiartfactory
]