metadata
tags:
- text-to-image
- lora
- diffusers
- template:diffusion-lora
widget:
- text: >-
sketch cx, an illustration of three women standing on a light brown
background. The woman on the left is wearing a striped shirt, striped
pants, and white shoes. She has long blonde hair, and is holding a black
bag in her left hand. She is also wearing a black t-shirt, and a white
plaid skirt. She also has a black backpack on her right shoulder, and she
is also carrying a black and white bag on her left shoulder. Her right
hand is on her hip, and her left leg is crossed over her right leg. Her
left hand is in her pocket, and the right hand has a white and black bag
on it. Her hair is long and wavy, and it is tied in a ponytail. She is
wearing a white baseball cap, and black shoes. Her shadow is cast on the
ground in front of her.
output:
url: images/1.png
- text: >-
sketch cx, a vibrant pink paper is adorned with a pop-up illustration of a
womans face, adorned with blue circles. Her hair is styled in a bun,
adding a pop of color to the scene. Her eyes are squinted with a smile,
while her lips are pursed. Her mouth is slightly open, as if she is
screaming. The woman on the left is wearing a kimono, while the woman in
the middle is holding a book in her hand. The books title, "STEP NEW!" is
written in a bold, blue font. The background is a stark white, with a few
blue stars scattered throughout the image.
output:
url: images/2.png
- text: >-
sketch cx, a black and white sketch of three women on a light pink
background. The woman on the left is sitting on her knees with her hands
on her hips. She is wearing a plaid shirt and black shoes. She has long
blonde hair and black eyes. Her hair is styled in a ponytail and she is
looking to the right. Her eyes are black and her mouth is slightly open.
Her right hand is in her pocket. Her left hand is on her hip. Her jacket
is open and she is wearing a polka dot shirt. Her pants are plaid and her
hair is long and wavy. Her boots are black.
output:
url: images/3.png
- text: >-
sketch cx, an illustration of four women in a line on a light pink
background. The woman on the left is wearing a short skirt with a plaid
pattern on it, while the woman in the middle is holding a phone in her
hand. The other two women are standing on either side of her, with their
arms raised in the air. The third woman is standing on the right, with her
legs crossed. The fourth woman is sitting on her knees with her arms
outstretched. She has short brown hair, and her hair is styled in a
ponytail, and she is wearing glasses on her face. She is also wearing a
polka dot dress.
output:
url: images/4.png
- text: >-
Sketch CX, an illustration of three women standing on a light brown
background. The woman on the left is wearing a striped shirt, striped
pants, and white shoes. She has long blonde hair and is holding a black
bag in her left hand. She is also wearing a black t-shirt and a white
plaid skirt. Additionally, she has a black backpack on her right shoulder
and is carrying a black and white bag on her left shoulder. Her right hand
is on her hip, and her left leg is crossed over her right leg. Her left
hand is in her pocket, and her right hand is holding a white and black
bag. Her hair is long, wavy, and tied in a ponytail. She is wearing a
white baseball cap and black shoes. Her shadow is cast on the ground in
front of her.
output:
url: images/5.png
- text: >-
Sketch CX, a black and white sketch of three women on a light pink
background. The woman on the left is sitting on her knees with her hands
on her hips. She is wearing a plaid shirt and black shoes. She has long
blonde hair, black eyes, and her hair is styled in a ponytail. She is
looking to the right, with her mouth slightly open. Her right hand is in
her pocket, while her left hand is on her hip. Her jacket is open,
revealing a polka dot shirt underneath. She is wearing plaid pants, and
her hair is long and wavy. Her boots are black.
output:
url: images/6.png
base_model: black-forest-labs/FLUX.1-dev
instance_prompt: sketch cx
license: creativeml-openrail-m
Model description for Flux-Cx-Sketch-LoRA
Image Processing Parameters
Parameter | Value | Parameter | Value |
---|---|---|---|
LR Scheduler | constant | Noise Offset | 0.03 |
Optimizer | AdamW | Multires Noise Discount | 0.1 |
Network Dim | 64 | Multires Noise Iterations | 10 |
Network Alpha | 32 | Repeat & Steps | 23 & 2780 |
Epoch | 18 | Save Every N Epochs | 1 |
Labeling: florence2-en(natural language & English)
Total Images Used for Training : 29
Best Dimensions & Inference
Dimensions | Aspect Ratio | Recommendation |
---|---|---|
1280 x 832 | 3:1 | Compatible |
1024 x 1024 | 1:1 | Default |
Setting Up
import torch
from pipelines import DiffusionPipeline
base_model = "black-forest-labs/FLUX.1-dev"
pipe = DiffusionPipeline.from_pretrained(base_model, torch_dtype=torch.bfloat16)
lora_repo = "strangerzonehf/Flux-Cx-Sketch-LoRA"
trigger_word = "sketch cx"
pipe.load_lora_weights(lora_repo)
device = torch.device("cuda")
pipe.to(device)
Trigger words
You should use sketch cx
to trigger the image generation.
Download model
Weights for this model are available in Safetensors format.
Download them in the Files & versions tab.