FLUX.1-dev-LoRA-Ghibli

This is a Ghibli style LoRA trained on FLUX.1-dev.

Prompt

ghibli style, a boy and a girl looking out of a window with a cat perched on the window sill. There is a bicycle parked in front of them and a plant with flowers to the right side of the image. The wall behind them is visible in the background.

Prompt

ghibli style, a girl in a green cloak walking alone through an ancient forest, sunlight piercing through towering trees like stained glass, glowing pollen swirling around her boots, a rusted lantern hanging from her wooden staff, shadows of deer spirits flickering between moss-covered stones, muted emerald and gold color palette

Prompt

ghibli style, a shepherd boy floating on a wooly cloud-whale, holding a glowing dandelion staff to guide sheep-shaped cumulus, miniature storm clouds grazing nearby, his patched jacket flapping in high-altitude winds, aurora-like ribbons in peach and lavender stretching across the sky

Trigger words

You should use ghibli style to trigger the image generation.

Inference

import torch
from diffusers import FluxPipeline

pipe = FluxPipeline.from_pretrained("black-forest-labs/FLUX.1-dev", torch_dtype=torch.bfloat16)
pipe.load_lora_weights("InstantX/FLUX.1-dev-LoRA-Ghibli", weight_name="ghibli_style.safetensors")
pipe.fuse_lora(lora_scale=1.0)
pipe.to("cuda")

prompt = "ghibli style, a shepherd boy floating on a wooly cloud-whale, holding a glowing dandelion staff to guide sheep-shaped cumulus, miniature storm clouds grazing nearby, his patched jacket flapping in high-altitude winds, aurora-like ribbons in peach and lavender stretching across the sky"

image = pipe(prompt, 
             num_inference_steps=24, 
             guidance_scale=3.5,
             width=960, height=1280,
            ).images[0]
image.save(f"example.png")