README.md

---
tags:
- flux
- text-to-image
- lora
- diffusers
- fal
base_model: black-forest-labs/FLUX.1-dev
instance_prompt: >-
 Ghibli style [character description] with [distinctive features], [action or
 pose], [environment or background], [lighting or atmosphere], [additional
 details]
license: other
license_name: flux-1-dev-non-commercial-license
license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md
widget:
- text: >-
 Ghibli style futuristic stormtrooper with glossy white armor and a sleek
 helmet, standing heroically on a lush alien planet, vibrant flowers blooming
 around, soft sunlight illuminating the scene, a gentle breeze rustling the
 leaves
 output:
 url: images/x4swNXc6IRKnh-D6DtihE_5f83bc549d1742ab90badc3d4b70d633.jpg
- text: >-
 Ghibli style Shrek, a lovable green ogre with a big smile, sitting on a
 moss-covered rock while enjoying a plate of freshly picked vegetables, in a
 magical forest filled with whimsical creatures, dappled sunlight filtering
 through the trees, surrounded by curious fairies peeking out from behind
 leaves
 output:
 url: images/7rrcd6pMDfYpF-ogxgG4h_539c7546dae945efb68560befc655eb3.jpg
- text: >-
 Ghibli style Albus Dumbledore, a wise old wizard with long silver hair and a
 flowing robe, standing in a lush garden filled with colorful magical plants,
 gently stroking a phoenix perched on his shoulder, soft morning light
 filtering through the trees, surrounded by whimsical creatures curiously
 observing him
 output:
 url: images/62SwmyLf8xHJ8uGRBL4Tm_2dad22f9fcd64b859b3c83735b270016.jpg
- text: >-
 Ghibli style The Grinch, a mischievous green creature with a sly grin,
 peeking out from behind a snow-covered tree while plotting his antics, in a
 quaint snowy village decorated for the holidays, warm light glowing from
 cozy homes, with playful snowflakes dancing in the air
 output:
 url: images/U9CD7T-PUXSdQqhOvMnZl_e867ddc5c1e34398b01112999f44eafa.jpg
- text: >-
 Ghibli style Santa Claus, a jolly old man with a fluffy white beard and a
 red coat, cheerfully preparing gifts in a cozy workshop filled with magical
 toys, warm golden light glowing from lanterns, surrounded by adorable elves
 and whimsical creatures helping him
 output:
 url: images/_h_RDKv-7-SSwXTn3RCYw_fc2d6d100b354ac1bf54b5e45c364dd5.jpg
- text: >-
 Ghibli style Garfield, a lazy orange cat with a mischievous grin, lounging
 on a sunny windowsill while dreaming of lasagna, in a cozy home filled with
 plants and colorful decor, warm light streaming in, with a friendly mouse
 peeking out from behind a flower pot
 output:
 url: images/laOMFQjySoeOM9SUc-yDr_958497495bef4224b9f845ba01beb1ec.jpg
datasets:
- alvarobartt/ghibli-characters
pipeline_tag: text-to-image
---

# Studio Ghibli Characters - FLUX.1 Dev LoRA

<Gallery />

## Model description

This repository contains the LoRA adapter for [FLUX.1-dev](https://huggingface.co/black-forest-labs/FLUX.1-dev), fine-tuned using [fal.ai/models/fal-ai/flux-lora-general-training](https://fal.ai/models/fal-ai/flux-lora-general-training)
with Studio Ghibli images free-to-use downloaded manually from https://ghibli.jp and hosted at [alvarobartt/ghibli-characters](https://huggingface.co/datasets/alvarobartt/ghibli-characters).

## Prompt Template

You should use the following template (defined when annotating the images with the captions) to trigger the image generation:

"Ghibli style [character description] with [distinctive features], [action or pose], [environment or background], [lighting or atmosphere], [additional details]"

## Inference with `diffusers`

```python
import torch
from diffusers import DiffusionPipeline

model_id = "black-forest-labs/FLUX.1-dev"
adapter_id = "alvarobartt/ghibli-characters-flux-lora"

pipeline = DiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.bfloat16)
pipeline.load_lora_weights(adapter_id)
pipeline.to("cuda")

prompt = (
 "Ghibli style futuristic stormtrooper with glossy white armor and a sleek helmet,"
 " standing heroically on a lush alien planet, vibrant flowers blooming around, soft"
 " sunlight illuminating the scene, a gentle breeze rustling the leaves"
)

image = pipeline(
 prompt=prompt,
 num_inference_steps=30,
 width=1024,
 height=768,
 guidance_scale=3.5,
 lora_scale=1.0,
).images[0]

image.save("ghibli.png", format="PNG")
```

## Disclaimer

This fine-tune is for **personal-use only**, with **no-commercial purposes** as stated within the licensing.

The FLUX.1-dev fine-tunes fall under the same license as FLUX.1-dev i.e. https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md;
and the Studio Ghibli dataset is released with a custom non-commercial license based on the interpretation of the findings on their website.