Update README.md

README.md

@@ -1,7 +1,6 @@
 ---
 base_model: stabilityai/stable-diffusion-3.5-large
 library_name: diffusers
-license: other
 tags:
 - text-to-image
 - diffusers-training
@@ -10,70 +9,77 @@ tags:
 - sd3
 - sd3-diffusers
 - template:sd-lora
-instance_prompt: Ghibli style human with pig face, staring while being mouth full
-  of food, in a restaurant, warm light on night, sweating a lot
-widget: []
+instance_prompt: >-
+  Ghibli style [character description] with [distinctive features], [action or
+  pose], [environment or background], [lighting or atmosphere], [additional
+  details]
+license: other
+license_name: stabilityai-ai-community
+license_link: https://huggingface.co/stabilityai/stable-diffusion-3.5-large/blob/main/LICENSE.md
+widget:
+- text: >-
+    Ghibli style futuristic stormtrooper with glossy white armor and a sleek
+    helmet, standing heroically on a lush alien planet, vibrant flowers blooming
+    around, soft sunlight illuminating the scene, a gentle breeze rustling the
+    leaves
+  output:
+    url: images/stormtrooper.jpg
+datasets:
+- alvarobartt/ghibli-characters
+pipeline_tag: text-to-image
 ---
 
-<!-- This model card has been generated automatically according to the information the training script had access to. You
-should probably proofread and complete it, then remove this comment. -->
-
-
-# SD3 DreamBooth LoRA - alvarobartt/ghibli-characters-sd3.5-lora
+# Studio Ghibli Characters - FLUX.1 Dev LoRA
 
 <Gallery />
 
 ## Model description
 
-These are alvarobartt/ghibli-characters-sd3.5-lora DreamBooth LoRA weights for stabilityai/stable-diffusion-3.5-large.
-
-The weights were trained using [DreamBooth](https://dreambooth.github.io/) with the [SD3 diffusers trainer](https://github.com/huggingface/diffusers/blob/main/examples/dreambooth/README_sd3.md).
+This repository contains the LoRA adapter for [StableDiffusion 3.5 Large](https://huggingface.co/stabilityai/stable-diffusion-3.5-large), fine-tuned using [Diffusers + Dreambooth](https://github.com/huggingface/diffusers/blob/main/examples/dreambooth/train_dreambooth_lora_sd3.py)
+with Studio Ghibli images free-to-use downloaded manually from https://ghibli.jp and hosted at [alvarobartt/ghibli-characters](https://huggingface.co/datasets/alvarobartt/ghibli-characters).
 
-Was LoRA for the text encoder enabled? False.
+## Prompt Template
 
-## Trigger words
+You should use the following template (defined when annotating the images with the captions) to trigger the image generation:
 
-You should use `Ghibli style human with pig face, staring while being mouth full of food, in a restaurant, warm light on night, sweating a lot` to trigger the image generation.
+"Ghibli style [character description] with [distinctive features], [action or pose], [environment or background], [lighting or atmosphere], [additional details]"
 
-## Download model
-
-[Download the *.safetensors LoRA](alvarobartt/ghibli-characters-sd3.5-lora/tree/main) in the Files & versions tab.
-
-## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers)
-
-```py
-from diffusers import AutoPipelineForText2Image
-import torch
-pipeline = AutoPipelineForText2Image.from_pretrained('stabilityai/stable-diffusion-3-medium-diffusers', torch_dtype=torch.float16).to('cuda')
-pipeline.load_lora_weights('alvarobartt/ghibli-characters-sd3.5-lora', weight_name='pytorch_lora_weights.safetensors')
-image = pipeline('Ghibli style human with pig face, staring while being mouth full of food, in a restaurant, warm light on night, sweating a lot').images[0]
-```
+## Inference with `diffusers`
 
-### Use it with UIs such as AUTOMATIC1111, Comfy UI, SD.Next, Invoke
-
-- **LoRA**: download **[`diffusers_lora_weights.safetensors` here 💾](/alvarobartt/ghibli-characters-sd3.5-lora/blob/main/diffusers_lora_weights.safetensors)**.
-    - Rename it and place it on your `models/Lora` folder.
-    - On AUTOMATIC1111, load the LoRA by adding `<lora:your_new_name:1>` to your prompt. On ComfyUI just [load it as a regular LoRA](https://comfyanonymous.github.io/ComfyUI_examples/lora/).
-
-For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters)
-
-## License
-
-Please adhere to the licensing terms as described [here](https://huggingface.co/stabilityai/stable-diffusion-3-medium/blob/main/LICENSE).
-
-
-## Intended uses & limitations
-
-#### How to use
+> [!NOTE]
+> Requires `diffusers` 0.31.0 or higher, see the [release notes](https://github.com/huggingface/diffusers/releases/tag/v0.31.0).
 
 ```python
-# TODO: add an example code snippet for running this diffusion pipeline
+import torch
+from diffusers import DiffusionPipeline
+
+model_id = "stabilityai/stable-diffusion-3.5-large"
+adapter_id = "alvarobartt/ghibli-characters-sd3.5-lora"
+
+pipeline = DiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.bfloat16)
+pipeline.load_lora_weights(adapter_id)
+pipeline.to("cuda")
+
+prompt = (
+    "Ghibli style futuristic stormtrooper with glossy white armor and a sleek helmet,"
+    " standing heroically on a lush alien planet, vibrant flowers blooming around, soft"
+    " sunlight illuminating the scene, a gentle breeze rustling the leaves"
+)
+
+image = pipeline(
+    prompt=prompt,
+    num_inference_steps=30,
+    width=1024,
+    height=768,
+    guidance_scale=3.5,
+).images[0]
+
+image.save("ghibli.png", format="PNG")
 ```
 
-#### Limitations and bias
-
-[TODO: provide examples of latent issues and potential remediations]
+## Disclaimer
 
-## Training details
+This fine-tune is for **personal-use only**, with **no-commercial purposes** as stated within the licensing.
 
-[TODO: describe the data used to train the model]
+The StableDiffusion 3.5 Large fine-tunes fall under the same license as StableDiffusion 3.5 Large i.e. https://huggingface.co/stabilityai/stable-diffusion-3.5-large/blob/main/LICENSE.md;
+and the Studio Ghibli dataset is released with a custom non-commercial license based on the interpretation of the findings on their website.