zhreyu's picture
Update README.md
fdf3b3e verified
metadata
tags:
  - text-to-image
  - flux
  - lora
  - diffusers
  - template:sd-lora
  - ai-toolkit
widget:
  - text: Calvin and Hobbs swimming in the pool chatting
    output:
      url: samples/group_0.gif
  - text: Calvin and Hobbs climbing tree and talking
    output:
      url: samples/group_1.gif
  - text: Calvin and Hobbs talking about quitting school
    output:
      url: samples/group_2.gif
  - text: Calvin and Hobbs eat dinner
    output:
      url: samples/group_3.gif
  - text: Calvin and Hobbs go to shopping
    output:
      url: samples/group_4.gif
  - text: Calvin and Hobbs in Mountain
    output:
      url: samples/CNH.jpg
base_model: black-forest-labs/FLUX.1-dev
instance_prompt: Calvin and Hobbs
license: other
license_name: flux-1-dev-non-commercial-license
license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md

ComicStrips_flux_lora_v1_fp16

This is a fine-tuned model based on the Flux model, specifically trained with LoRA (Low-Rank Adaptation) technique, to generate comic strips in the style of Calvin and Hobbes. This model was trained with AI Toolkit by Ostris enabling you to create fun and engaging comic strip scenarios using Calvin and Hobbes characters.

Prompt
Calvin and Hobbs swimming in the pool chatting
Prompt
Calvin and Hobbs climbing tree and talking
Prompt
Calvin and Hobbs talking about quitting school
Prompt
Calvin and Hobbs eat dinner
Prompt
Calvin and Hobbs go to shopping
Prompt
Calvin and Hobbs in Mountain

Trigger words

You should use Calvin and Hobbs to trigger the image generation.

Download model and use it with ComfyUI, AUTOMATIC1111, SD.Next, Invoke AI, etc.

Weights for this model are available in Safetensors format.

Download them in the Files & versions tab.

Use it with the 🧨 diffusers library

from diffusers import AutoPipelineForText2Image
import torch

pipeline = AutoPipelineForText2Image.from_pretrained('black-forest-labs/FLUX.1-dev', torch_dtype=torch.bfloat16).to('cuda')
pipeline.load_lora_weights('zhreyu/ComicStrips-Lora-Fluxdev', weight_name='ComicStrips_flux_lora_v1_fp16.safetensors')
image = pipeline('Calvin and Hobbs swimming in the pool chatting about drinking lemonade').images[0]
image.save("my_image.png")

For more details, including weighting, merging and fusing LoRAs, check the documentation on loading LoRAs in diffusers