hahminlew/sdxl-kream-model-lora

KREAM-Product-Generator

Latest version of the model has been released! Please try it: hahminlew/sdxl-kream-model-lora-2.0

KREAM-Product-Generator is a finetuned text-to-image generative model with a custom dataset collected from KREAM, one of the best online-resell market in Korea. Have fun creating realistic, high-quality fashion items!

You can see detailed instructions to finetune and inference the model in my github repository: fashion-product-generator.

Results

Prompts

• outer, The Nike x Balenciaga down jacket black, a photography of a black down jacket with a logo on the chest.
• top, (W) Balenciaga x Nike Slip Hoodie Dress Cream, a photography of a cream dress and a hood on.
• bottom, Supreme Animal Print Baggy Jean Washed Indigo - 23FW, a photography of a dark blue jean with an animal printing on.
• outer, The North Face x Supreme White Label Nuptse Down Jacket Cream Beige, a photography of a white puffer jacket with a red box logo on the front.
• top, The Supreme x Stussy Oversized Cotton Black Hoodie, a photography of a black shirt with a hood on and a logo on the chest.
• bottom, The IAB Studio x Stussy Dye Sweat Wooven Shorts, a photography of a short pants with a logo.

*A more precise model is now available. Please try to generate products through prompt engineering!

Inference

from diffusers import DiffusionPipeline
import torch

pipe = DiffusionPipeline.from_pretrained("stabilityai/stable-diffusion-xl-base-1.0", torch_dtype=torch.float16)
pipe.to("cuda")
pipe.load_lora_weights("hahminlew/sdxl-kream-model-lora")

prompt = "outer, The Nike x Balenciaga down jacket black, a photography of a black down jacket with a logo on the chest."

image = pipe(prompt, num_inference_steps=30, guidance_scale=7.5).images[0]
image.save("example.png")

LoRA text2image fine-tuning Info.

These are LoRA adaption weights for stabilityai/stable-diffusion-xl-base-1.0. The weights were fine-tuned on the hahminlew/kream-product-blip-captions dataset.

LoRA for the text encoder was enabled: False.

Special VAE used for training: madebyollin/sdxl-vae-fp16-fix.

Citation

If you use KREAM Product Dataset and the model in your research or projects, please cite it as:

@misc{lew2023kream,
      author = {Lew, Hah Min},
      title = {KREAM Product BLIP Captions},
      year={2023},
      howpublished= {\url{https://huggingface.co/datasets/hahminlew/kream-product-blip-captions/}}
}