File size: 2,981 Bytes
8ee0bc8 7dcdee8 8ee0bc8 03ba96b c4724bd 7dcdee8 8ee0bc8 447a23b df55664 18410f7 df55664 c4724bd 7dcdee8 f585de4 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 |
---
license: creativeml-openrail-m
base_model: stabilityai/stable-diffusion-xl-base-1.0
dataset: hahminlew/kream-product-blip-captions
tags:
- stable-diffusion-xl
- stable-diffusion-xl-diffusers
- text-to-image
- diffusers
- lora
inference: true
---
# KREAM-Product-Generator
**Latest version of the model has been released! Please try it: [hahminlew/sdxl-kream-model-lora-2.0](https://huggingface.co/hahminlew/sdxl-kream-model-lora-2.0)**
**KREAM-Product-Generator** is a finetuned text-to-image generative model with a custom dataset collected from [KREAM](https://kream.co.kr/), one of the best online-resell market in Korea.
Have fun creating realistic, high-quality fashion items!
You can see detailed instructions to finetune and inference the model in my github repository: [easy-finetuning-stable-diffusion](https://github.com/hahminlew/easy-finetuning-stable-diffusion).
# Inference
```
from diffusers import DiffusionPipeline
import torch
pipe = DiffusionPipeline.from_pretrained("stabilityai/stable-diffusion-xl-base-1.0", torch_dtype=torch.float16)
pipe.to("cuda")
pipe.load_lora_weights("hahminlew/sdxl-kream-model-lora")
prompt = "outer, The Nike x Balenciaga down jacket black, a photography of a black down jacket with a logo on the chest."
image = pipe(prompt, num_inference_steps=30, guidance_scale=7.5).images[0]
image.save("example.png")
```
# Results
`Prompts`
- `outer, The Nike x Balenciaga down jacket black, a photography of a black down jacket with a logo on the chest.`
- `top, (W) Balenciaga x Nike Slip Hoodie Dress Cream, a photography of a cream dress and a hood on.`
- `bottom, Supreme Animal Print Baggy Jean Washed Indigo - 23FW, a photography of a dark blue jean with an animal printing on.`
- `outer, The North Face x Supreme White Label Nuptse Down Jacket Cream Beige, a photography of a white puffer jacket with a red box logo on the front.`
- `top, The Supreme x Stussy Oversized Cotton Black Hoodie, a photography of a black shirt with a hood on and a logo on the chest.`
- `bottom, The IAB Studio x Stussy Dye Sweat Wooven Shorts, a photography of a short pants with a logo.`
**A more precise model is now available. Please try to generate products through prompt engineering!*
# LoRA text2image fine-tuning Info.
These are LoRA adaption weights for stabilityai/stable-diffusion-xl-base-1.0. The weights were fine-tuned on the [hahminlew/kream-product-blip-captions](https://huggingface.co/datasets/hahminlew/kream-product-blip-captions) dataset.
LoRA for the text encoder was enabled: False.
Special VAE used for training: madebyollin/sdxl-vae-fp16-fix.
## Citation
If you use KREAM Product Dataset and the model in your research or projects, please cite it as:
```
@misc{lew2023kream,
author = {Lew, Hah Min},
title = {KREAM Product BLIP Captions},
year={2023},
howpublished= {\url{https://huggingface.co/datasets/hahminlew/kream-product-blip-captions/}}
}
``` |