Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,50 @@
|
|
1 |
---
|
2 |
license: mit
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: mit
|
3 |
+
pipeline_tag: image-to-image
|
4 |
+
tags:
|
5 |
+
- ControlNetModel
|
6 |
+
- StableDiffusionXLControlNetInpaintPipeline
|
7 |
+
- 'ControlNetModel'
|
8 |
+
- stable-diffusion-xl
|
9 |
+
- inpainting
|
10 |
+
- light-estimation
|
11 |
+
- relighting
|
12 |
+
base_model: stabilityai/stable-diffusion-xl-base-1.0
|
13 |
+
instance_prompt: >-
|
14 |
+
a perfect mirrored reflective chrome ball sphere
|
15 |
+
inference: false
|
16 |
---
|
17 |
+
# Chromeball SDXL EV0 Wild 1500
|
18 |
+
|
19 |
+
**THIS IS NOT A PART OF DIFFUSIONLIGHT PAPER**
|
20 |
+
|
21 |
+
Unlike Chromeball-sdxl-ev0 repo, this controlnet is fine-tuned use 1500 in the wild image (Taken from Unsplash) instead of fully synthetic dataset.
|
22 |
+
|
23 |
+
We use a ControlNet to output the chrome ball from SDXL instead of using LoRA which enables the SDXL Turbo to output lighting in one denosing step
|
24 |
+
|
25 |
+
If the speed is less of a concern for you and want to focus on the quality. Please check out the LoRA model at [DiffusionLight](https://huggingface.co/DiffusionLight/DiffusionLight)
|
26 |
+
|
27 |
+
|
28 |
+
|
29 |
+
## ControlNet vs LoRA: The SDXL Turbo
|
30 |
+
|
31 |
+
TODO: I will explained later that SDXL Turbo makes LoRA impossible to give an input signal in one step. So, we use a control to guide output instead
|
32 |
+
|
33 |
+
|
34 |
+
## Download model
|
35 |
+
|
36 |
+
Weights for this model are available in Safetensors format.
|
37 |
+
|
38 |
+
[Download](/DiffusionLight/DiffusionLight/tree/main) them in the Files & versions tab.
|
39 |
+
|
40 |
+
## Trigger words
|
41 |
+
|
42 |
+
| Chromeball | Prompt |
|
43 |
+
| ----------- | ----------- |
|
44 |
+
| EV0 | a perfect mirrored reflective chrome ball sphere |
|
45 |
+
|
46 |
+
## Chromeball generation
|
47 |
+
TODO: I will update how to generate chrome ball from controlnet in one Unet pass.
|
48 |
+
|
49 |
+
|
50 |
+
PS. This repo is currently supported outing the EV0. We might support different EV in the future.
|