pureexe commited on
Commit
9fff674
1 Parent(s): 86b3e67

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +47 -0
README.md CHANGED
@@ -1,3 +1,50 @@
1
  ---
2
  license: mit
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
+ pipeline_tag: image-to-image
4
+ tags:
5
+ - ControlNetModel
6
+ - StableDiffusionXLControlNetInpaintPipeline
7
+ - 'ControlNetModel'
8
+ - stable-diffusion-xl
9
+ - inpainting
10
+ - light-estimation
11
+ - relighting
12
+ base_model: stabilityai/stable-diffusion-xl-base-1.0
13
+ instance_prompt: >-
14
+ a perfect mirrored reflective chrome ball sphere
15
+ inference: false
16
  ---
17
+ # Chromeball SDXL EV0 Wild 1500
18
+
19
+ **THIS IS NOT A PART OF DIFFUSIONLIGHT PAPER**
20
+
21
+ Unlike Chromeball-sdxl-ev0 repo, this controlnet is fine-tuned use 1500 in the wild image (Taken from Unsplash) instead of fully synthetic dataset.
22
+
23
+ We use a ControlNet to output the chrome ball from SDXL instead of using LoRA which enables the SDXL Turbo to output lighting in one denosing step
24
+
25
+ If the speed is less of a concern for you and want to focus on the quality. Please check out the LoRA model at [DiffusionLight](https://huggingface.co/DiffusionLight/DiffusionLight)
26
+
27
+
28
+
29
+ ## ControlNet vs LoRA: The SDXL Turbo
30
+
31
+ TODO: I will explained later that SDXL Turbo makes LoRA impossible to give an input signal in one step. So, we use a control to guide output instead
32
+
33
+
34
+ ## Download model
35
+
36
+ Weights for this model are available in Safetensors format.
37
+
38
+ [Download](/DiffusionLight/DiffusionLight/tree/main) them in the Files & versions tab.
39
+
40
+ ## Trigger words
41
+
42
+ | Chromeball | Prompt |
43
+ | ----------- | ----------- |
44
+ | EV0 | a perfect mirrored reflective chrome ball sphere |
45
+
46
+ ## Chromeball generation
47
+ TODO: I will update how to generate chrome ball from controlnet in one Unet pass.
48
+
49
+
50
+ PS. This repo is currently supported outing the EV0. We might support different EV in the future.