AdamLucek commited on
Commit
a3d3e10
·
verified ·
1 Parent(s): 6725ff7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +31 -24
README.md CHANGED
@@ -26,21 +26,15 @@ widget:
26
  url: image_3.png
27
  ---
28
 
29
- <!-- This model card has been generated automatically according to the information the training script had access to. You
30
- should probably proofread and complete it, then remove this comment. -->
31
 
 
32
 
33
- # SD3 DreamBooth LoRA - AdamLucek/sd3-cube-dreambooth-lora-2
34
-
35
- <Gallery />
36
 
37
  ## Model description
38
 
39
- These are AdamLucek/sd3-cube-dreambooth-lora-2 DreamBooth LoRA weights for stabilityai/stable-diffusion-3-medium-diffusers.
40
-
41
- The weights were trained using [DreamBooth](https://dreambooth.github.io/) with the [SD3 diffusers trainer](https://github.com/huggingface/diffusers/blob/main/examples/dreambooth/README_sd3.md).
42
-
43
- Was LoRA for the text encoder enabled? True.
44
 
45
  ## Trigger words
46
 
@@ -48,7 +42,7 @@ You should use `A photo of T0K cube` to trigger the image generation.
48
 
49
  ## Download model
50
 
51
- [Download the *.safetensors LoRA](AdamLucek/sd3-cube-dreambooth-lora-2/tree/main) in the Files & versions tab.
52
 
53
  ## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers)
54
 
@@ -62,7 +56,7 @@ image = pipeline('A photo of T0K cube on a shelf').images[0]
62
 
63
  ### Use it with UIs such as AUTOMATIC1111, Comfy UI, SD.Next, Invoke
64
 
65
- - **LoRA**: download **[`diffusers_lora_weights.safetensors` here 💾](/AdamLucek/sd3-cube-dreambooth-lora-2/blob/main/diffusers_lora_weights.safetensors)**.
66
  - Rename it and place it on your `models/Lora` folder.
67
  - On AUTOMATIC1111, load the LoRA by adding `<lora:your_new_name:1>` to your prompt. On ComfyUI just [load it as a regular LoRA](https://comfyanonymous.github.io/ComfyUI_examples/lora/).
68
 
@@ -72,19 +66,32 @@ For more details, including weighting, merging and fusing LoRAs, check the [docu
72
 
73
  Please adhere to the licensing terms as described [here](https://huggingface.co/stabilityai/stable-diffusion-3-medium/blob/main/LICENSE).
74
 
 
75
 
76
- ## Intended uses & limitations
77
-
78
- #### How to use
79
 
80
- ```python
81
- # TODO: add an example code snippet for running this diffusion pipeline
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
82
  ```
83
 
84
- #### Limitations and bias
85
-
86
- [TODO: provide examples of latent issues and potential remediations]
87
-
88
- ## Training details
89
-
90
- [TODO: describe the data used to train the model]
 
26
  url: image_3.png
27
  ---
28
 
29
+ # SD3 DreamBooth LoRA - AdamLucek/sd3-cube-dreambooth-lora-cube
 
30
 
31
+ **Reference Image**
32
 
33
+ **Generated Images**
 
 
34
 
35
  ## Model description
36
 
37
+ These are DreamBooth LoRA weights for [stabilityai/stable-diffusion-3-medium-diffusers](https://huggingface.co/stabilityai/stable-diffusion-3-medium).
 
 
 
 
38
 
39
  ## Trigger words
40
 
 
42
 
43
  ## Download model
44
 
45
+ [Download the pytorch_lora_weights.safetensors LoRA](AdamLucek/sd3-cube-dreambooth-lora-cube/tree/main) in the Files & versions tab.
46
 
47
  ## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers)
48
 
 
56
 
57
  ### Use it with UIs such as AUTOMATIC1111, Comfy UI, SD.Next, Invoke
58
 
59
+ - **LoRA**: download **[`diffusers_lora_weights.safetensors` here 💾](/AdamLucek/sd3-cube-dreambooth-lora-cube/blob/main/diffusers_lora_weights.safetensors)**.
60
  - Rename it and place it on your `models/Lora` folder.
61
  - On AUTOMATIC1111, load the LoRA by adding `<lora:your_new_name:1>` to your prompt. On ComfyUI just [load it as a regular LoRA](https://comfyanonymous.github.io/ComfyUI_examples/lora/).
62
 
 
66
 
67
  Please adhere to the licensing terms as described [here](https://huggingface.co/stabilityai/stable-diffusion-3-medium/blob/main/LICENSE).
68
 
69
+ ## Training details
70
 
71
+ The weights were trained using [DreamBooth](https://dreambooth.github.io/) with the [SD3 diffusers trainer](https://github.com/huggingface/diffusers/blob/main/examples/dreambooth/README_sd3.md).
 
 
72
 
73
+ Script
74
+ ```
75
+ accelerate launch train_dreambooth_lora_sd3.py \
76
+ --pretrained_model_name_or_path="stabilityai/stable-diffusion-3-medium-diffusers" \
77
+ --output_dir="lora-trained-sd3-t3" \
78
+ --dataset_name="AdamLucek/cube-pics-dreambooth" \
79
+ --mixed_precision="fp16" \
80
+ --instance_prompt="A photo of T0K cube" \
81
+ --resolution=1024 \
82
+ --train_batch_size=16 \
83
+ --learning_rate=1e-4 \
84
+ --report_to="wandb" \
85
+ --lr_scheduler="constant" \
86
+ --lr_warmup_steps=0 \
87
+ --max_train_steps=1000 \
88
+ --validation_prompt="A photo of T0K cube on a shelf" \
89
+ --validation_epochs=500 \
90
+ --seed="420" \
91
+ --rank=16 \
92
+ --hub_model_id="sd3-cube-dreambooth-lora-2" \
93
+ --train_text_encoder \
94
+ --push_to_hub
95
  ```
96
 
97
+ Trained on a single H100