alvarobartt HF staff commited on
Commit
786faaa
1 Parent(s): f58bb56

End of training

Browse files
README.md ADDED
@@ -0,0 +1,79 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: stabilityai/stable-diffusion-3.5-large
3
+ library_name: diffusers
4
+ license: other
5
+ tags:
6
+ - text-to-image
7
+ - diffusers-training
8
+ - diffusers
9
+ - lora
10
+ - sd3
11
+ - sd3-diffusers
12
+ - template:sd-lora
13
+ instance_prompt: Ghibli style human with pig face, staring while being mouth full
14
+ of food, in a restaurant, warm light on night, sweating a lot
15
+ widget: []
16
+ ---
17
+
18
+ <!-- This model card has been generated automatically according to the information the training script had access to. You
19
+ should probably proofread and complete it, then remove this comment. -->
20
+
21
+
22
+ # SD3 DreamBooth LoRA - alvarobartt/ghibli-characters-sd3.5-lora
23
+
24
+ <Gallery />
25
+
26
+ ## Model description
27
+
28
+ These are alvarobartt/ghibli-characters-sd3.5-lora DreamBooth LoRA weights for stabilityai/stable-diffusion-3.5-large.
29
+
30
+ The weights were trained using [DreamBooth](https://dreambooth.github.io/) with the [SD3 diffusers trainer](https://github.com/huggingface/diffusers/blob/main/examples/dreambooth/README_sd3.md).
31
+
32
+ Was LoRA for the text encoder enabled? False.
33
+
34
+ ## Trigger words
35
+
36
+ You should use `Ghibli style human with pig face, staring while being mouth full of food, in a restaurant, warm light on night, sweating a lot` to trigger the image generation.
37
+
38
+ ## Download model
39
+
40
+ [Download the *.safetensors LoRA](alvarobartt/ghibli-characters-sd3.5-lora/tree/main) in the Files & versions tab.
41
+
42
+ ## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers)
43
+
44
+ ```py
45
+ from diffusers import AutoPipelineForText2Image
46
+ import torch
47
+ pipeline = AutoPipelineForText2Image.from_pretrained('stabilityai/stable-diffusion-3-medium-diffusers', torch_dtype=torch.float16).to('cuda')
48
+ pipeline.load_lora_weights('alvarobartt/ghibli-characters-sd3.5-lora', weight_name='pytorch_lora_weights.safetensors')
49
+ image = pipeline('Ghibli style human with pig face, staring while being mouth full of food, in a restaurant, warm light on night, sweating a lot').images[0]
50
+ ```
51
+
52
+ ### Use it with UIs such as AUTOMATIC1111, Comfy UI, SD.Next, Invoke
53
+
54
+ - **LoRA**: download **[`diffusers_lora_weights.safetensors` here 💾](/alvarobartt/ghibli-characters-sd3.5-lora/blob/main/diffusers_lora_weights.safetensors)**.
55
+ - Rename it and place it on your `models/Lora` folder.
56
+ - On AUTOMATIC1111, load the LoRA by adding `<lora:your_new_name:1>` to your prompt. On ComfyUI just [load it as a regular LoRA](https://comfyanonymous.github.io/ComfyUI_examples/lora/).
57
+
58
+ For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters)
59
+
60
+ ## License
61
+
62
+ Please adhere to the licensing terms as described [here](https://huggingface.co/stabilityai/stable-diffusion-3-medium/blob/main/LICENSE).
63
+
64
+
65
+ ## Intended uses & limitations
66
+
67
+ #### How to use
68
+
69
+ ```python
70
+ # TODO: add an example code snippet for running this diffusion pipeline
71
+ ```
72
+
73
+ #### Limitations and bias
74
+
75
+ [TODO: provide examples of latent issues and potential remediations]
76
+
77
+ ## Training details
78
+
79
+ [TODO: describe the data used to train the model]
checkpoint-500/optimizer.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:edd389811923ac1d3dff32990a0604f51c6ca2f1b0a82392c7e63df2104ed69e
3
+ size 47571962
checkpoint-500/pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:26e8cc7bfd21355f92fe330dc57893cf0c95134c562f58d3a87185ea5f0dbfa0
3
+ size 23697992
checkpoint-500/random_states_0.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:29a97ff1e23285c706c1e320bea1d952a624be8fe9584697ca25780423beee8e
3
+ size 14344
checkpoint-500/scheduler.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:55d89757e9a416b80d2e21ab8e682105c317c618793a364358277d485b3dbfc8
3
+ size 1000
logs/dreambooth-sd3-lora/1729687938.8093321/events.out.tfevents.1729687938.a8a4a3f10336.16219.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:32b594dd570f9dcb37db4f8e0ccfdad1aeac245171973be280e118044c7ef899
3
+ size 3436
logs/dreambooth-sd3-lora/1729687938.8112953/hparams.yml ADDED
@@ -0,0 +1,73 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.0001
5
+ adam_weight_decay_text_encoder: 0.001
6
+ allow_tf32: false
7
+ cache_dir: null
8
+ cache_latents: false
9
+ caption_column: text
10
+ center_crop: false
11
+ checkpointing_steps: 500
12
+ checkpoints_total_limit: null
13
+ class_data_dir: null
14
+ class_prompt: null
15
+ dataloader_num_workers: 0
16
+ dataset_config_name: null
17
+ dataset_name: alvarobartt/ghibli-characters
18
+ gradient_accumulation_steps: 1
19
+ gradient_checkpointing: false
20
+ hub_model_id: null
21
+ hub_token: null
22
+ image_column: image
23
+ instance_data_dir: null
24
+ instance_prompt: Ghibli style human with pig face, staring while being mouth full
25
+ of food, in a restaurant, warm light on night, sweating a lot
26
+ learning_rate: 0.0004
27
+ local_rank: -1
28
+ logging_dir: logs
29
+ logit_mean: 0.0
30
+ logit_std: 1.0
31
+ lr_num_cycles: 1
32
+ lr_power: 1.0
33
+ lr_scheduler: constant
34
+ lr_warmup_steps: 0
35
+ max_grad_norm: 1.0
36
+ max_sequence_length: 77
37
+ max_train_steps: 700
38
+ mixed_precision: bf16
39
+ mode_scale: 1.29
40
+ num_class_images: 100
41
+ num_train_epochs: 78
42
+ num_validation_images: 4
43
+ optimizer: AdamW
44
+ output_dir: ghibli-characters-sd3.5-lora
45
+ precondition_outputs: 1
46
+ pretrained_model_name_or_path: stabilityai/stable-diffusion-3.5-large
47
+ prior_generation_precision: null
48
+ prior_loss_weight: 1.0
49
+ prodigy_beta3: null
50
+ prodigy_decouple: true
51
+ prodigy_safeguard_warmup: true
52
+ prodigy_use_bias_correction: true
53
+ push_to_hub: true
54
+ random_flip: false
55
+ rank: 16
56
+ repeats: 1
57
+ report_to: tensorboard
58
+ resolution: 768
59
+ resume_from_checkpoint: null
60
+ revision: null
61
+ sample_batch_size: 4
62
+ scale_lr: false
63
+ seed: 0
64
+ text_encoder_lr: 5.0e-06
65
+ train_batch_size: 1
66
+ train_text_encoder: false
67
+ upcast_before_saving: false
68
+ use_8bit_adam: false
69
+ validation_epochs: 50
70
+ validation_prompt: null
71
+ variant: null
72
+ weighting_scheme: logit_normal
73
+ with_prior_preservation: false
logs/dreambooth-sd3-lora/events.out.tfevents.1729687938.a8a4a3f10336.16219.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c195dcb69c1a75fc6f90b1a308b06f8212f5840f6003773d6f55a50a99e33ad9
3
+ size 58634
pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f78fe0ab562ae0ef410d10a4250f777a50da3cdd02ee3b17509b2eb4d97fba00
3
+ size 23697992