Upload README (16).md
Browse files- README (16).md +60 -0
README (16).md
ADDED
@@ -0,0 +1,60 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: other
|
3 |
+
license_name: flux-1-dev-non-commercial-license
|
4 |
+
license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.
|
5 |
+
language:
|
6 |
+
- en
|
7 |
+
pipeline_tag: text-to-image
|
8 |
+
tags:
|
9 |
+
- lora
|
10 |
+
- Stable Diffusion
|
11 |
+
- image-generation
|
12 |
+
- Flux
|
13 |
+
- diffusers
|
14 |
+
base_model: black-forest-labs/FLUX.1-dev
|
15 |
+
---
|
16 |
+
![Lora Photorealism for Flux](https://github.com/XLabs-AI/x-flux/blob/main/assets/readme/light/lora-photorealism-header-rev1.png?raw=true)
|
17 |
+
[<img src="https://github.com/XLabs-AI/x-flux/blob/main/assets/readme/light/join-our-discord-rev1.png?raw=true">](https://discord.gg/FHY2guThfy)
|
18 |
+
|
19 |
+
This repository provides a checkpoint with trained LoRA photorealism for
|
20 |
+
[FLUX.1-dev model](https://huggingface.co/black-forest-labs/FLUX.1-dev) by Black Forest Labs
|
21 |
+
|
22 |
+
![Example Picture 1](https://github.com/XLabs-AI/x-flux/blob/main/assets/readme/examples/picture-6-rev1.png?raw=true)
|
23 |
+
# ComfyUI
|
24 |
+
|
25 |
+
[See our github](https://github.com/XLabs-AI/x-flux-comfyui) for comfy ui workflows.
|
26 |
+
![Example Picture 1](https://github.com/XLabs-AI/x-flux-comfyui/blob/main/assets/image1.png?raw=true)
|
27 |
+
# Training details
|
28 |
+
[XLabs AI](https://github.com/XLabs-AI) team is happy to publish fine-tuning Flux scripts, including:
|
29 |
+
|
30 |
+
- **LoRA** π₯
|
31 |
+
- **ControlNet** π₯
|
32 |
+
|
33 |
+
[See our github](https://github.com/XLabs-AI/x-flux) for train script and train configs.
|
34 |
+
|
35 |
+
# Training Dataset
|
36 |
+
Dataset has the following format for the training process:
|
37 |
+
|
38 |
+
```
|
39 |
+
βββ images/
|
40 |
+
β βββ 1.png
|
41 |
+
β βββ 1.json
|
42 |
+
β βββ 2.png
|
43 |
+
β βββ 2.json
|
44 |
+
β βββ ...
|
45 |
+
```
|
46 |
+
A .json file contains "caption" field with a text prompt.
|
47 |
+
|
48 |
+
# Inference
|
49 |
+
```bash
|
50 |
+
python3 demo_lora_inference.py \
|
51 |
+
--checkpoint lora.safetensors \
|
52 |
+
--prompt " handsome girl in a suit covered with bold tattoos and holding a pistol. Animatrix illustration style, fantasy style, natural photo cinematic"
|
53 |
+
```
|
54 |
+
|
55 |
+
![Example Picture 1](https://github.com/XLabs-AI/x-flux/blob/main/assets/readme/examples/picture-0-rev1.png?raw=true)
|
56 |
+
|
57 |
+
|
58 |
+
# License
|
59 |
+
|
60 |
+
lora.safetensors falls under the [FLUX.1 [dev]](https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md) Non-Commercial License<br/>
|