prithivMLmods
commited on
Commit
β’
a507ff0
1
Parent(s):
06242e7
Update README.md
Browse files
README.md
CHANGED
@@ -22,8 +22,52 @@ license: creativeml-openrail-m
|
|
22 |
|
23 |
<Gallery />
|
24 |
|
|
|
25 |
|
26 |
-
##
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
27 |
|
28 |
You should use `3D Sketchfab` to trigger the image generation.
|
29 |
|
|
|
22 |
|
23 |
<Gallery />
|
24 |
|
25 |
+
**The model is still in the training phase. This is not the final version and may contain artifacts and perform poorly in some cases.**
|
26 |
|
27 |
+
## Model description
|
28 |
+
|
29 |
+
**prithivMLmods/Castor-3D-Sketchfab-Flux-LoRA**
|
30 |
+
|
31 |
+
Image Processing Parameters
|
32 |
+
|
33 |
+
| Parameter | Value | Parameter | Value |
|
34 |
+
|---------------------------|--------|---------------------------|--------|
|
35 |
+
| LR Scheduler | constant | Noise Offset | 0.03 |
|
36 |
+
| Optimizer | AdamW | Multires Noise Discount | 0.1 |
|
37 |
+
| Network Dim | 64 | Multires Noise Iterations | 10 |
|
38 |
+
| Network Alpha | 32 | Repeat & Steps | 23 & 1.8k |
|
39 |
+
| Epoch | 10 | Save Every N Epochs | 1 |
|
40 |
+
|
41 |
+
Labeling: florence2-en(natural language & English)
|
42 |
+
|
43 |
+
Total Images Used for Training : 39
|
44 |
+
|
45 |
+
## Setting Up
|
46 |
+
```
|
47 |
+
import torch
|
48 |
+
from pipelines import DiffusionPipeline
|
49 |
+
|
50 |
+
base_model = "black-forest-labs/FLUX.1-dev"
|
51 |
+
pipe = DiffusionPipeline.from_pretrained(base_model, torch_dtype=torch.bfloat16)
|
52 |
+
|
53 |
+
lora_repo = "prithivMLmods/Castor-3D-Sketchfab-Flux-LoRA"
|
54 |
+
trigger_word = "3D Sketchfab" # Leave trigger_word blank if not used.
|
55 |
+
pipe.load_lora_weights(lora_repo)
|
56 |
+
|
57 |
+
device = torch.device("cuda")
|
58 |
+
pipe.to(device)
|
59 |
+
```
|
60 |
+
## App File Structure
|
61 |
+
|
62 |
+
/project-root/
|
63 |
+
|
64 |
+
βββ .gitattributes
|
65 |
+
βββ README.md
|
66 |
+
βββ app.py
|
67 |
+
βββ pythonproject.py
|
68 |
+
|
69 |
+
|
70 |
+
## Trigger words π§¨
|
71 |
|
72 |
You should use `3D Sketchfab` to trigger the image generation.
|
73 |
|