|
--- |
|
license: openrail |
|
language: |
|
- en |
|
tags: |
|
- art |
|
- comfyui |
|
- text-to-image |
|
- PixArt-Σ |
|
--- |
|
|
|
 |
|
|
|
**Abominable Workflows** unleashes the full potential of PixArt-Sigma, enhancing its exceptional prompt following capabilities with the rich detail of SD15 models to generate stunning, unique visuals. |
|
|
|
|
|
## Setup Guide |
|
|
|
\> [Required Files](#required-files) <br/> |
|
\> [Required Nodes](#required-nodes) <br/> |
|
\> [How to Automatically Install the Required Nodes](#how-to-automatically-install-the-required-nodes) <br/> |
|
\> [Manually Installing Required Nodes on Linux](#manually-installing-required-nodes-on-linux) <br/> |
|
\> [Manually Installing Required Nodes on Windows](#manually-installing-required-nodes-on-windows) <br/> |
|
|
|
|
|
## Required Files |
|
|
|
To use the workflows, you need to have the following models installed in ComfyUI.<br/> |
|
Place them in the corresponding directories as specified below. |
|
|
|
* \<YOUR_COMFYUI_DIR\> __/ models / checkpoints :__ |
|
* [pixart_sigma-FP16.safetensors](https://huggingface.co/martin-rizzo/AbominableWorkflows/tree/main) (1.2GB) |
|
* [photon_refiner-FP16.safetensors](https://huggingface.co/martin-rizzo/AbominableWorkflows/tree/main) (2.1GB) |
|
* \<YOUR_COMFYUI_DIR\> __/ models / clip :__ |
|
* [t5_xxl_encoder-FP8.safetensors](https://huggingface.co/martin-rizzo/AbominableWorkflows/tree/main) (4.9GB) |
|
* \<YOUR_COMFYUI_DIR\> __/ models / vae :__ |
|
* [pixart_vae.safetensors](https://huggingface.co/martin-rizzo/AbominableWorkflows/tree/main) (0.1GB) |
|
|
|
## Required Nodes |
|
|
|
> [!IMPORTANT] |
|
> Ensure that your ComfyUI is updated to the latest version. |
|
|
|
Additionally, the workflows require the following custom nodes to be installed: |
|
* [__ComfyUI_ExtraModels__]( |
|
https://github.com/city96/ComfyUI_ExtraModels): provides support for PixArt-Sigma. |
|
* [__ComfyUI-Crystools__]( |
|
https://github.com/crystian/ComfyUI-Crystools): used for some simple string operations. |
|
|
|
### How to Automatically Install the Required Nodes |
|
|
|
The easiest way to install the required nodes is by using [ComfyUI-Manager](https://github.com/ltdrdata/ComfyUI-Manager). |
|
This extension for ComfyUI offers management functions to install, remove, |
|
disable, and enable custom nodes. It simplifies the process and can save you |
|
a lot of trouble. |
|
|
|
If for some reason you cannot use ComfyUI-Manager, follow the instructions |
|
below to install the nodes manually. |
|
|
|
### Manually Installing Required Nodes on Linux |
|
|
|
To manually install the nodes, open a terminal and run the following commands: |
|
``` |
|
cd <your_comfyui_dir> |
|
git clone https://github.com/city96/ComfyUI_ExtraModels ./custom_nodes/ComfyUI_ExtraModels |
|
git clone https://github.com/crystian/ComfyUI-Crystools ./custom_nodes/ComfyUI-Crystools |
|
``` |
|
|
|
If ComfyUI is using a virtual environment, you must activate it before installing |
|
the dependencies: |
|
``` |
|
# You might need to replace '.venv' with the directory |
|
# where the virtual environment is located |
|
source .venv/bin/activate |
|
``` |
|
|
|
Then, install the dependencies required by the nodes: |
|
``` |
|
python -m pip install -r ./custom_nodes/ComfyUI_ExtraModels/requirements.txt |
|
python -m pip install -r ./custom_nodes/ComfyUI-Crystools/requirements.txt |
|
``` |
|
|
|
### Manually Installing Required Nodes on Windows |
|
|
|
If you are using the standalone ComfyUI release on Windows, open a CMD in |
|
the "ComfyUI_windows_portable" folder (the one containing your `run_nvidia_gpu.bat` |
|
file). |
|
|
|
From that directory, run the following commands to install the required nodes: |
|
``` |
|
git clone https://github.com/city96/ComfyUI_ExtraModels ComfyUI/custom_nodes/ComfyUI_ExtraModels |
|
git clone https://github.com/crystian/ComfyUI-Crystools ComfyUI/custom_nodes/ComfyUI-Crystools |
|
``` |
|
|
|
Then, install the dependencies required by these nodes: |
|
``` |
|
.\python_embeded\python.exe -s -m pip install -r .\ComfyUI\custom_nodes\ComfyUI_ExtraModels\requirements.txt |
|
.\python_embeded\python.exe -s -m pip install -r .\ComfyUI\custom_nodes\ComfyUI-Crystools\requirements.txt |
|
``` |
|
|
|
|
|
## Acknowledgments |
|
|
|
I would like to thank the developers of PixArt-Σ for their outstanding work. |
|
Their model has been a crucial component in the development of the Abominable Workflows. |
|
|
|
__Further Information about PixArt-Σ__: |
|
* [PixArt-Σ GitHub Repository](https://github.com/PixArt-alpha/PixArt-sigma) |
|
* [PixArt-Σ Hugging Face Model](https://huggingface.co/PixArt-alpha/PixArt-Sigma-XL-2-1024-MS) |
|
* [PixArt-Σ arXiv Report](https://arxiv.org/abs/2403.04692) |
|
|
|
|
|
|
