Controlling Structure and Appearance for SSD-1B
The CtrlXStableDiffusionXLPipeline has been modified as it had way too many TODO lines. Removed the refiner phase.
Requires 8GB VRAM.
Setup
pip install accelerate diffusers gradio torch safetensors transformers
Inference
python run_ctrlx.py --num_inference_steps 20 --guidance_scale 9.0 --model_offload --structure_image images/horse__point_cloud.jpg --appearance_image images/horse.jpg --prompt "a photo of a horse standing on grass" --structure_prompt "3D point cloud of a horse"
Disclaimer
All code belongs to Jordan Lin, the models weight to Segmind.
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API was unable to determine this model's library.