| # 360 Diffusion | |
| ## 360 Diffusion v1 | |
| This [LoRA](https://arxiv.org/abs/2106.09685) model was finetuned on an extremely diverse dataset of 360° equirectangular projections with 2104 captioned training images, using the [Stable Diffusion v1-5 model](https://huggingface.co/runwayml/stable-diffusion-v1-5). | |
| # Rendering Tips | |
| When rendering, it is recommended that you use either a 1:2 ratio or a perfect square. Rendering as a 1:1 square can help improve concept coherence (like the walls of a room). | |
| Details can lose coherence at large sizes with txt2img, so it is recommended that you initially render a smaller version with at least one dimension near 512px, and then upscale it with img2img (with denoising set to 0.5) or a built in high-res fix feature. | |
| Details can sometimes be improved by looping the output back through img2img multiple times, with a denoising of 0.5 and seed resizing. | |
| ## Seam Handling | |
| As Stable Diffusion only renders squares and rectangles, any equirectangular projections will have edges that may not fully match the other side. While these seams are generally pretty minimal, there are multiple ways to deal with them: | |
| * Using the [asymmetric-tiling](https://github.com/tjm35/asymmetric-tiling-sd-webui) extension's x-axis tiling feature can help eliminate seams entirely, but the extension can significantly degrade output. It is recommended that you set the 'Start tiling from step N' setting to start at around 50% in order to minimize the impact (ex: start at 9 if using 20 steps). | |
| * Inpainting can be used across the seam after shifting the image horizontally to the right or left. | |
| * [GIMP](https://www.gimp.org/) (potentially with [G'MIC](https://gmic.eu/)) or Photoshop can be used to remove the seams. | |
| # Viewing 360 images | |
| The images created with this model are meant to be viewed by 360° viewers and thus will have weird distortions when viewed in 2D. | |
| Website (supports VR headsets): https://renderstuff.com/tools/360-panorama-web-viewer/ | |
| AUTOMATIC1111 WebUI Extension: https://github.com/GeorgLegato/sd-webui-panorama-viewer | |
| ### Example Image Models | |
| - Landscape renders used: https://civitai.com/models/4384/dreamshaper | |
| - Renders of people used: https://civitai.com/models/4823/deliberate |