Hugging Face's logo

ProGamerGov
/
360-Diffusion-LoRA-sd-v1-5

Text-to-Image
English
lora
stable-diffusion
equirectangular
360°
VR
Model card Files Community
3
360-Diffusion-LoRA-sd-v1-5 / README.md
ProGamerGov's picture
ProGamerGov
Add useful tag information
42a43d6
preview code
|
raw
history blame
5.69 kB
metadata
license: creativeml-openrail-m
language:
  - en
tags:
  - lora
  - stable-diffusion
  - text-to-image
  - equirectangular
  - 360°
  - VR

360 Diffusion

360 Diffusion v1

This LoRA model was finetuned on an extremely diverse dataset of 360° equirectangular projections with 2104 captioned training images, using the Stable Diffusion v1-5 model.

This model was finetuned with the trigger word qxj. If using the AUTOMATIC1111 WebUI, then you will have to append <lora:360Diffusion_v1:1> to the prompt as well in order to activate the model.

Useful Tags

In order to improve usability of the model, various words and phrases were used to tag objects, scenes, style, and content. Note that these lists are based on the training data and do not include things added by the base model. These lists are also not comprehensive.

Styles

  • photo, photobash, render, architectural rendering, illustration, digital illustration, painting, digital painting, drawing, watercolor painting concept art, charcoal drawing, sketch, rough sketch, fractal art, crayon drawing, anime, pixel art

Camera Locations

  • underwater, aerial view, interior, exterior, pov, street level, above the clouds, low earth orbit, underground

Locations

  • library, bedroom, bathroom, hallway, corridor, bridge, helm, cockpit, driver's seat, street, road, forest, city, train station, railway, greenhouse, residential street, dock, hanger, landing pad, ferry, cave, observatory, amusement park, waterpark, tunnel, mine, tropical, beach, desert, steep slope, cliff, ocean, body of water, river, mountain, space, underground bunker, space station

Skies

  • aurora borealis, cloudy, overcast sky, blue sky, stars

Time

  • sunset, sunrise night, sunny day, winter, twilight, fall

Weather

  • rain, raining, snow, snowing, fog, haze, smoke, storm, stormy, lightning, flooded, arid

Lighting

  • bright, dark, dimly lit

Themes

  • futuristic, cyberpunk, historical, messy, scifi, minimalism, minimalistic, simple, simplistic, video game, surrealism, surrealistic, cartoon, comic, black and white, smooth, ancient, medieval, vector art, abandoned, horror

Humans & Animals

  • people, women, woman, man, men, cat, dog, horse, group of, various dinosaurs, zombie, fish, shark

Rendering Tips

When rendering, it is recommended that you use either a 1:2 ratio or a perfect square. Rendering as a 1:1 square can help improve concept coherence (like the walls of a room).

Details can lose coherence at large sizes with txt2img, so it is recommended that you initially render a smaller version with at least one dimension near 512px, and then upscale it with img2img (with denoising set to 0.5) or a built in high-res fix feature.

Details can sometimes be improved by looping the output back through img2img multiple times, with a denoising of 0.5 and seed resizing.

Seam Handling

As Stable Diffusion only renders squares and rectangles, any equirectangular projections will have edges that may not fully match the other side. While these seams are generally pretty minimal, there are multiple ways to deal with them:

  • Using the asymmetric-tiling extension's x-axis tiling feature can help eliminate seams entirely, but the extension can significantly degrade output. It is recommended that you set the 'Start tiling from step N' setting to start at around 50% in order to minimize the impact (ex: start at 9 if using 20 steps).

  • Inpainting can be used across the seam after shifting the image horizontally to the right or left.

  • GIMP (potentially with G'MIC) or Photoshop can be used to remove the seams.

Viewing 360 images

The images created with this model are meant to be viewed by 360° viewers and thus will have weird distortions when viewed in 2D.

Website (supports VR headsets): https://renderstuff.com/tools/360-panorama-web-viewer/

AUTOMATIC1111 WebUI Extension: https://github.com/GeorgLegato/sd-webui-panorama-viewer

Example Image Models