Support for Lora Weights

#14
by caldwecg - opened

I'm trying to load lora weights onto this playground model and it is not working! Is there something different I need to do? Thanks!

model = "playgroundai/playground-v2-1024px-aesthetic"
vae = AutoencoderKL.from_pretrained('madebyollin/sdxl-vae-fp16-fix', torch_dtype=torch.float16)
lora_scale = 0.9
pipe = DiffusionPipeline.from_pretrained(model, vae=vae, torch_dtype = torch.float16, variant="fp16")
pipe.to("cuda")
pipe.load_lora_weights("/mys3bucket/model/", weight_name = "pytorch_lora_weights.safetensors")

Playground org

Perhaps the VAE isn't compatible, have you tried the VAE that comes with the model?

Which VAE would that be?

Playground org
ehsanakh changed discussion status to closed

Sign up or log in to comment