Update README.md

README.md

@@ -16,7 +16,7 @@ inference: true
 should probably proofread and complete it, then remove this comment. -->
 
 
-# LoRA text2image fine-tuning - jonathandinu/sdxl-metamorphosis
+# LoRA fine-tuning - jonathandinu/sdxl-metamorphosis
 
 These are LoRA adaption weights for stabilityai/stable-diffusion-xl-base-1.0. The weights were fine-tuned on illustrations from [Maria Sibylla Merian’s Metamorphosis Insectorum Surinamensium (1705)](https://huggingface.co/datasets/jonathandinu/merian-metamorphosis).
 
@@ -31,10 +31,48 @@ Special VAE used for training: madebyollin/sdxl-vae-fp16-fix.
 
 ## Intended uses & limitations
 
-#### How to use
+### How to use
+
+#### text2img
+
+```python
+from diffusers import DiffusionPipeline, AutoencoderKL, utils
+
+vae = AutoencoderKL.from_pretrained("madebyollin/sdxl-vae-fp16-fix", torch_dtype=torch.float16)
+
+pipeline = DiffusionPipeline.from_pretrained("stabilityai/stable-diffusion-xl-base-1.0",  vae=vae, torch_dtype=torch.float16, variant="fp16")
+pipeline.to("cuda")
+
+pipeline.load_lora_weights("jonathandinu/sdxl-metamorphosis-lora", weight_name="pytorch_lora_weights.safetensors")
+
+pipeline(
+  prompt="an astronaut in the jungle",
+  num_inference_steps=30,
+  generator=torch.manual_seed(1)
+).images[0]
+```
+
+#### img2img
 
 ```python
-# TODO: add an example code snippet for running this diffusion pipeline
+from diffusers import AutoPipelineForImage2Image
+
+url = "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/img2img-sdxl-init.png"
+
+vae = AutoencoderKL.from_pretrained("madebyollin/sdxl-vae-fp16-fix", torch_dtype=torch.float16)
+
+pipeline = AutoPipelineForImage2Image.from_pretrained("stabilityai/stable-diffusion-xl-base-1.0",  vae=vae, torch_dtype=torch.float16, variant="fp16")
+pipeline.to("cuda")
+
+pipeline.load_lora_weights("jonathandinu/sdxl-metamorphosis-lora", weight_name="pytorch_lora_weights.safetensors")
+
+pipeline(
+  prompt="an astronaut in the jungle",
+  image=init_image,
+  num_inference_steps=30,
+  generator=torch.manual_seed(1),
+  strength=0.7
+).images[0]
 ```
 
 #### Limitations and bias