examples/Ip-Adapter/README.md

IP-Adapter

IP-Adapter is a interesting model, which can adopt the content or style of another image to generate a new image.

Example: Content Controlling in Stable Diffusion

Based on Stable Diffusion, we can transfer the object to another scene. See sd_ipadapter.py.

First, we generate a car. The prompt is "masterpiece, best quality, a car".	Next, utilizing IP-Adapter, we move the car to the road. The prompt is "masterpiece, best quality, a car running on the road".

Example: Content and Style Controlling in Stable Diffusion XL

The IP-Adapter model based on Stable Diffusion XL is more powerful. You have the option to use the content or style. See sdxl_ipadapter.py.

• Content controlling (original usage of IP-Adapter)

First, we generate a rabbit.	Next, enable IP-Adapter and let the rabbit jump.	For comparision, disable IP-Adapter to see the generated image.

• Style controlling (InstantStyle)

First, we generate a rabbit.	Next, enable InstantStyle and convert the rabbit to a cat.	For comparision, disable IP-Adapter to see the generated image.

Example: Image Fusing (Experimental)

Since IP-Adapter can control the content based on more than one image, we can do something interesting. See sdxl_ipadapter_multi_reference.py.

We have two pokemons here:

Charizard	Pikachu

Fuse!

Pikazard ???