Skip to content

How to use Instruct Pix2Pix

stassius edited this page May 27, 2023 · 3 revisions

What is Instruct pix2pix?

Instruct pix2pix is a model that lets you change an image using text instructions like "make his hair blue" or "turn it into a wood carving".

Long story short, the initial implementation of Instruct p2p in Automatic1111 became obsolete as we can do the same with a ControlNet model. It's way more convenient, as it can work with hi-res images and there is no hassle with the double denoising strength setting.

How to use it in Stable Houdini?

Put your image to ControlNet, set the ControlNet preprocessor to "none" and model to Control_v11e_sd15_ip2p, put your instruction into the prompt field and you're good to go. It works in both text2image and image2image modes. You can use it with FullHD images as well.

image

Example

Initial image 00951-3078209812

Turn it into a drawing Stable_Diffusion_Dream2_0

Make it an evening scene brightly lit with fire Stable_Diffusion_Dream3_0