Create a img2img (+ inpainting) controlnet pipeline

[tiimgreen]

Is your feature request related to a problem? Please describe.
In auto1111 I can use img2img with inpainting in combination with controlnet canny edge detection to generate a new image.

With current tools in diffusers it appears I can't do that. I can only do text2img with controlnet

Describe the solution you'd like
A new pipeline StableDiffusionImg2ImgControlNetPipeline or something similar which will allow img2img with inpainting and controlnet

Describe alternatives you've considered
Tried with auto1111 and works perfectly but can't use diffusers library for it

[yiyixuxu]

Hi @tiimgreen

we have a community pipeline here
#2561

YiYi

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

[patrickvonplaten]

Think we should move them to source cc @yiyixuxu @williamberman

[kadirnar]

@patrickvonplaten ,@yiyixuxu

Can we do Inpaint using Image2Image(openjourney, anythingv4...) models?

#1825 (comment)
I've seen this but controlnet doesn't support it. I want to do Controlnet + Img2Img + Inpaint.

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

[patrickvonplaten]

One can do controlnet img2img & inpaint with the pipelines here: #3533

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.