Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Add Flux inpainting pipeline #9148

Closed
2 tasks done
AmericanPresidentJimmyCarter opened this issue Aug 11, 2024 · 4 comments
Closed
2 tasks done

Add Flux inpainting pipeline #9148

AmericanPresidentJimmyCarter opened this issue Aug 11, 2024 · 4 comments

Comments

@AmericanPresidentJimmyCarter
Copy link
Contributor

Model/Pipeline/Scheduler description

There is a lot of discussion and colabs here: https://old.reddit.com/r/StableDiffusion/comments/1epi1d0/flux_better_than_photoshop_for_inpainting/

Open source status

  • The model implementation is available.
  • The model weights are available (Only relevant if addition is not a scheduler).

Provide useful links for the implementation

No response

@Gothos
Copy link
Contributor

Gothos commented Aug 12, 2024

Well my PR #9135 does add in Inpainting and is currently drafted because it doesn't do some stuff. You could take a look at that for now, if you wish.

@anilsathyan7
Copy link

@Gothos Is there a way to reduce GPU vram usage for inpaint? The schnell bf16 version does not seem to work even with 32 gb GPU.
Ref:
https://huggingface.co/spaces/SkalskiP/FLUX.1-inpaint-dev/blob/main/app.py
https://huggingface.co/black-forest-labs/FLUX.1-schnell/discussions/5

@datong-new
Copy link

https://github.com/yishaoai/flux-controlnet-inpaint/ support flux + controlnet + inpaint. Thanks for the work of @Gothos, and we extend the inpainting with flux controlnet.

@AmericanPresidentJimmyCarter
Copy link
Contributor Author

Closed because merged

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants