Integrate Lumina-T2X

[PommesPeter]

Model/Pipeline/Scheduler description

Lumina-T2X is a text-to-any generation model. Our model is capable of generating multiple modalities, most notably image generation. Currently, our image generation supports any resolution, achieving stunning results. We will unify various modalities and integrate them into diffusers, including controlnet, Lora fine-tune, compositional generation, etc.

Paper: Lumina-Next
Paper: Lumina-T2X

Open source status

• The model implementation is available.
• The model weights are available (Only relevant if addition is not a scheduler).

Provide useful links for the implementation

Weight v1: https://huggingface.co/Alpha-VLLM/Lumina-Next-T2I
Weight v2: https://huggingface.co/Alpha-VLLM/Lumina-Next-SFT
Code: https://github.com/Alpha-VLLM/Lumina-T2X/
HF Space: https://huggingface.co/spaces/Alpha-VLLM/Lumina-Next-T2I

[PommesPeter]

We are currently preparing our code to integrate diffusers.

[xhinker]

This model is SO cool

[yiyixuxu]

@PommesPeter look forward to the PR!

[PommesPeter]

PR here: #8652

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

[a-r-r-o-w]

I think we can close this since Lumina has been integrated. Thanks @PommesPeter!