Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

[BUG in Stable Diffusion inference] There's an error on CUDAGraph when using deepspeed inference. How to fix it? #866

Open
foin6 opened this issue Feb 29, 2024 · 2 comments
Open

[BUG in Stable Diffusion inference] There's an error on CUDAGraph when using deepspeed inference. How to fix it? #866

foin6 opened this issue Feb 29, 2024 · 2 comments

Comments

@foin6
Copy link
Contributor

foin6 commented Feb 29, 2024

【Repo Link】:
Stable-Diffusion inference

【The Command used to run】:
deepspeed --num_gpus 1 test-stable-diffusion.py

【Envs】:

RTX 3090
deepspeed 0.12.6
torch 1.13.1
diffusers 0.26.1
triton 2.0.0.dev20221202

【Traceback information】:
image

It seems like the CUDAGraph is not available, which confused me a lot.
Please take time to review the issue and give me some feedback. Appreciate!
@foin6
Copy link
Contributor Author

foin6 commented Mar 11, 2024

Would be nice if someone can tell how to fix it.

@umchand
Copy link

umchand commented Mar 11, 2024

Can you try upgrading the torch to 2.2.1 and use the latest deepspeed ?

# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@foin6 @umchand