Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Support pipeline parallelism #222

Open
taehyunzzz opened this issue Feb 18, 2025 · 0 comments
Open

Support pipeline parallelism #222

taehyunzzz opened this issue Feb 18, 2025 · 0 comments

Comments

@taehyunzzz
Copy link

taehyunzzz commented Feb 18, 2025

Any plans to support pipeline parallel (e.g., layer 0-10 on GPU1 and layer 11-20 on GPU2)?

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant