New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

[DOC]: Update the documentation of ShardConfig for 1D, 2D, 2.5D, 3D tensor parallelism #6197

Open

giriprasad51 opened this issue Feb 18, 2025 · 0 comments

Labels

giriprasad51 commented Feb 18, 2025

📚 The doc issue

Hi @FrankLeeeee , @ver217 please update the https://github.com/hpcaitech/ColossalAI/blob/main/colossalai/shardformer/README.md file

# tensor_parallel_mode: Literal['1d', '2d', '2.5d', '3d'] this line is commented in ShardConfig but documentation is not updated Its hard to use 2D,2.5D, 3D tensor parallelism

The text was updated successfully, but these errors were encountered:

giriprasad51 added the documentation label

# for free to join this conversation on GitHub. Already have an account? # to comment