Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Fix exception handling in get_all_ranks_from_group() function (#4862)
In the latest Pytorch nightly, the exception thrown from `torch.distributed.distributed_c10d.get_global_rank()` is changed from `RuntimeError` to `ValueError` so we need to update our try-catch in `deepspeed.comm` Tested with torch version 2.3.0.dev20231221+cu121 Fixes: #4853
- Loading branch information