Enabled high-performance Automatic Tensor Parallelism (auto TP) for the Qwen2-MoE and DeepSeek-V2 models on multiple GPUs/HPUs #12950
Run time
Learn about OS # on GitHub ActionsJob | Run time |
---|---|
1h 33m 14s | |
1h 33m 14s |
Job | Run time |
---|---|
1h 33m 14s | |
1h 33m 14s |