Skip to content

✨[Feature] Parallelize Dynamo Converter, Backend, E2E Tests in CI #2139

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom
Closed
gs-olive opened this issue Jul 25, 2023 · 0 comments · Fixed by #2165
Closed

✨[Feature] Parallelize Dynamo Converter, Backend, E2E Tests in CI #2139

gs-olive opened this issue Jul 25, 2023 · 0 comments · Fixed by #2165
Assignees
@gs-olive
Labels
component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths feature request New feature or request Story: Dynamo Compile Improvements Issues relating to improvement of the Dynamo compile path

Comments

@gs-olive
Copy link
Collaborator

Context

Dynamo tests collectively take over an hour on PR #2070 due to the addition of many new converters. These tests can be parallelized in much the same way FX tests are, currently.

Proposal

Add parallelization to the Dynamo testing pipeline, similar to that which exists for FX. Begin with 4 parallel instances and split the tests from converters, backend, and e2e across those instances to speed up CI testing times.
@gs-olive gs-olive added feature request New feature or request component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths Story: Dynamo Compile Improvements Issues relating to improvement of the Dynamo compile path labels Jul 25, 2023
@gs-olive gs-olive mentioned this issue Aug 3, 2023
Merged
@gs-olive gs-olive self-assigned this Aug 3, 2023
# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees

@gs-olive gs-olive

Labels
component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths feature request New feature or request Story: Dynamo Compile Improvements Issues relating to improvement of the Dynamo compile path
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

chore: Add parallelism to Dynamo tests pytorch/TensorRT
1 participant
@gs-olive