Skip to content
This repository has been archived by the owner on Mar 21, 2024. It is now read-only.

Fix: pl_find_unused_parameters was no longer used #547

Merged
merged 4 commits into from
Jul 27, 2021
Merged

Conversation

ant0nsc
Copy link
Contributor

@ant0nsc ant0nsc commented Jul 27, 2021

In #531, we accidentally removed pl_find_unused_parameters. Undoing that.

@ant0nsc ant0nsc requested a review from melanibe July 27, 2021 11:01
melanibe
melanibe previously approved these changes Jul 27, 2021
melanibe
melanibe previously approved these changes Jul 27, 2021
accelerator = "ddp" if effective_num_gpus > 1 else None
if effective_num_gpus > 1:
accelerator: Optional[str] = "ddp"
# Initialize the DDP plugin with find_unused_parameters=False by default. If True (default), it prints out
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the comment is a bit confusing for me, the default seems to be indicated 2 times with opposite values. Does this should be interpreted as suggestion to set pl_find_unused_parameters=False in the container? if yes I would slightly change as below.

Suggested change
# Initialize the DDP plugin with find_unused_parameters=False by default. If True (default), it prints out
# Initialize the DDP plugin with find_unused_parameters=False. If True (default), it prints out

Also, for my own understanding, where the user is setting up this default value for the container? maybe a comment there would help too?

@ant0nsc ant0nsc merged commit 988d9fa into main Jul 27, 2021
@ant0nsc ant0nsc deleted the antonsc/find_unused branch July 27, 2021 15:14
# for free to subscribe to this conversation on GitHub. Already have an account? #.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants