Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

"BatchNorm eval trick" in CBNet question #62

Open
zlenyk opened this issue Oct 9, 2023 · 0 comments
Open

"BatchNorm eval trick" in CBNet question #62

zlenyk opened this issue Oct 9, 2023 · 0 comments

Comments

@zlenyk
Copy link

zlenyk commented Oct 9, 2023

Hi!
I wanted to ask you about specific "eval trick" that you put in here:

# trick: eval have effect on BatchNorm only

It seems to put all modules in "self.cb_linears" into eval model, which generally sounds like a good idea, however I don't see any such batch-norm modules inside cb_linears.
Am I correct that this effectively does nothing? Or am I missing something?

Thank you!

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant