Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Flux Optimizers should define equality #823

Open
oxinabox opened this issue Jul 29, 2019 · 3 comments · May be fixed by #1481
Open

Flux Optimizers should define equality #823

oxinabox opened this issue Jul 29, 2019 · 3 comments · May be fixed by #1481

Comments

@oxinabox
Copy link
Member

I was writing some tests, and I wanted to be sure that the hyper-parameters of two models were the same.
So I was checking equality on an object that contained all my hyperparameters,
including the optimizer (which has its own hyper-parameters).

Turns out that fails as

julia> Flux.Optimise.NADAM(0.003, (0.9, 0.9), IdDict{Any,Any}()) == Flux.Optimise.NADAM(0.003, (0.9, 0.9), IdDict{Any,Any}())
false
@DhairyaLGandhi
Copy link
Member

Should be much easier as we remove the states completely from the optimisers.

@MikeInnes
Copy link
Member

Yeah, this is not well defined right now but can happen as part of #637.

@ToucheSir
Copy link
Member

#637 has since been spun off as Optimisers.jl, which supports equality comparison OOTB :)

@darsnack darsnack linked a pull request Jun 14, 2021 that will close this issue
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants