New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

error in eval loss & ppl #147

Open

dar-tau opened this issue Sep 28, 2021 · 0 comments

dar-tau commented Sep 28, 2021

Hey!

reformer-pytorch/pretraining/self-supervised.py

Line 327 in 2cbc36b

eval_loss /= eval_steps

you are dividing the eval_loss & perplexity each time you pass through the loop

Cheers,
Guy :)

# for free to join this conversation on GitHub. Already have an account? # to comment