New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

微调时无法使用FP16损失为nan #58

Open

WangYuhang123 opened this issue May 31, 2023 · 0 comments

WangYuhang123 commented May 31, 2023

您好，我在尝试微调过程中开启FP16加速训练，但loss一直为nan，想问下您如何使用FP16微调chatyuan，感谢！

# for free to join this conversation on GitHub. Already have an account? # to comment