Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

weight updates should be done with beta=1 #105

Merged
merged 1 commit into from
Jan 21, 2016

Conversation

drnikolaev
Copy link

As per Natalia:
Line 90 of cudnn_batch_norm_layer.cu should be
cudnn::dataType::one

  • weight updates should be done with beta=1, similar to how they are done for convolutional layers, so that updates can be potentially accumulated over a few batches.

thatguymike added a commit that referenced this pull request Jan 21, 2016
weight updates should be done with beta=1
@thatguymike thatguymike merged commit b9b83d4 into NVIDIA:caffe-0.14 Jan 21, 2016
@drnikolaev drnikolaev deleted the fix2 branch January 27, 2016 19:26
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants