This repository has been archived by the owner on Jul 7, 2023. It is now read-only.

Use of Layer Normalization #1910

Open

Andre1998Shuvam opened this issue Mar 19, 2022 · 0 comments

Andre1998Shuvam commented Mar 19, 2022

Hello! I would like to know why Layer Normalization and Residual connections have been used in the Transformer architecture.

# for free to subscribe to this conversation on GitHub. Already have an account? #.