Layer Normalization: Stabilizing Deep Learning Models

LayerNorm is a per-sample technique that stabilizes the training of deep neural networks by normalizing activations within each layer.