What If Neural Networks Could Sleep?

After building increasingly elaborate optimizers, the thing that actually improved training was a boolean switch on dropout — applied only…