tamanna-a / relu-activation Goto Github PK
View Code? Open in Web Editor NEWExamining Re-Lu activations, comparing weight initializers for re-lu, examining its gradients and when network collapses due to vanishing gradients. Lastly trying how Leaky Re-Lu helps in these sitations.