Viewing a single comment thread. View all comments

ReasonablyBadass t1_jdx7f88 wrote on March 27, 2023 at 9:11 PM

I still remember the vanishing/exploding gradient problem. It seems to be a complete non issue now. Was it just Relus and skip connections that sovled it?

gmork_13 t1_je7gluu wrote on March 29, 2023 at 11:27 PM

And not using RNNs haha