Viewing a single comment thread. View all comments

itsstylepoint OP t1_irjh4n3 wrote

Reply to comment by pm_me_your_ensembles in [N] I Have Released the YouTube Series Discussing and Implementing Activation Functions by itsstylepoint

Yup, all implementations are numerically stable.

Note that I do not discuss numerical stability issues for all activation functions, but for those where the intuitive implementation is not numerically stable (i.e., Sigmoid, Tanh).

I also have a separate video discussing numerical stability: AI/ML Model API Design and Numerical Stability (follow-up). But this is in the context of Gaussian Naive Bayes.

1