Do Activation Functions Cause Vanishing Gradient Problems?

Vanishing vs Exploding Gradients Explained Visually | WAYSOM Whiteboard

3.5: Mathematics of Gradient Descent - Intelligence and Learning

Gradient Descent Equations - Mathematical Derivation [Machine Learning Tutorial]

Vanishing Gradient Problem in ANN | Exploding Gradient Problem | Code Example

From Residual Connections to Manifold-Constrained Hyper-Connections: Neural Network Architecture

RNNs vs LSTMs Explained Simply | How Neural Networks Understand Sequences