RNNs Ghosted, LSTMs Goated: The Math Behind It

This blog explains the math behind LSTMs from scratch and shows how they solve the vanishing and exploding gradient problem in vanilla RNNs. Including the intuition behind the equations along with the implementation in Python.

August 12, 2025; 15 min read

• LSTM
• Neural-Networks
• Machine-Learning
• Math-Facts