Neura saysBackpropagation efficiently computes the gradient for every weight via the chain rule.
To do gradient descent in a deep net, you need each weight's gradient. Backprop computes them in one backward pass: run the input forward to get the loss, then propagate the error backward layer by layer using the chain rule, reusing intermediate results. It's what makes training deep networks computationally feasible — the algorithm that powers all modern deep learning.
Power-ups you unlock
Forward pass → loss; backward pass → gradients
Chain rule, layer by layer
Reuses intermediates (efficient)
Makes deep-net training feasible
The Overfit Ogre attacks — common mistakes
Thinking gradients are computed per-weight separately
Confusing the forward and backward passes
Vanishing/exploding gradients in very deep nets
Boss battleDescribe the forward-then-backward flow of one training step.
Example code
<!doctype html><html><head><meta charset="utf-8"></head>
<body style="background:#06040d;color:#e6e0ff;font-family:monospace;padding:20px"><pre>forward: input → layers → prediction → loss
backward: loss → gradients back through layers (chain rule)
update weights → repeat</pre></body></html>