An expression as a graph: the forward pass fills in the values, and the backward pass walks a topological order from the output, sending gradients back by the chain rule, one edge at a time.
This interactive visualization needs JavaScript.