Read a sentence one word at a time, carrying a memory from each word to the next. A plain RNN’s memory of the first word fades; an LSTM’s gated cell carries it, and the product of factors shows why.
This interactive visualization needs JavaScript.