This work illustrates diagrams for recurrent neural networks, including vanilla RNN, LSTM, and Bi. The motivation behind this work is to understand and visualise what happens in these cells, and how the sequences are partitioned and transformed to produce the output nodes.

Vanilla Recurrent Neural Network

Long Short-Term Memory

Bidirectional Long Short-Term Memory

Seq2Seq (Encoder-Decoder LSTM)