LSTMs, designed to address the limitations of RNNs, showed a clear trend of improving performance as window size increased, peaking at a window size of 128 due to their ability to store and process longer temporal dependencies using gating mechanisms.
1
—
—