Continuous Memory Machines
Recurrent neural networks typically compress information into a single vector-valued recurrent state, forcing short-term computation and long-term retention to share the same representation. Past extensions alleviate this bottleneck by increasing the memory capacity or separating timescales, but lack the combination of...
Ciaran Regan, K. Arulkumaran, L. Darlow et al.
· 0 citations