Divisive Normalization Shapes Low-Rank Slow Manifolds for Continuous Working Memory

Zhaotian Gu, Jie SU, Weiwei Wang, Chang Liu, Tianyi Qian, Dahui Wang

Action editor: Gitta Kutyniok

https://openreview.net/forum?id=a43l19lyfC

#rnns #normalization #backpropagation

2/By training ants with local vision and path context via #backpropagation and #REINFORCE, NAnts can collaboratively paint complex shapes like geckos, butterflies, and snails.

Even if partially erased or started anywhere on the grid, they dynamically repair the image! 🦎✨