Continuous Recurrent Neural Networks Based on Function Satlins

作者:Yue Huang, Jiali Yu, Jinsong Leng, Bisen Liu, Zhang Yi

摘要

The brief investigates the coexistence of multiple continuous attractors in a recurrent neural network, i.e., the symmetric saturated Satlins linear neural networks, based on a parameterized 2-D model. The saturated parts of the unliner activation function are the breakthrough for us to study the coexistence. The novel point of our research method is linearization in nonlinear networks. A continuous attractor is a set of connected stable equilibrium points. On the basis of the theorem that we proved on stability and existing findings on equilibria in mathematics, we propose the conditions for the coexistence of two or even multiple continuous attractors in a recurrent neural network. Simulations are also demonstrated to illustrate the theoretical results.

论文关键词:Recurrent neural network, Dynamical system, Nonlinear activation function, Continuous attractors, Coexistence

论文评审过程:

论文官网地址:https://doi.org/10.1007/s11063-021-10682-9