Timezone: »
A non--linear dynamic system is called contracting if initial conditions are forgotten exponentially fast, so that all trajectories converge to a single trajectory which is the solution of the system. We use contraction theory to derive an upper bound for the strength of recurrent connections that guarantees contraction for complex neural networks. Specifically, we apply this theory to a special class of recurrent networks which are an abstract representation of the cooperative-competitive connectivity observed in cortex and often called Cooperative Competitive Networks (CCNs). This specific type of network is believed to play a major role in shaping cortical responses and selecting the relevant signal among distractors and noise. In this paper, we analyze contraction of combined CCNs of linear threshold units and verify the results of our analysis in a hybrid analog/digital VLSI CCN comprising spiking neurons and dynamic synapses.
Author Information
Emre Neftci (Institute of Neuroinformatics)
Elisabetta Chicca (Bielefeld University)
Giacomo Indiveri (ETH Zurich)
Jean-Jacques Slotine (Massachusetts Institute of Technology)
Rodney J Douglas (Institute of Neuroinformatics)
Related Events (a corresponding poster, oral, or spotlight)
-
2007 Poster: Contraction Properties of VLSI Cooperative Competitive Neural Networks of Spiking Neurons »
Wed. Dec 5th 06:30 -- 06:40 PM Room
More from the Same Authors
-
2021 : A Unified Approach to Obstacle Avoidance and Motion Learning »
Lukas Huber · Aude G Billard · Jean-Jacques Slotine -
2022 Poster: RNNs of RNNs: Recursive Construction of Stable Assemblies of Recurrent Neural Networks »
Leo Kozachkov · Michaela Ennis · Jean-Jacques Slotine -
2020 Poster: Ode to an ODE »
Krzysztof Choromanski · Jared Quincy Davis · Valerii Likhosherstov · Xingyou Song · Jean-Jacques Slotine · Jacob Varley · Honglak Lee · Adrian Weller · Vikas Sindhwani -
2013 Poster: Recurrent networks of coupled Winner-Take-All oscillators for solving constraint satisfaction problems »
Hesham Mostafa · Lorenz K Muller · Giacomo Indiveri -
2012 Poster: Multiclass Learning with Simplex Coding »
Youssef Mroueh · Tomaso Poggio · Lorenzo Rosasco · Jean-Jacques Slotine -
2012 Poster: Synchronization can Control Regularization in Neural Systems via Correlated Noise Processes »
Jake Bouvrie · Jean-Jacques Slotine -
2007 Oral: Learning to classify complex patterns using a VLSI network of spiking neurons »
Srinjoy Mitra · Giacomo Indiveri · Stefano Fusi -
2007 Poster: Learning to classify complex patterns using a VLSI network of spiking neurons »
Srinjoy Mitra · Giacomo Indiveri · Stefano Fusi -
2007 Demonstration: Contraction of VLSI Spiking Neurons »
Emre Neftci · Elisabetta Chicca · Giacomo Indiveri · Jean-Jacques Slotine · Rodney J Douglas -
2006 Poster: Context dependent amplification of both rate and event-correlation in a VLSI network of spiking neurons »
Elisabetta Chicca · Giacomo Indiveri · Rodney J Douglas -
2006 Spotlight: Context dependent amplification of both rate and event-correlation in a VLSI network of spiking neurons »
Elisabetta Chicca · Giacomo Indiveri · Rodney J Douglas -
2006 Poster: A selective attention multi--chip system with dynamic synapses and spiking neurons »
Chiara Bartolozzi · Giacomo Indiveri -
2006 Poster: Attentional Processing on a Spike-Based VLSI Neural Network »
Yingxue Wang · Rodney J Douglas · Shih-Chii Liu