Investigating Information Transmissions In Neural Networks

Investigation of the role of the local field potential (LFP) fluctuations in encoding the nervous system’s received sensory information remains largely unknown. On the other hand, the transmission of these translation rules in information transmission between the structure of sensory stimuli and the cortical oscillations to the bio-inspired artificial neural networks operating at the efficiency of the nervous system is still a vague puzzle.

In order to achieve this important goal, computational neuroscience tools can be useful. Therefore, we simulated a large-scale network of excitatory and inhibitory spiking neurons with synaptic connections consisting of AMPA and GABA currents as a model of cortical populations. Based on empirical observations of the learning process in the brain, we developed a spike-based unsupervised weight optimization based on the dynamical behavior of the excitatory (AMPA) and inhibitory (GABA) synapses using Spike Timing Dependent Plasticity (STDP) in identifying MNIST dataset, and we achieved a performance of 96.1%.

Then, we assumed that the information of the trained patterns was stored in the network, which in turn caused the output fluctuations (LFP oscillation) and input patterns, which included shared information. We tested this hypothesis with some steps. First, we computed the LFP and the power spectrum of LFP, and we observed that by applying each digit to the trained network, a peak has appeared at frequencies of 60 to 100 Hz in the LFP power spectrum of a corresponding classifying neuron. Second, we calculated the mutual, joint and redundancy information between the LFP power at frequency f and the input digit. According to the results, we concluded that our assumption was correct, and the input and output of the spiking network were contained shared information; in other words, input pattern information was encoded in the LFP power spectrum.

In the next step, we were looking to propose a more accurate description of the computed quantitative information, which brought us to the topic of Prolate spheroidal wave functions (PSWFs). The interesting result was that the PSWF coefficients of input with the MSE criterion and the output LFP power spectrum with the CIM criterion was equal. The valuable result was that 82.3% of PSWF coefficients of the input digit were the same as the connecting weights of the cortical neurons to the classifying neurons after the completion of the training process. This high percentage of matching between coefficients and synaptic weights can be a gateway to the discovery of the encoding principles of the information transmission in the nervous system.

We introduced the new concept of “cortical spiking model as the information channel transmits input information to the output oscillations in the form of PSWF coefficients.” Given that, the proposed concept has significant application in neuroscience, as well as in the computational capability of spiking network and learning in artificial intelligence; this article is a new horizon following the Hopfieldʼs challenge that will provide intelligence network with the power to compete with the human brain in real-world applications.

These findings are described in the article entitled A new approach to detect the coding rule of the cortical spiking model in the information transmission, recently published in the journal Neural NetworksThis work was conducted by Soheila Nazari and Karim Faez from the Amirkabir University of Technology, and Mahyar Janahmadi from the Shahid Beheshti University of Medical Sciences.

Speak Your Mind!

READ THIS NEXT

Study Finds Humans Have More Empathy For Dogs Than Other People

The internet is filled with cute videos of kittens and puppies doing mundane things that transform into a feast of […]

Searching For Protists In The Vistula River Estuary

Tropical rainforests are often referred to as an Earth’s lungs and are hotspots for biological diversity. However, few are aware […]

What Are Expressed Powers: Definition And Examples

With respect to the United States legal and political system, the expressed powers (also called enumerated powers or delegated powers) are those powers […]

Biased And Crossmap Dropout Strategies For Convolutional Neural Networks

Over the last decade, deep learning models, particularly Convolutional Neural Networks (CNN), have shown outstanding results in various fields, including […]

Enzyme-free Ligation Of Oligonucleotides In A DNA Nanostructure

Modern methods in medicine and synthetic biology require very long DNA strands, in particular with the advent of the increasingly […]

What Are Emergent Properties? Definition And Examples

Emergent properties are properties that manifest themselves as the result of various system components working together, not as a property […]

Costs And Benefits Of Bioenergy Alternatives For Birds

A predicament the United States faces is the simultaneous threat of climate change and the rising energy demands of its […]