Having Second Thoughts? Let's hear it

Deep learning models loosely mimic bottom-up signal pathways from low-order sensory areas to high-order cognitive areas. After training, DL models can outperform humans on some domain-specific tasks, but their decision-making process has been known to be easily disrupted. Since the human brain consists of multiple functional areas highly connected to one another and relies on intricate interplays between bottom-up and top-down (from high-order to low-order areas) processing, we hypothesize that incorporating top-down signal processing may make DL models more robust. To address this hypothesis, we propose a certification process mimicking selective attention and test if it could make DL models more robust. Our empirical evaluations suggest that this newly proposed certification can improve DL models' accuracy and help us build safety measures to alleviate their vulnerabilities with both artificial and natural adversarial examples.Comment: 13 pages, 11 figures, 1 table, 2 supplementary tables and 1 supplementary figur

Assessing Neuronal Interactions of Cell Assemblies during General Anesthesia

Understanding the way in which groups of cortical neurons change their individual and mutual firing activity during the induction of general anesthesia may improve the safe usage of many anesthetic agents. Assessing neuronal interactions within cell assemblies during anesthesia may be useful for understanding the neural mechanisms of general anesthesia. Here, a point process generalized linear model (PPGLM) was applied to infer the functional connectivity of neuronal ensembles during both baseline and anesthesia, in which neuronal firing rates and network connectivity might change dramatically. A hierarchical Bayesian modeling approach combined with a variational Bayes (VB) algorithm is used for statistical inference. The effectiveness of our approach is evaluated with synthetic spike train data drawn from small and medium-size networks (consisting of up to 200 neurons), which are simulated using biophysical voltage-gated conductance models. We further apply the analysis to experimental spike train data recorded from rats' barrel cortex during both active behavior and isoflurane anesthesia conditions. Our results suggest that that neuronal interactions of both putative excitatory and inhibitory connections are reduced after the induction of isoflurane anesthesia.National Institutes of Health (U.S.) (NIH Grants DP1-OD003646

Discrete- and Continuous-Time Probabilistic Models and Algorithms for Inferring Neuronal UP and DOWN States

UP and DOWN states, the periodic fluctuations between increased and decreased spiking activity of a neuronal population, are a fundamental feature of cortical circuits. Understanding UP-DOWN state dynamics is important for understanding how these circuits represent and transmit information in the brain. To date, limited work has been done on characterizing the stochastic properties of UP-DOWN state dynamics. We present a set of Markov and semi-Markov discrete- and continuous-time probability models for estimating UP and DOWN states from multiunit neural spiking activity. We model multiunit neural spiking activity as a stochastic point process, modulated by the hidden (UP and DOWN) states and the ensemble spiking history. We estimate jointly the hidden states and the model parameters by maximum likelihood using an expectation-maximization (EM) algorithm and a Monte Carlo EM algorithm that uses reversible-jump Markov chain Monte Carlo sampling in the E-step. We apply our models and algorithms in the analysis of both simulated multiunit spiking activity and actual multi- unit spiking activity recorded from primary somatosensory cortex in a behaving rat during slow-wave sleep. Our approach provides a statistical characterization of UP-DOWN state dynamics that can serve as a basis for verifying and refining mechanistic descriptions of this process.National Institutes of Health (U.S.) (Grant R01-DA015644)National Institutes of Health (U.S.) (Director Pioneer Award DP1- OD003646)National Institutes of Health (U.S.) (NIH/NHLBI grant R01-HL084502)National Institutes of Health (U.S.) (NIH institutional NRSA grant T32 HL07901

Modeling of whole brain sleep electroencephalogram using deep oscillatory neural network

This study presents a general trainable network of Hopf oscillators to model high-dimensional electroencephalogram (EEG) signals across different sleep stages. The proposed architecture consists of two main components: a layer of interconnected oscillators and a complex-valued feed-forward network designed with and without a hidden layer. Incorporating a hidden layer in the feed-forward network leads to lower reconstruction errors than the simpler version without it. Our model reconstructs EEG signals across all five sleep stages and predicts the subsequent 5 s of EEG activity. The predicted data closely aligns with the empirical EEG regarding mean absolute error, power spectral similarity, and complexity measures. We propose three models, each representing a stage of increasing complexity from initial training to architectures with and without hidden layers. In these models, the oscillators initially lack spatial localization. However, we introduce spatial constraints in the final two models by superimposing spherical shells and rectangular geometries onto the oscillator network. Overall, the proposed model represents a step toward constructing a large-scale, biologically inspired model of brain dynamics

Universality in spectral condensation

Self-organization is the spontaneous formation of spatial, temporal, or spatiotemporal patterns in complex systems far from equilibrium. During such self-organization, energy distributed in a broadband of frequencies gets condensed into a dominant mode, analogous to a condensation phenomenon. We call this phenomenon spectral condensation and study its occurrence in fluid mechanical, optical and electronic systems. We define a set of spectral measures to quantify this condensation spanning several dynamical systems. Further, we uncover an inverse power law behaviour of spectral measures with the power corresponding to the dominant peak in the power spectrum in all the aforementioned systems

Universality in spectral condensation

Self-organization is the spontaneous formation of spatial, temporal, or spatiotemporal patterns in complex systems far from equilibrium. During such self-organization, energy distributed in a broadband of frequencies gets condensed into a dominant mode, analogous to a condensation phenomena. We call this phenomenon spectral condensation and study its occurrence in fluid mechanical, optical and electronic systems. We define a set of spectral measures to quantify this condensation spanning several dynamical systems. Further, we uncover an inverse power law behaviour of spectral measures with the power corresponding to the dominant peak in the power spectrum in all the aforementioned systems.Comment: 5 pages, 3 figure

Thalamic model of awake alpha oscillations and implications for stimulus processing

We describe a unique conductance-based model of awake thalamic alpha and some of its implications for function. The full model includes a model for a specialized class of high-threshold thalamocortical cells (HTC cells), which burst at the alpha frequency at depolarized membrane potentials (∼−56 mV). Our model generates alpha activity when the actions of either muscarinic acetylcholine receptor (mAChR) or metabotropic glutamate receptor 1 (mGluR1) agonists on thalamic reticular (RE), thalamocortical (TC), and HTC cells are mimicked. In our model of mGluR1-induced alpha, TC cells are equally likely to fire during any phase of alpha, consistent with in vitro experiments. By contrast, in our model of mAChR-induced alpha, TC cells tend to fire either at the peak or the trough of alpha, depending on conditions. Our modeling suggests that low levels of mGluR1 activation on a background of mAChR agonists may be able to initiate alpha activity that biases TC cells to fire at certain phases of alpha, offering a pathway for cortical control. If we introduce a strong stimulus by increasing the frequency of excitatory postsynaptic potentials (EPSPs) to TC cells, an increase in alpha power is needed to mimic the level of phasing of TC cells observed in vivo. This increased alpha power reduces the probability that TC cells spike near the trough of alpha. We suggest that mAChR-induced alpha may contribute to grouping TC activity into discrete perceptual units for processing, whereas mGluR1-induced alpha may serve the purpose of blocking unwanted stimuli from reaching the cortex.</jats:p

A Time-Series Model of Phase Amplitude Cross Frequency Coupling and Comparison of Spectral Characteristics with Neural Data

Stochastic processes that exhibit cross-frequency coupling (CFC) are introduced. The ability of these processes to model observed CFC in neural recordings is investigated by comparison with published spectra. One of the proposed models, based on multiplying a pulsatile function of a low-frequency oscillation (θ) with an unobserved and high-frequency component, yields a process with a spectrum that is consistent with observation. Other models, such as those employing a biphasic pulsatile function of a low-frequency oscillation, are demonstrated to be less suitable. We introduce the full stochastic process time series model as a summation of three component weak-sense stationary (WSS) processes, namely, θ, γ, and η, with η a 1/fα noise process. The γ process is constructed as a product of a latent and unobserved high-frequency process x with a function of the lagged, low-frequency oscillatory component (θ). After demonstrating that the model process is WSS, an appropriate method of simulation is introduced based upon the WSS property. This work may be of interest to researchers seeking to connect inhibitory and excitatory dynamics directly to observation in a model that accounts for known temporal dependence or to researchers seeking to examine what can occur in a multiplicative time-domain CFC mechanism