Why Are Deep Representations Good Perceptual Quality Features?

Recently, intermediate feature maps of pre-trained convolutional neural networks have shown significant perceptual quality improvements, when they are used in the loss function for training new networks. It is believed that these features are better at encoding the perceptual quality and provide more efficient representations of input images compared to other perceptual metrics such as SSIM and PSNR. However, there have been no systematic studies to determine the underlying reason. Due to the lack of such an analysis, it is not possible to evaluate the performance of a particular set of features or to improve the perceptual quality even more by carefully selecting a subset of features from a pre-trained CNN. This work shows that the capabilities of pre-trained deep CNN features in optimizing the perceptual quality are correlated with their success in capturing basic human visual perception characteristics. In particular, we focus our analysis on fundamental aspects of human perception, such as the contrast sensitivity and orientation selectivity. We introduce two new formulations to measure the frequency and orientation selectivity of the features learned by convolutional layers for evaluating deep features learned by widely-used deep CNNs such as VGG-16. We demonstrate that the pre-trained CNN features which receive higher scores are better at predicting human quality judgment. Furthermore, we show the possibility of using our method to select deep features to form a new loss function, which improves the image reconstruction quality for the well-known single-image super-resolution problem.Comment: To be presented at ECCV 202

Noise and Periodic Modulations in Neural Excitable Media

We have analyzed the interplay between noise and periodic modulations in a mean field model of a neural excitable medium. To this purpose, we have considered two types of modulations; namely, variations of the resistance and oscillations of the threshold. In both cases, stochastic resonance is present, irrespective of if the system is monostable or bistable.Comment: 13 pages, RevTex, 5 PostScript figure

Foci of orientation plasticity in visual cortex

[Abstract] Cortical areas are generally assumed to be uniform in their capacity for adaptive changes or plasticity1, 2, 3, 4. Here we demonstrate, however, that neurons in the cat striate cortex (V1) show pronounced adaptation-induced short-term plasticity of orientation tuning primarily at specific foci. V1 neurons are clustered according to their orientation preference in iso-orientation domains5 that converge at singularities or pinwheel centres6, 7. Although neurons in pinwheel centres have similar orientation tuning and responses to those in iso-orientation domains, we find that they differ markedly in their capacity for adaptive changes. Adaptation with an oriented drifting grating stimulus alters responses of neurons located at and near pinwheel centres to a broad range of orientations, causing repulsive shifts in orientation preference and changes in response magnitude. In contrast, neurons located in iso-orientation domains show minimal changes in their tuning properties after adaptation. The anisotropy of adaptation-induced orientation plasticity is probably mediated by inhomogeneities in local intracortical interactions that are overlaid on the map of orientation preference in V1

Invariant computations in local cortical networks with balanced excitation and inhibition

[Abstract] Cortical computations critically involve local neuronal circuits. The computations are often invariant across a cortical area yet are carried out by networks that can vary widely within an area according to its functional architecture. Here we demonstrate a mechanism by which orientation selectivity is computed invariantly in cat primary visual cortex across an orientation preference map that provides a wide diversity of local circuits. Visually evoked excitatory and inhibitory synaptic conductances are balanced exquisitely in cortical neurons and thus keep the spike response sharply tuned at all map locations. This functional balance derives from spatially isotropic local connectivity of both excitatory and inhibitory cells. Modeling results demonstrate that such covariation is a signature of recurrent rather than purely feed-forward processing and that the observed isotropic local circuit is sufficient to generate invariant spike tuning

A framework for the first‑person internal sensation of visual perception in mammals and a comparable circuitry for olfactory perception in Drosophila

Perception is a first-person internal sensation induced within the nervous system at the time of arrival of sensory stimuli from objects in the environment. Lack of access to the first-person properties has limited viewing perception as an emergent property and it is currently being studied using third-person observed findings from various levels. One feasible approach to understand its mechanism is to build a hypothesis for the specific conditions and required circuit features of the nodal points where the mechanistic operation of perception take place for one type of sensation in one species and to verify it for the presence of comparable circuit properties for perceiving a different sensation in a different species. The present work explains visual perception in mammalian nervous system from a first-person frame of reference and provides explanations for the homogeneity of perception of visual stimuli above flicker fusion frequency, the perception of objects at locations different from their actual position, the smooth pursuit and saccadic eye movements, the perception of object borders, and perception of pressure phosphenes. Using results from temporal resolution studies and the known details of visual cortical circuitry, explanations are provided for (a) the perception of rapidly changing visual stimuli, (b) how the perception of objects occurs in the correct orientation even though, according to the third-person view, activity from the visual stimulus reaches the cortices in an inverted manner and (c) the functional significance of well-conserved columnar organization of the visual cortex. A comparable circuitry detected in a different nervous system in a remote species-the olfactory circuitry of the fruit fly Drosophila melanogaster-provides an opportunity to explore circuit functions using genetic manipulations, which, along with high-resolution microscopic techniques and lipid membrane interaction studies, will be able to verify the structure-function details of the presented mechanism of perception

Mechanisms underlying a thalamocortical transformation during active tactile sensation

During active somatosensation, neural signals expected from movement of the sensors are suppressed in the cortex, whereas information related to touch is enhanced. This tactile suppression underlies low-noise encoding of relevant tactile features and the brain’s ability to make fine tactile discriminations. Layer (L) 4 excitatory neurons in the barrel cortex, the major target of the somatosensory thalamus (VPM), respond to touch, but have low spike rates and low sensitivity to the movement of whiskers. Most neurons in VPM respond to touch and also show an increase in spike rate with whisker movement. Therefore, signals related to self-movement are suppressed in L4. Fast-spiking (FS) interneurons in L4 show similar dynamics to VPM neurons. Stimulation of halorhodopsin in FS interneurons causes a reduction in FS neuron activity and an increase in L4 excitatory neuron activity. This decrease of activity of L4 FS neurons contradicts the "paradoxical effect" predicted in networks stabilized by inhibition and in strongly-coupled networks. To explain these observations, we constructed a model of the L4 circuit, with connectivity constrained by in vitro measurements. The model explores the various synaptic conductance strengths for which L4 FS neurons actively suppress baseline and movement-related activity in layer 4 excitatory neurons. Feedforward inhibition, in concert with recurrent intracortical circuitry, produces tactile suppression. Synaptic delays in feedforward inhibition allow transmission of temporally brief volleys of activity associated with touch. Our model provides a mechanistic explanation of a behavior-related computation implemented by the thalamocortical circuit

Changing behaviour 'more or less'-do theories of behaviour inform strategies for implementation and de-implementation? A critical interpretive synthesis

BACKGROUND: Implementing evidence-based care requires healthcare practitioners to do less of some things (de-implementation) and more of others (implementation). Variations in effectiveness of behaviour change interventions may result from failure to consider a distinction between approaches by which behaviour increases and decreases in frequency. The distinction is not well represented in methods for designing interventions. This review aimed to identify whether there is a theoretical rationale to support this distinction. METHODS: Using Critical Interpretative Synthesis, this conceptual review included papers from a broad range of fields (biology, psychology, education, business) likely to report approaches for increasing or decreasing behaviour. Articles were identified from databases using search terms related to theory and behaviour change. Articles reporting changes in frequency of behaviour and explicit use of theory were included. Data extracted were direction of behaviour change, how theory was operationalised, and theory-based recommendations for behaviour change. Analyses of extracted data were conducted iteratively and involved inductive coding and critical exploration of ideas and purposive sampling of additional papers to explore theoretical concepts in greater detail. RESULTS: Critical analysis of 66 papers and their theoretical sources identified three key findings: (1) 9 of the 15 behavioural theories identified do not distinguish between implementation and de-implementation (5 theories were applied to only implementation or de-implementation, not both); (2) a common strategy for decreasing frequency was substituting one behaviour with another. No theoretical basis for this strategy was articulated, nor were methods proposed for selecting appropriate substitute behaviours; (3) Operant Learning Theory makes an explicit distinction between techniques for increasing and decreasing frequency. DISCUSSION: Behavioural theories provide little insight into the distinction between implementation and de-implementation. Operant Learning Theory identified different strategies for implementation and de-implementation, but these strategies may not be acceptable in health systems. Additionally, if behaviour substitution is an approach for de-implementation, further investigation may inform methods or rationale for selecting the substitute behaviour

Analysis of 339 pregnancies in 181 women with 13 different forms of inherited thrombocytopenia

65Pregnancy in women with inherited thrombocytopenias is a major matter of concern as both the mothers and the newborns are potentially at risk of bleeding. However, medical management of this condition cannot be based on evidence because of the lack of consistent information in the literature. To advance knowledge on this matter, we performed a multicentric, retrospective study evaluating 339 pregnancies in 181 women with 13 different forms of inherited thrombocytopenia. Neither the degree of thrombocytopenia nor the severity of bleeding tendency worsened during pregnancy and the course of pregnancy did not differ from that of healthy subjects in terms of miscarriages, fetal bleeding and pre-term births. The degree of thrombocytopenia in the babies was similar to that in the mother. Only 7 of 156 affected newborns had delivery-related bleeding, but 2 of them died of cerebral hemorrhage. The frequency of delivery-related maternal bleeding ranged from 6.8% to 14.2% depending on the definition of abnormal blood loss, suggesting that the risk of abnormal blood loss was increased with respect to the general population. However, no mother died or had to undergo hysterectomy to arrest bleeding. The search for parameters predicting delivery-related bleeding in the mother suggested that hemorrhages requiring blood transfusion were more frequent in women with history of severe bleedings before pregnancy and with platelet count at delivery below 50 × 10(9)/L.openopenPatrizia Noris; Nicole Schlegel; Catherine Klersy; Paula G. Heller; Elisa Civaschi; Nuria Pujol-Moix; Fabrizio Fabris; Remi Favier; Paolo Gresele; Véronique Latger-Cannard; Adam Cuker; Paquita Nurden; Andreas Greinacher; Marco Cattaneo; Erica De Candia; Alessandro Pecci; Marie-Françoise Hurtaud-Roux; Ana C. Glembotsky; Eduardo Muñiz-Diaz; Maria Luigia Randi; Nathalie Trillot; Loredana Bury; Thomas Lecompte; Caterina Marconi; Anna Savoia; Carlo L. Balduini; Sophie Bayart; Anne Bauters; Schéhérazade Benabdallah-Guedira; Françoise Boehlen; Jeanne-Yvonne Borg; Roberta Bottega; James Bussel; Daniela De Rocco; Emmanuel de Maistre; Michela Faleschini; Emanuela Falcinelli; Silvia Ferrari; Alina Ferster; Tiziana Fierro; Dominique Fleury; Pierre Fontana; Chloé James; Francois Lanza; Véronique Le Cam Duchez; Giuseppe Loffredo; Pamela Magini; Dominique Martin-Coignard; Fanny Menard; Sandra Mercier; Annamaria Mezzasoma; Pietro Minuz; Ilaria Nichele; Lucia D. Notarangelo; Tommaso Pippucci; Gian Marco Podda; Catherine Pouymayou; Agnes Rigouzzo; Bruno Royer; Pierre Sie; Virginie Siguret; Catherine Trichet; Alessandra Tucci; Béatrice Saposnik; Dino VeneriPatrizia, Noris; Nicole, Schlegel; Catherine, Klersy; Paula G., Heller; Elisa, Civaschi; Nuria Pujol, Moix; Fabrizio, Fabris; Remi, Favier; Paolo, Gresele; Véronique Latger, Cannard; Adam, Cuker; Paquita, Nurden; Andreas, Greinacher; Marco, Cattaneo; Erica De, Candia; Alessandro, Pecci; Marie Françoise Hurtaud, Roux; Ana C., Glembotsky; Eduardo Muñiz, Diaz; Maria Luigia, Randi; Nathalie, Trillot; Loredana, Bury; Thomas, Lecompte; Caterina, Marconi; Savoia, Anna; Carlo L., Balduini; Sophie, Bayart; Anne, Bauters; Schéhérazade Benabdallah, Guedira; Françoise, Boehlen; Jeanne Yvonne, Borg; Bottega, Roberta; James, Bussel; DE ROCCO, Daniela; Emmanuel de, Maistre; Faleschini, Michela; Emanuela, Falcinelli; Silvia, Ferrari; Alina, Ferster; Tiziana, Fierro; Dominique, Fleury; Pierre, Fontana; Chloé, James; Francois, Lanza; Véronique Le Cam, Duchez; Giuseppe, Loffredo; Pamela, Magini; Dominique Martin, Coignard; Fanny, Menard; Sandra, Mercier; Annamaria, Mezzasoma; Pietro, Minuz; Ilaria, Nichele; Lucia D., Notarangelo; Tommaso, Pippucci; Gian Marco, Podda; Catherine, Pouymayou; Agnes, Rigouzzo; Bruno, Royer; Pierre, Sie; Virginie, Siguret; Catherine, Trichet; Alessandra, Tucci; Béatrice, Saposnik; Dino, Vener

Unraveling the complexity of global climate dynamics: interactions among El Niño-Southern Oscillation, Atlantic meridional overturning circulation, and tropical basins across different timescales

International audienceTropical basin interactions and the climatic linkages between mid-to-high latitudes and the tropics are active research areas. These interactions include the influence of El Niño–Southern Oscillation (ENSO) on the tropical Indian and Atlantic oceans, the feedback from these basins on ENSO, the influence of the tropics on mid-to-high-latitude climates, and the feedback from higher latitudes on tropical climate variability. This review summarizes the current understanding of these relationships and key underlying physical processes. In particular, we assessed the current knowledge of tropical variability and the interactions between the tropics and extratropics, including ENSO variability and diversity, the influence of ENSO on the tropical Atlantic and Indian Oceans, interactions among tropical basins on different timescales, variability in the Atlantic meridional overturning circulation (AMOC), the effect of tropical basins on the AMOC, the relationship between the AMOC and Atlantic multidecadal variability, the influence of the AMOC on ENSO and tropical variability, and the impact of other mid-to-high-latitude processes on tropical variability. Although ENSO is the dominant mode of variability on interannual timescales, its characteristics are not stationary and can be influenced by processes from other tropical basins and mid-to-high latitudes. The strength and variations of these interactions among different tropical basins and latitudes can be modulated by changes in external forcing, whether of natural or anthropogenic origin, and may also be shaped by nonlinear interactions between different modes of internal variability