Collaborative Layer-wise Discriminative Learning in Deep Neural Networks

Intermediate features at different layers of a deep neural network are known to be discriminative for visual patterns of different complexities. However, most existing works ignore such cross-layer heterogeneities when classifying samples of different complexities. For example, if a training sample has already been correctly classified at a specific layer with high confidence, we argue that it is unnecessary to enforce rest layers to classify this sample correctly and a better strategy is to encourage those layers to focus on other samples. In this paper, we propose a layer-wise discriminative learning method to enhance the discriminative capability of a deep network by allowing its layers to work collaboratively for classification. Towards this target, we introduce multiple classifiers on top of multiple layers. Each classifier not only tries to correctly classify the features from its input layer, but also coordinates with other classifiers to jointly maximize the final classification performance. Guided by the other companion classifiers, each classifier learns to concentrate on certain training examples and boosts the overall performance. Allowing for end-to-end training, our method can be conveniently embedded into state-of-the-art deep networks. Experiments with multiple popular deep networks, including Network in Network, GoogLeNet and VGGNet, on scale-various object classification benchmarks, including CIFAR100, MNIST and ImageNet, and scene classification benchmarks, including MIT67, SUN397 and Places205, demonstrate the effectiveness of our method. In addition, we also analyze the relationship between the proposed method and classical conditional random fields models.Comment: To appear in ECCV 2016. Maybe subject to minor changes before camera-ready versio

GPU-Based Data Processing for 2-D Microwave Imaging on MAST

The Synthetic Aperture Microwave Imaging (SAMI) diagnostic is a Mega Amp Spherical Tokamak (MAST) diagnostic based at Culham Centre for Fusion Energy. The acceleration of the SAMI diagnostic data-processing code by a graphics processing unit is presented, demonstrating acceleration of up to 60 times compared to the original IDL (Interactive Data Language) data-processing code. SAMI will now be capable of intershot processing allowing pseudo-real-time control so that adjustments and optimizations can be made between shots. Additionally, for the first time the analysis of many shots will be possible

Antihyperalgesia by α2-GABAA Receptors Occurs Via a Genuine Spinal Action and Does Not Involve Supraspinal Sites

Drugs that enhance GABAergic inhibition alleviate inflammatory and neuropathic pain after spinal application. This antihyperalgesia occurs mainly through GABAA receptors (GABAARs) containing α2 subunits (α2-GABAARs). Previous work indicates that potentiation of these receptors in the spinal cord evokes profound antihyperalgesia also after systemic administration, but possible synergistic or antagonistic actions of supraspinal α2-GABAARs on spinal antihyperalgesia have not yet been addressed. Here we generated two lines of GABAAR-mutated mice, which either lack α2-GABAARs specifically from the spinal cord, or, which express only benzodiazepine-insensitive α2-GABAARs at this site. We analyzed the consequences of these mutations for antihyperalgesia evoked by systemic treatment with the novel non-sedative benzodiazepine site agonist HZ166 in neuropathic and inflammatory pain. Wild-type mice and both types of mutated mice had similar baseline nociceptive sensitivities and developed similar hyperalgesia. However, antihyperalgesia by systemic HZ166 was reduced in both mutated mouse lines by about 60% and was virtually indistinguishable from that of global point-mutated mice, in which all α2-GABAARs were benzodiazepine insensitive. The major (α2-dependent) component of GABAAR-mediated antihyperalgesia was therefore exclusively of spinal origin, whereas supraspinal α2-GABAARs had neither synergistic nor antagonistic effects on antihyperalgesia. Our results thus indicate that drugs that specifically target α2-GABAARs exert their antihyperalgesic effect through enhanced spinal nociceptive control. Such drugs may therefore be well-suited for the systemic treatment of different chronic pain conditions

MemShield: GPU-assisted software memory encryption

Cryptographic algorithm implementations are vulnerable to Cold Boot attacks, which consist in exploiting the persistence of RAM cells across reboots or power down cycles to read the memory contents and recover precious sensitive data. The principal defensive weapon against Cold Boot attacks is memory encryption. In this work we propose MemShield, a memory encryption framework for user space applications that exploits a GPU to safely store the master key and perform the encryption/decryption operations. We developed a prototype that is completely transparent to existing applications and does not require changes to the OS kernel. We discuss the design, the related works, the implementation, the security analysis, and the performances of MemShield.Comment: 14 pages, 2 figures. In proceedings of the 18th International Conference on Applied Cryptography and Network Security, ACNS 2020, October 19-22 2020, Rome, Ital

DecGPU: distributed error correction on massively parallel graphics processing units using CUDA and MPI

<p>Abstract</p> <p>Background</p> <p>Next-generation sequencing technologies have led to the high-throughput production of sequence data (reads) at low cost. However, these reads are significantly shorter and more error-prone than conventional Sanger shotgun reads. This poses a challenge for the <it>de novo </it>assembly in terms of assembly quality and scalability for large-scale short read datasets.</p> <p>Results</p> <p>We present DecGPU, the first parallel and distributed error correction algorithm for high-throughput short reads (HTSRs) using a hybrid combination of CUDA and MPI parallel programming models. DecGPU provides CPU-based and GPU-based versions, where the CPU-based version employs coarse-grained and fine-grained parallelism using the MPI and OpenMP parallel programming models, and the GPU-based version takes advantage of the CUDA and MPI parallel programming models and employs a hybrid CPU+GPU computing model to maximize the performance by overlapping the CPU and GPU computation. The distributed feature of our algorithm makes it feasible and flexible for the error correction of large-scale HTSR datasets. Using simulated and real datasets, our algorithm demonstrates superior performance, in terms of error correction quality and execution speed, to the existing error correction algorithms. Furthermore, when combined with Velvet and ABySS, the resulting DecGPU-Velvet and DecGPU-ABySS assemblers demonstrate the potential of our algorithm to improve <it>de novo </it>assembly quality for <it>de</it>-<it>Bruijn</it>-graph-based assemblers.</p> <p>Conclusions</p> <p>DecGPU is publicly available open-source software, written in CUDA C++ and MPI. The experimental results suggest that DecGPU is an effective and feasible error correction algorithm to tackle the flood of short reads produced by next-generation sequencing technologies.</p

Vibration-induced extra torque during electrically-evoked contractions of the human calf muscles

<p>Abstract</p> <p>Background</p> <p>High-frequency trains of electrical stimulation applied over the lower limb muscles can generate forces higher than would be expected from a peripheral mechanism (i.e. by direct activation of motor axons). This phenomenon is presumably originated within the central nervous system by synaptic input from Ia afferents to motoneurons and is consistent with the development of plateau potentials. The first objective of this work was to investigate if vibration (sinusoidal or random) applied to the Achilles tendon is also able to generate large magnitude extra torques in the triceps surae muscle group. The second objective was to verify if the extra torques that were found were accompanied by increases in motoneuron excitability.</p> <p>Methods</p> <p>Subjects (n = 6) were seated on a chair and the right foot was strapped to a pedal attached to a torque meter. The isometric ankle torque was measured in response to different patterns of coupled electrical (20-Hz, rectangular 1-ms pulses) and mechanical stimuli (either 100-Hz sinusoid or gaussian white noise) applied to the triceps surae muscle group. In an additional investigation, M_maxand F-waves were elicited at different times before or after the vibratory stimulation.</p> <p>Results</p> <p>The vibratory bursts could generate substantial self-sustained extra torques, either with or without the background 20-Hz electrical stimulation applied simultaneously with the vibration. The extra torque generation was accompanied by increased motoneuron excitability, since an increase in the peak-to-peak amplitude of soleus F waves was observed. The delivery of electrical stimulation following the vibration was essential to keep the maintained extra torques and increased F-waves.</p> <p>Conclusions</p> <p>These results show that vibratory stimuli applied with a background electrical stimulation generate considerable force levels (up to about 50% MVC) due to the spinal recruitment of motoneurons. The association of vibration and electrical stimulation could be beneficial for many therapeutic interventions and vibration-based exercise programs. The command for the vibration-induced extra torques presumably activates spinal motoneurons following the size principle, which is a desirable feature for stimulation paradigms.</p

Chemogenomic Analysis of G-Protein Coupled Receptors and Their Ligands Deciphers Locks and Keys Governing Diverse Aspects of Signalling

Understanding the molecular mechanism of signalling in the important super-family of G-protein-coupled receptors (GPCRs) is causally related to questions of how and where these receptors can be activated or inhibited. In this context, it is of great interest to unravel the common molecular features of GPCRs as well as those related to an active or inactive state or to subtype specific G-protein coupling. In our underlying chemogenomics study, we analyse for the first time the statistical link between the properties of G-protein-coupled receptors and GPCR ligands. The technique of mutual information (MI) is able to reveal statistical inter-dependence between variations in amino acid residues on the one hand and variations in ligand molecular descriptors on the other. Although this MI analysis uses novel information that differs from the results of known site-directed mutagenesis studies or published GPCR crystal structures, the method is capable of identifying the well-known common ligand binding region of GPCRs between the upper part of the seven transmembrane helices and the second extracellular loop. The analysis shows amino acid positions that are sensitive to either stimulating (agonistic) or inhibitory (antagonistic) ligand effects or both. It appears that amino acid positions for antagonistic and agonistic effects are both concentrated around the extracellular region, but selective agonistic effects are cumulated between transmembrane helices (TMHs) 2, 3, and ECL2, while selective residues for antagonistic effects are located at the top of helices 5 and 6. Above all, the MI analysis provides detailed indications about amino acids located in the transmembrane region of these receptors that determine G-protein signalling pathway preferences