BLOCK: Bilinear Superdiagonal Fusion for Visual Question Answering and Visual Relationship Detection

Multimodal representation learning is gaining more and more interest within the deep learning community. While bilinear models provide an interesting framework to find subtle combination of modalities, their number of parameters grows quadratically with the input dimensions, making their practical implementation within classical deep learning pipelines challenging. In this paper, we introduce BLOCK, a new multimodal fusion based on the block-superdiagonal tensor decomposition. It leverages the notion of block-term ranks, which generalizes both concepts of rank and mode ranks for tensors, already used for multimodal fusion. It allows to define new ways for optimizing the tradeoff between the expressiveness and complexity of the fusion model, and is able to represent very fine interactions between modalities while maintaining powerful mono-modal representations. We demonstrate the practical interest of our fusion model by using BLOCK for two challenging tasks: Visual Question Answering (VQA) and Visual Relationship Detection (VRD), where we design end-to-end learnable architectures for representing relevant interactions between modalities. Through extensive experiments, we show that BLOCK compares favorably with respect to state-of-the-art multimodal fusion models for both VQA and VRD tasks. Our code is available at https://github.com/Cadene/block.bootstrap.pytorch

Benchmark Analysis of Representative Deep Neural Network Architectures

This work presents an in-depth analysis of the majority of the deep neural networks (DNNs) proposed in the state of the art for image recognition. For each DNN multiple performance indices are observed, such as recognition accuracy, model complexity, computational complexity, memory usage, and inference time. The behavior of such performance indices and some combinations of them are analyzed and discussed. To measure the indices we experiment the use of DNNs on two different computer architectures, a workstation equipped with a NVIDIA Titan X Pascal and an embedded system based on a NVIDIA Jetson TX1 board. This experimentation allows a direct comparison between DNNs running on machines with very different computational capacity. This study is useful for researchers to have a complete view of what solutions have been explored so far and in which research directions are worth exploring in the future; and for practitioners to select the DNN architecture(s) that better fit the resource constraints of practical deployments and applications. To complete this work, all the DNNs, as well as the software used for the analysis, are available online.Comment: Will appear in IEEE Acces

INITIAL INSIGHTS INTO THE STRUCTURE-ACTIVITY RELATIONSHIPS OF AVIAN DEFENSINS.

Numerous β-defensins have been identified in birds and the potential use of these peptides as alternatives to antibiotics has been proposed, in particular to fight antibiotic-resistant and zoonotic bacterial species. Little is known about the mechanism of antibacterial activity of avian β-defensins (AvBDs), and the present work was carried out to obtain initial insights into the involvement of structural features or specific residues in the antimicrobial activity of chicken AvBD2. Chicken AvBD2 and its enantiomeric counterpart were chemically synthesized. Peptide elongation and oxidative folding were both optimized. The similar antimicrobial activity measured for both L- and D- proteins clearly indicates that there is no chiral partner. Therefore the bacterial membrane is in all likelihood the primary target. Moreover, this work evidences that the three-dimensional fold is required for an optimal antimicrobial activity, in particular for Gram-positive bacterial strains. The three-dimensional NMR structure of chicken AvBD2 defensin displays the structural 3-stranded antiparallel β-sheet characteristic of β-defensins. The surface of the molecule does not display any amphipathic character. In light of this new structure and of the king penguin AvBD103b defensin structure, the consensus sequence of avian β-defensin's family was analyzed. Well conserved residues were highlighted and the potential strategic role of the lysine 31 residue of AvBD2 emphasized. The synthetic AvBD2-K31A variant displayed substantial N-terminal structural modifications and a dramatic decrease in activity. Taken together, these results demonstrate the structural as well as the functional role of the critical lysine 31 residue in antimicrobial activity

Vanadyl sulfate inhibits NO production via threonine phosphorylation of eNOS.

Exposure to excessive vanadium occurs in some occupations and with consumption of some dietary regimens for weight reduction and body building. Because vanadium is vasoactive, individuals exposed to excessive vanadium may develop adverse vascular effects. We have previously shown that vanadyl sulfate causes acute pulmonary vasoconstriction, which could be attributed in part to inhibition of nitric oxide production. In the present study we investigated whether NO inhibition was related to phosphorylation of endothelial nitric oxide synthase (eNOS). VOSO4 produced dose-dependent constriction of pulmonary arteries in isolated perfused lungs and pulmonary arterial rings and a right shift of the acetylcholine-dependent vasorelaxation curve. VOSO4 inhibited constitutive as well as A23187-stimulated NO production. Constitutive NO inhibition was accompanied by increased Thr495 (threonine at codon 495) phosphorylation of eNOS, which would inhibit eNOS activity. Thr495 phosphorylation of eNOS and inhibition of NO were partially reversed by pretreatment with calphostin C, a protein kinase C (PKC) inhibitor. There were no changes in Ser1177 (serine at codon 1177) or tyrosine phosphorylation of eNOS. These results indicate that VOSO4 induced acute pulmonary vasoconstriction that was mediated in part by the inhibition of endothelial NO production via PKC-dependent phosphorylation of Thr495 of eNOS. Exposure to excessive vanadium may contribute to pulmonary vascular diseases

Economic and environmental assessment of recovery and disposal pathways for CFRP waste management

The high cost and energy intensity of virgin carbon fibre manufacturing constitute a challenge to recover substantial value from carbon fibre reinforced polymers (CFRP). The objective of this study is to assess the environmental and financial viability of several waste management processes for CFRP. Life cycle costing and environmental assessment models are developed to quantify the financial and environmental impacts of waste treatment pathways comparing a panel of recycling techniques that are now available (grinding, pyrolysis, microwave and supercritical water) and that can be used to substitute different grades of both carbon and glass fibres by recycled carbon fibres at competitive prices compared to landfill and incineration. GWP assessment promotes recycling activities by recovery of carbon fibre due to the high avoided impacts from substitution of virgin fibre, thus highlighting the high interest of recycling over conventional production for environmental purpose. Fibre recovery rate and recycling capacity are pivotal to decrease the unit cost of recycled fibre as well as GWP impacts. The advantages and drawbacks of each technique are analysed through economic and environmental indicators, to better understand the network configuration for optimisation purpose of waste management pathway in a holistic viewpoint

Improved protocol for metabolite extraction and identification of respiratory quinones in extremophilic Archaea grown on mineral materials

We investigated the metabolome of the iron- and sulfur-oxidizing, extremely thermoacidophilic archaeon Metallosphaera sedula grown on mineral pyrite (FeS2). The extraction of organic materials from these microorganisms is a major challenge because of the tight contact and interaction between cells and mineral materials. Therefore, we applied an improved protocol to break the microbial cells and separate their organic constituents from the mineral surface, to extract lipophilic compounds through liquid–liquid extraction, and performed metabolomics analyses using MALDI-TOF MS and UHPLC-UHR-Q/TOF. Using this approach, we identified several molecules involved in central carbon metabolism and in the modified Entner-Doudoroff pathway found in Archaea, sulfur metabolism-related compounds, and molecules involved in the adaptation of M. sedula to extreme environments, such as metal tolerance and acid resistance. Furthermore, we identified molecules involved in microbial interactions, i.e., cell surface interactions through biofilm formation and cell–cell interactions through quorum sensing, which relies on messenger molecules for microbial communication. Moreover, we successfully extracted and identified different saturated thiophene-bearing quinones using software for advanced compound identification (MetaboScape). These quinones are respiratory chain electron carriers in M. sedula, with biomarker potential for life detection in extreme environmental conditions

Discovery and characterisation of a novel toxin from Dendroaspis angusticeps, named Tx7335, that activates the potassium channel KcsA

Due to their central role in essential physiological processes, potassium channels are common targets for animal toxins. These toxins in turn are of great value as tools for studying channel function and as lead compounds for drug development. Here, we used a direct toxin pull-down assay with immobilised KcsA potassium channel to isolate a novel KcsA-binding toxin (called Tx7335) from eastern green mamba snake (Dendroaspis angusticeps) venom. Sequencing of the toxin by Edman degradation and mass spectrometry revealed a 63 amino acid residue peptide with 4 disulphide bonds that belongs to the three-finger toxin family, but with a unique modification of its disulphide-bridge scaffold. The toxin induces a dose-dependent increase in both open probabilities and mean open times on KcsA in artificial bilayers. Thus, it unexpectedly behaves as a channel activator rather than an inhibitor. A charybdotoxinsensitive mutant of KcsA exhibits similar susceptibility to Tx7335 as wild-type, indicating that the binding site for Tx7335 is distinct from that of canonical pore-blocker toxins. Based on the extracellular location of the toxin binding site (far away from the intracellular pH gate), we propose that Tx7335 increases potassium flow through KcsA by allosterically reducing inactivation of the channel