EIGEN: Ecologically-Inspired GENetic Approach for Neural Network Structure Searching from Scratch

Designing the structure of neural networks is considered one of the most challenging tasks in deep learning, especially when there is few prior knowledge about the task domain. In this paper, we propose an Ecologically-Inspired GENetic (EIGEN) approach that uses the concept of succession, extinction, mimicry, and gene duplication to search neural network structure from scratch with poorly initialized simple network and few constraints forced during the evolution, as we assume no prior knowledge about the task domain. Specifically, we first use primary succession to rapidly evolve a population of poorly initialized neural network structures into a more diverse population, followed by a secondary succession stage for fine-grained searching based on the networks from the primary succession. Extinction is applied in both stages to reduce computational cost. Mimicry is employed during the entire evolution process to help the inferior networks imitate the behavior of a superior network and gene duplication is utilized to duplicate the learned blocks of novel structures, both of which help to find better network structures. Experimental results show that our proposed approach can achieve similar or better performance compared to the existing genetic approaches with dramatically reduced computation cost. For example, the network discovered by our approach on CIFAR-100 dataset achieves 78.1% test accuracy under 120 GPU hours, compared to 77.0% test accuracy in more than 65, 536 GPU hours in [35].Comment: CVPR 201

Amorphization of embedded Cu nanocrystals by ion irradiation

While bulk crystalline elemental metals cannot be amorphized by ion irradiation in the absence of chemical impurities, the authors demonstrate that finite-size effects enable the amorphization of embedded Cu nanocrystals. The authors form and compare the atomic-scale structure of the polycrystalline, nanocrystalline, and amorphous phases, present an explanation for the extreme sensitivity to irradiation exhibited by nanocrystals, and show that low-temperature annealing is sufficient to return amorphized material to the crystalline form

Pathology Imaging Informatics for Clinical Practice and Investigative and Translational Research

Pathologists routinely interpret gross and microscopic specimens to render diagnoses and to engage in a broad spectrum of investigative research. Multiple studies have demonstrated that imaging technologies have progressed to a level at which properly digitized specimens provide sufficient quality comparable to the traditional glass slides examinations. Continued advancements in this area will have a profound impact on the manner in which pathology is conducted from this point on. Several leading institutions have already undertaken ambitious projects directed toward digitally imaging, archiving, and sharing pathology specimens. As a result of these advances, the use of informatics in diagnostic and investigative pathology applications is expanding rapidly. In addition, the advent of novel technologies such as multispectral imaging makes it possible to visualize and analyze imaged specimens using multiple wavelengths simultaneously. As these powerful technologies become increasingly accepted and adopted, the opportunities for gaining new insight into the underlying mechanisms of diseases as well as the potential for discriminating among subtypes of pathologies are growing accordingly.

Multi-Scale Feature Fusion using Parallel-Attention Block for COVID-19 Chest X-ray Diagnosis

Under the global COVID-19 crisis, accurate diagnosis of COVID-19 from Chest X-ray (CXR) images is critical. To reduce intra- and inter-observer variability, during the radiological assessment, computer-aided diagnostic tools have been utilized to supplement medical decision-making and subsequent disease management. Computational methods with high accuracy and robustness are required for rapid triaging of patients and aiding radiologists in the interpretation of the collected data. In this study, we propose a novel multi-feature fusion network using parallel attention blocks to fuse the original CXR images and local-phase feature-enhanced CXR images at multi-scales. We examine our model on various COVID-19 datasets acquired from different organizations to assess the generalization ability. Our experiments demonstrate that our method achieves state-of-art performance and has improved generalization capability, which is crucial for widespread deployment.Comment: Accepted for publication at the Journal of Machine Learning for Biomedical Imaging (MELBA) https://melba-journal.org/2023:00

Multi-Feature Vision Transformer via Self-Supervised Representation Learning for Improvement of COVID-19 Diagnosis

The role of chest X-ray (CXR) imaging, due to being more cost-effective, widely available, and having a faster acquisition time compared to CT, has evolved during the COVID-19 pandemic. To improve the diagnostic performance of CXR imaging a growing number of studies have investigated whether supervised deep learning methods can provide additional support. However, supervised methods rely on a large number of labeled radiology images, which is a time-consuming and complex procedure requiring expert clinician input. Due to the relative scarcity of COVID-19 patient data and the costly labeling process, self-supervised learning methods have gained momentum and has been proposed achieving comparable results to fully supervised learning approaches. In this work, we study the effectiveness of self-supervised learning in the context of diagnosing COVID-19 disease from CXR images. We propose a multi-feature Vision Transformer (ViT) guided architecture where we deploy a cross-attention mechanism to learn information from both original CXR images and corresponding enhanced local phase CXR images. We demonstrate the performance of the baseline self-supervised learning models can be further improved by leveraging the local phase-based enhanced CXR images. By using 10\% labeled CXR scans, the proposed model achieves 91.10\% and 96.21\% overall accuracy tested on total 35,483 CXR images of healthy (8,851), regular pneumonia (6,045), and COVID-19 (18,159) scans and shows significant improvement over state-of-the-art techniques. Code is available https://github.com/endiqq/Multi-Feature-ViTComment: Accepted to the 2022 MICCAI Workshop on Medical Image Learning with Limited and Noisy Dat

The transcription factor RUNX2 regulates receptor tyrosine kinase expression in melanoma.

Receptor tyrosine kinases-based autocrine loops largely contribute to activate the MAPK and PI3K/AKT pathways in melanoma. However, the molecular mechanisms involved in generating these autocrine loops are still largely unknown. In the present study, we examine the role of the transcription factor RUNX2 in the regulation of receptor tyrosine kinase (RTK) expression in melanoma. We have demonstrated that RUNX2-deficient melanoma cells display a significant decrease in three receptor tyrosine kinases, EGFR, IGF-1R and PDGFRβ. In addition, we found co-expression of RUNX2 and another RTK, AXL, in both melanoma cells and melanoma patient samples. We observed a decrease in phosphoAKT2 (S474) and phosphoAKT (T308) levels when RUNX2 knock down resulted in significant RTK down regulation. Finally, we showed a dramatic up regulation of RUNX2 expression with concomitant up-regulation of EGFR, IGF-1R and AXL in melanoma cells resistant to the BRAF V600E inhibitor PLX4720. Taken together, our results strongly suggest that RUNX2 might be a key player in RTK-based autocrine loops and a mediator of resistance to BRAF V600E inhibitors involving RTK up regulation in melanoma