Fast Predictive Multimodal Image Registration

We introduce a deep encoder-decoder architecture for image deformation prediction from multimodal images. Specifically, we design an image-patch-based deep network that jointly (i) learns an image similarity measure and (ii) the relationship between image patches and deformation parameters. While our method can be applied to general image registration formulations, we focus on the Large Deformation Diffeomorphic Metric Mapping (LDDMM) registration model. By predicting the initial momentum of the shooting formulation of LDDMM, we preserve its mathematical properties and drastically reduce the computation time, compared to optimization-based approaches. Furthermore, we create a Bayesian probabilistic version of the network that allows evaluation of registration uncertainty via sampling of the network at test time. We evaluate our method on a 3D brain MRI dataset using both T1- and T2-weighted images. Our experiments show that our method generates accurate predictions and that learning the similarity measure leads to more consistent registrations than relying on generic multimodal image similarity measures, such as mutual information. Our approach is an order of magnitude faster than optimization-based LDDMM.Comment: Accepted as a conference paper for ISBI 201

Quicksilver: Fast Predictive Image Registration - a Deep Learning Approach

This paper introduces Quicksilver, a fast deformable image registration method. Quicksilver registration for image-pairs works by patch-wise prediction of a deformation model based directly on image appearance. A deep encoder-decoder network is used as the prediction model. While the prediction strategy is general, we focus on predictions for the Large Deformation Diffeomorphic Metric Mapping (LDDMM) model. Specifically, we predict the momentum-parameterization of LDDMM, which facilitates a patch-wise prediction strategy while maintaining the theoretical properties of LDDMM, such as guaranteed diffeomorphic mappings for sufficiently strong regularization. We also provide a probabilistic version of our prediction network which can be sampled during the testing time to calculate uncertainties in the predicted deformations. Finally, we introduce a new correction network which greatly increases the prediction accuracy of an already existing prediction network. We show experimental results for uni-modal atlas-to-image as well as uni- / multi- modal image-to-image registrations. These experiments demonstrate that our method accurately predicts registrations obtained by numerical optimization, is very fast, achieves state-of-the-art registration results on four standard validation datasets, and can jointly learn an image similarity measure. Quicksilver is freely available as an open-source software.Comment: Add new discussion

HeMIS: Hetero-Modal Image Segmentation

We introduce a deep learning image segmentation framework that is extremely robust to missing imaging modalities. Instead of attempting to impute or synthesize missing data, the proposed approach learns, for each modality, an embedding of the input image into a single latent vector space for which arithmetic operations (such as taking the mean) are well defined. Points in that space, which are averaged over modalities available at inference time, can then be further processed to yield the desired segmentation. As such, any combinatorial subset of available modalities can be provided as input, without having to learn a combinatorial number of imputation models. Evaluated on two neurological MRI datasets (brain tumors and MS lesions), the approach yields state-of-the-art segmentation results when provided with all modalities; moreover, its performance degrades remarkably gracefully when modalities are removed, significantly more so than alternative mean-filling or other synthesis approaches.Comment: Accepted as an oral presentation at MICCAI 201

Neonatal White Matter Maturation Is Associated With Infant Language Development

Background: While neonates have no sophisticated language skills, the neural basis for acquiring this function is assumed to already be present at birth. Receptive language is measurable by 6 months of age and meaningful speech production by 10-18 months of age. Fiber tracts supporting language processing include the corpus callosum (CC), which plays a key role in the hemispheric lateralization of language; the left arcuate fasciculus (AF), which is associated with syntactic processing; and the right AF, which plays a role in prosody and semantics. We examined if neonatal maturation of these fiber tracts is associated with receptive language development at 12 months of age. Methods: Diffusion-weighted imaging (DWI) was performed in 86 infants at 26.6 ± 12.2 days post-birth. Receptive language was assessed via the MacArthur-Bates Communicative Development Inventory at 12 months of age. Tract-based fractional anisotropy (FA) was determined using the NA-MIC atlas-based fiber analysis toolkit. Associations between neonatal regional FA, adjusted for gestational age at birth and age at scan, and language development at 12 months of age were tested using ANOVA models. Results: After multiple comparisons correction, higher neonatal FA was positively associated with receptive language at 12 months of age within the genu (p < 0.001), rostrum (p < 0.001), and tapetum (p < 0.001) of the CC and the left fronto-parietal AF (p = 0.008). No significant clusters were found in the right AF. Conclusion: Microstructural development of the CC and the AF in the newborn is associated with receptive language at 12 months of age, demonstrating that interindividual variation in white matter microstructure is relevant for later language development, and indicating that the neural foundation for language processing is laid well ahead of the majority of language acquisition. This suggests that some origins of impaired language development may lie in the intrauterine and potentially neonatal period of life. Understanding how interindividual differences in neonatal brain maturity relate to the acquisition of function, particularly during early development when the brain is in an unparalleled window of plasticity, is key to identifying opportunities for harnessing neuroplasticity in health and disease

Hippocampal shape and volume changes with antipsychotics in early stage psychotic illness

Progression of hippocampal shape and volume abnormalities has been described in psychotic disorders such as schizophrenia. However it is unclear how specific antipsychotic medications influence the development of hippocampal structure. We conducted a longitudinal, randomized, controlled, multisite, double-blind study involving 14 academic medical centers (United States 11, Canada 1, Netherlands 1, and England 1). 134 first-episode psychosis (receiving either haloperidol or olanzapine) patients and 51 healthy controls were treated and followed up for up to 104 weeks using magnetic resonance imaging and large-deformation high-dimensional brain mapping of the hippocampus. Changes in hippocampal volume and shape metrics (i.e., percentage of negative surface vertex slopes, and surface deformation) were evaluated. Mixed-models analysis did not show a significant group-by-time interaction for hippocampal volume. However, the cumulative distribution function of hippocampal surface vertex slopes showed a notable left shift with haloperidol treatment compared to olanzapine treatment and to controls. Olanzapine treatment was associated with a significantly lower percentage of large magnitude negative surface vertex slopes compared to haloperidol treatment (p=0.004). Surface deformation maps however did not localize any hippocampal regions that differentially contracted over time with olanzapine treatment, after FDR correction. These results indicate that surface analysis provides supplementary information to volumetry in detecting differential treatment effects of the hippocampus. Our results suggest that olanzapine is associated with less longitudinal hippocampal surface deformation than haloperidol, however the hippocampal regions affected appear to be variable across patients

Evaluation of atlas based mouse brain segmentation

Magentic Reasonance Imaging for mouse phenotype study is one of the important tools to understand human diseases. In this paper, we present a fully automatic pipeline for the process of morphometric mouse brain analysis. The method is based on atlas-based tissue and regional segmentation, which was originally developed for the human brain. To evaluate our method, we conduct a qualitative and quantitative validation study as well as compare of b-spline and fluid registration methods as components in the pipeline. The validation study includes visual inspection, shape and volumetric measurements and stability of the registration methods against various parameter settings in the processing pipeline. The result shows both fluid and b-spline registration methods work well in murine settings, but the fluid registration is more stable. Additionally, we evaluated our segmentation methods by comparing volume differences between Fmr1 FXS in FVB background vs C57BL/6J mouse strains

Shallow vs deep learning architectures for white matter lesion segmentation in the early stages of multiple sclerosis

In this work, we present a comparison of a shallow and a deep learning architecture for the automated segmentation of white matter lesions in MR images of multiple sclerosis patients. In particular, we train and test both methods on early stage disease patients, to verify their performance in challenging conditions, more similar to a clinical setting than what is typically provided in multiple sclerosis segmentation challenges. Furthermore, we evaluate a prototype naive combination of the two methods, which refines the final segmentation. All methods were trained on 32 patients, and the evaluation was performed on a pure test set of 73 cases. Results show low lesion-wise false positives (30%) for the deep learning architecture, whereas the shallow architecture yields the best Dice coefficient (63%) and volume difference (19%). Combining both shallow and deep architectures further improves the lesion-wise metrics (69% and 26% lesion-wise true and false positive rate, respectively).Comment: Accepted to the MICCAI 2018 Brain Lesion (BrainLes) worksho

Cell Mechanosensitivity to Extremely Low Magnitude Signals is Enabled by a LINCed Nucleus

A cell's ability to recognize and adapt to the physical environment is central to its survival and function, but how mechanical cues are perceived and transduced into intracellular signals remains unclear. In mesenchymal stem cells (MSCs), high-magnitude substrate strain (HMS, ≥2%) effectively suppresses adipogenesis via induction of focal adhesion (FA) kinase (FAK)/mTORC2/Akt signaling generated at FAs. Physiologic systems also rely on a persistent barrage of low-level signals to regulate behavior. Exposing MSC to extremely low-magnitude mechanical signals (LMS) suppresses adipocyte formation despite the virtual absence of substrate strain (<0.001%), suggesting that LMS-induced dynamic accelerations can generate force within the cell. Here, we show that MSC response to LMS is enabled through mechanical coupling between the cytoskeleton and the nucleus, in turn activating FAK and Akt signaling followed by FAK-dependent induction of RhoA. While LMS and HMS synergistically regulated FAK activity at the FAs, LMS-induced actin remodeling was concentrated at the perinuclear domain. Preventing nuclear-actin cytoskeleton mechanocoupling by disrupting linker of nucleoskeleton and cytoskeleton (LINC) complexes inhibited these LMS-induced signals as well as prevented LMS repression of adipogenic differentiation, highlighting that LINC connections are critical for sensing LMS. In contrast, FAK activation by HMS was unaffected by LINC decoupling, consistent with signal initiation at the FA mechanosome. These results indicate that the MSC responds to its dynamic physical environment not only with "outside-in" signaling initiated by substrate strain, but vibratory signals enacted through the LINC complex enable matrix independent "inside-inside" signaling