EfficientViT: Lightweight Multi-Scale Attention for On-Device Semantic Segmentation

Semantic segmentation enables many appealing real-world applications, such as computational photography, autonomous driving, etc. However, the vast computational cost makes deploying state-of-the-art semantic segmentation models on edge devices with limited hardware resources difficult. This work presents EfficientViT, a new family of semantic segmentation models with a novel lightweight multi-scale attention for on-device semantic segmentation. Unlike prior semantic segmentation models that rely on heavy self-attention, hardware-inefficient large-kernel convolution, or complicated topology structure to obtain good performances, our lightweight multi-scale attention achieves a global receptive field and multi-scale learning (two critical features for semantic segmentation models) with only lightweight and hardware-efficient operations. As such, EfficientViT delivers remarkable performance gains over previous state-of-the-art semantic segmentation models across popular benchmark datasets with significant speedup on the mobile platform. Without performance loss on Cityscapes, our EfficientViT provides up to 15x and 9.3x mobile latency reduction over SegFormer and SegNeXt, respectively. Maintaining the same mobile latency, EfficientViT provides +7.4 mIoU gain on ADE20K over SegNeXt. Code: https://github.com/mit-han-lab/efficientvit.Comment: Tech repor

The Evolution of AI Dependency in Scientometric Research

The use of AI methodologies, particularly machine learning and deep learn-ing, is increasing in scientometrics research for processing large and com-plex data structures. This has resulted in the phenomenon of AI dependency in scientometrics. In this study, we analysed bibliographic data from the Journal of Informetrics and Scientometrics, two core scientometric journals, using the Web of Science database. We created an AI technology term lexi-con and studied the trend and adoption rate of AI dependency. Our findings show that scientometric research is becoming more dependent on AI, with a decreasing lag time for adopting new methods. In the coming years, deep learning-based scientometric studies will become a prominent research trend

A tale of two estrogen receptors (ERs): how differential ER-estrogen responsive element interactions contribute to subtype-specific transcriptional responses

The interaction of ERα and ERβ with ERE constitutes the initial step in the canonical nuclear E2 signaling in which E2-ERβ is a weaker transactivator than E2-ERα. This perspective summarizes recent findings to discuss potential mechanisms that contribute to ER subtype-specific transcriptional responses

Effects of long-term ammonia and heat stress on growth performance, antioxidant and immunity of wild and breeding juvenile rice field eel (Monopterus albus)

This study aimed to evaluate the impacts of wild and breeding juvenile rice field eel under conditions of ammonia and heat stress. The growth performance (FBW, WGR, SGR, and FCR) of 360 wild (24.22 ± 0.30 g) and 360 breeding (24.16 ± 0.27 g) strains was significantly hindered by ammonia and heat stress. The inhibitory effects were more obvious when the two stresses were combined. The growth performance and survival rates of the breeding strains outperformed that of the wild strains under identical stress conditions, this was explained by the expression of the growth-related gene (gh). They have increased the enzyme activity (CAT and GSH-Px) and expression of immune-related genes (cat, gpx3, and hsp90α) in response to oxidative stress. However, the results of certain indicator enzymes indicate the presence of oxidative damage in their tissues. The presence of an inflammatory response in the tissues was suggested by the up-regulation of genes associated with pro-inflammatory cytokines (il-1β and il-8) and the down-regulation of genes related to anti-inflammatory cytokines (il-10). Additionally, the presence of tissue damage was shown by the up-regulation of genes connected to apoptosis (cas2, cas8, and cas9) and the down-regulation of genes connected to tight junctions (zo-1). Nevertheless, it is noteworthy that breeding strains exhibited superior adaptability to ammonia and heat stress in comparison to wild strains

The potential contribution of miRNA-200-3p to the fatty acid metabolism by regulating AjEHHADH during aestivation in sea cucumber

The sea cucumber (Apostichopus japonicus) has become a good model organism for studying environmentally-induced aestivation by a marine invertebrate more recently. In the present study, we hypothesized that miRNA-200-3p may contribute to establish rapid biological control to regulate fatty acid meta

Grafted Trees Bear Better Fruit: An Improved Multiple-Valued Plaintext-Checking Side-Channel Attack against Kyber

As a prominent category of side-channel attacks (SCAs), plaintext-checking (PC) oracle-based SCAs offer the advantages of generality and operational simplicity on a targeted device. At TCHES 2023, Rajendran et al. and Tanaka et al. independently proposed the multiple-valued (MV) PC oracle, significantly reducing the required number of queries (a.k.a., traces) in the PC oracle. However, in practice, when dealing with environmental noise or inaccuracies in the waveform classifier, they still rely on majority voting or the other technique that usually results in three times the number of queries compared to the ideal case. In this paper, we propose an improved method to further reduce the number of queries of the MV-PC oracle, particularly in scenarios where the oracle is imperfect. Compared to the state-of-the-art at TCHES 2023, our proposed method reduces the number of queries for a full key recovery by more than $42.5\%$. The method involves three rounds. Our key observation is that coefficients recovered in the first round can be regarded as prior information to significantly aid in retrieving coefficients in the second round. This improvement is achieved through a newly designed grafted tree. Notably, the proposed method is generic and can be applied to both the NIST key encapsulation mechanism (KEM) standard Kyber and other significant candidates, such as Saber and Frodo. We have conducted extensive software simulations against Kyber-512, Kyber-768, Kyber-1024, FireSaber, and Frodo-1344 to validate the efficiency of the proposed method. An electromagnetic attack conducted on real-world implementations, using an STM32F407G board equipped with an ARM Cortex-M4 microcontroller and Kyber implementation from the public library \textit{pqm4}, aligns well with our simulations