DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

We present DeepSeek-V2, a strong Mixture-of-Experts (MoE) language model characterized by economical training and efficient inference. It comprises 236B total parameters, of which 21B are activated for each token, and supports a context length of 128K tokens. DeepSeek-V2 adopts innovative architectures including Multi-head Latent Attention (MLA) and DeepSeekMoE. MLA guarantees efficient inference through significantly compressing the Key-Value (KV) cache into a latent vector, while DeepSeekMoE enables training strong models at an economical cost through sparse computation. Compared with DeepSeek 67B, DeepSeek-V2 achieves significantly stronger performance, and meanwhile saves 42.5% of training costs, reduces the KV cache by 93.3%, and boosts the maximum generation throughput to 5.76 times. We pretrain DeepSeek-V2 on a high-quality and multi-source corpus consisting of 8.1T tokens, and further perform Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL) to fully unlock its potential. Evaluation results show that, even with only 21B activated parameters, DeepSeek-V2 and its chat versions still achieve top-tier performance among open-source models

Patient-specific pulmonary venous flow characterization and its impact on left atrial appendage thrombosis in atrial fibrillation patients

Background: Cardioembolic strokes are commonly occurred in non-valvular atrial fibrillation (AF) patients, with over 90% of cases originating from clot in left atrial appendage (LAA), which is believed to be greatly related with hemodynamic characters. Numerical simulation is widely accepted in the hemodynamic analysis, and patient-specific boundaries are required for realistic numerical simulations. Method: This paper firstly proposed a method that maps personalized pulmonary venous flow (PVF) by utilizing the volume changes of the left atrium (LA) over the cardiac cycle. Then we used data from patients with AF to investigate the correlation between PVF patterns and hemodynamics within the LAA. Meanwhile, we conducted a fluid-structure interaction analysis to assess the impact of velocity- and time-related PVF parameters on LAA hemodynamic characters. Results: The analysis reveal that the ratio of systolic to diastolic peak velocity (VS/VD), and systolic velocity-time integral (VTI) showed a significant influence on LAA velocity in patients with atrial fibrillation, and the increases of velocity- and time-related parameters were found to be positively correlated with the blood update in the LAA. Conclusions: This study established a method for mapping patient-specific PVF based on LA volume change, and evaluated the relationship between PVF parameters and thrombosis risk. The present work provides an insight from PVF characters to evaluate the risk of thrombus formation within LAA in patients with AF.</p

Efficient capture, rapid killing and ultrasensitive detection of bacteria by a nano-decorated multi-functional electrode sensor

In this work, we demonstrated a nano-decorated porous impedance electrode sensor for efficient capture, rapid killing and ultrasensitive detection of bacteria. The multi-functional sensor was prepared by a facile sono-chemical method via in situ deposition of antibacterial prickly Zn-CuO nanoparticles and graphene oxide (GO) nanosheets on a Ni porous electrode. Due to the surface burr-like nanostructures, the nano-decorated impedance sensor exhibited very good bacterial-capture efficiency (70 - 80% in 20 min) even at a low concentration of 50 CFU mL(-1), rapid antibacterial rate (100% killing in 30 min) and high detection sensitivity (as low as 10 CFU mL(-1)). More importantly, the nano-decorated sensor has proven to be highly effective in quantitative detection of bacteria in a biological sample, for example, a rat blood sample spiked with E. coll. Despite the complexity of blood, the sensor still exhibited excellent detection precision within 30 min at bacteria concentrations ranging from 10 - 10(5) CFU mL(-1). The simplicity, rapidity, sensitivity, practicability and multifunctionality of this impedance sensor would greatly facilitate applications in portable medical devices for on-the-spot diagnosis and even the possibility for simultaneous therapy of diseases caused by bacterial infections.</p