TORE: Token Reduction for Efficient Human Mesh Recovery with Transformer

In this paper, we introduce a set of effective TOken REduction (TORE) strategies for Transformer-based Human Mesh Recovery from monocular images. Current SOTA performance is achieved by Transformer-based structures. However, they suffer from high model complexity and computation cost caused by redundant tokens. We propose token reduction strategies based on two important aspects, i.e., the 3D geometry structure and 2D image feature, where we hierarchically recover the mesh geometry with priors from body structure and conduct token clustering to pass fewer but more discriminative image feature tokens to the Transformer. As a result, our method vastly reduces the number of tokens involved in high-complexity interactions in the Transformer, achieving competitive accuracy of shape recovery at a significantly reduced computational cost. We conduct extensive experiments across a wide range of benchmarks to validate the proposed method and further demonstrate the generalizability of our method on hand mesh recovery. Our code will be publicly available once the paper is published

An interactive meshless cutting model for nonlinear viscoelastic soft tissue in surgical simulators

In this paper, we present a novel interactive cutting simulation model for soft tissue based on the meshless framework. Unlike most existing methods that consider the cutting process of soft tissue in an over simplified manner, the presented model is able to simulate the complete cutting process that includes three stages: deformation before cutting open (DBCO), cutting open (CO), and deformation after cutting open (DACO). To characterize the complicated physical and mechanical properties of soft tissue, both nonlinearity and viscoelasticity were incorporated into the equations governing the motion of soft tissue. A line contact model was used for simulating the cutting process after analyzing the two major types of surgical instruments, i.e., scalpel and electrostick. The cutting speed and angle were taken into account in order to improve haptic rendering. Biomechanical tests and simulation experiments verified the validity of the introduced model. Specifically, the displacement vs. cutting force curves can be divided into three segments corresponding to the three stages of the cutting process. The results were also applied in a liver cutting simulating system and satisfactory visual effect and haptic feedback were achieved

A Brain Storm Optimization with Multiinformation Interactions for Global Optimization Problems

The original BSO fails to consider some potential information interactions in its individual update pattern, causing the premature convergence for complex problems. To address this problem, we propose a BSO algorithm with multi-information interactions (MIIBSO). First, a multi-information interaction (MII) strategy is developed, thoroughly considering various information interactions among individuals. Specially, this strategy contains three new MII patterns. The first two patterns aim to reinforce information interaction capability between individuals. The third pattern provides interactions between the corresponding dimensions of different individuals. The collaboration of the above three patterns is established by an individual stagnation feedback (ISF) mechanism, contributing to preserve the diversity of the population and enhance the global search capability for MIIBSO. Second, a random grouping (RG) strategy is introduced to replace both the K-means algorithm and cluster center disruption of the original BSO algorithm, further enhancing the information interaction capability and reducing the computational cost of MIIBSO. Finally, a dynamic difference step-size (DDS), which can offer individual feedback information and improve search range, is designed to achieve an effective balance between global and local search capability for MIIBSO. By combining the MII strategy, RG, and DDS, MIIBSO achieves the effective improvement in the global search ability, convergence speed, and computational cost. MIIBSO is compared with 11 BSO algorithms and five other algorithms on the CEC2013 test suit. The results confirm that MIIBSO obtains the best global search capability and convergence speed amongst the 17 algorithms

Weighted Gene Co-expression Network Analysis for RNA-Sequencing Data of the Varicose Veins Transcriptome

ObjectiveVaricose veins are a common problem worldwide and can cause significant impairments in health-related quality of life, but the etiology and pathogenesis remain not well defined. This study aims to elucidate transcriptomic regulations of varicose veins by detecting differentially expressed genes, pathways and regulator genes.MethodsWe harvested great saphenous veins (GSV) from patients who underwent coronary artery bypass grafting (CABG) and varicose veins from conventional stripping surgery. RNA-Sequencing (RNA-Seq) technique was used to obtain the complete transcriptomic data of both GSVs from CABG patients and varicose veins. Weighted Gene Co-expression network analysis (WGCNA) and further analyses were then carried out with the aim to elucidate transcriptomic regulations of varicose veins by detecting differentially expressed genes, pathways and regulator genes.ResultsFrom January 2015 to December 2016, 7 GSVs from CABG patients and 13 varicose veins were obtained. WGCNA identified 4 modules. In the brown module, gene ontology (GO) analysis showed that the biological processes were focused on response to stimulus, immune response and inflammatory response, etc. Kyoto encyclopedia of genes and genomes (KEGG) pathway analysis showed that the biological processes were focused on cytokine-cytokine receptor interaction and TNF signaling pathway, etc. In the gray module, GO analysis showed that the biological processes were skeletal myofibril assembly related. The immunohistochemistry staining showed that the expression of ASC, Caspase-1 and NLRP3 were increased in GSVs from CABG patients compared with varicose veins. Histopathological analysis showed that in the varicose veins group, the thickness of vascular wall, tunica intima, tunica media and collagen/smooth muscle ratio were significantly increased, and that the elastic fiber/internal elastic lamina ratio was decreased.ConclusionThis study shows that there are clear differences in transcriptomic information between varicose veins and GSVs from CABG patients. Some inflammatory RNAs are down-regulated in varicose veins compared with GSVs from CABG patients. Skeletal myofibril assembly pathway may play a crucial role in the pathogenesis of varicose veins. Characterization of these RNAs may provide new targets for understanding varicose veins diagnosis, progression, and treatment

Prognostic Analysis of Duodenal Gastrointestinal Stromal Tumors

Aim. This study aims to analyze factors possibly related to the prognosis of duodenal gastrointestinal stromal tumors (DGISTs). Methods. We collected and retrospectively analyzed clinical and pathological data of 62 patients with primary DGISTs. All the patients were hospitalized and received complete surgical resection at Shanghai Ruijin Hospital from September 2003 to April 2015. We followed up the patients to determine survival outcomes. We also analyzed the effect of clinical and pathological factors on disease-free survival (DFS) and overall survival (OS) of the patients. Results. Kaplan-Meier univariate survival analysis demonstrated that tumor size, mitotic index, Ki-67 index, and pathological risk were correlated with the DFS and OS of the patients (DFS P=0.039, 0.001, <0.001, and 0.005, resp.; OS P=0.027, 0.007, <0.001, and 0.012, resp.). Cox multivariate regression analysis revealed that Ki-67 index was an independent prognostic factor affecting DFS and OS (P=0.007 and 0.028, resp.). Moreover, Kaplan-Meier survival analysis showed that imatinib treatment for patients with recurrence was correlated with prolonged OS (P=0.002). Conclusion. Prognosis for DGIST treated by R0 resection is favorable. High level of Ki-67 can be an independent risk factor of DGIST prognosis. Adjuvant imatinib therapy for patients with tumor recurrence could probably lead to prolonged survival

Case report: An ectopic adrenocortical adenoma in the renal sinus

BackgroundEctopic adrenal tissue is rare in adults, with an incidence of only about 1%. We report a rare case of ectopic adrenocortical adenoma in the left renal sinus.Case PreentationA 57-year-old woman was admitted to the Department of Urology due to “a left kidney tumor” on physical examination. Multislice helical computed tomography (CT) showed the left kidney with an anterior lip mass near the hilum, approximately 2.3 cm × 2.2 cm in size. Preoperative renal artery CT angiography (CTA) showed no obvious abnormality. Laparoscopic resection of the left renal sinus mass was performed, and postoperative pathological findings showed ectopic adrenocortical adenoma. The tumor was a nonfunctional adenoma.ConclusionRenal ectopic adrenal cortical adenoma is rare. Most of them are nonfunctional adenomas, which cannot be clearly diagnosed by preoperative imaging examination and can often be diagnosed by postoperative pathology

YuLan: An Open-source Large Language Model

Large language models (LLMs) have become the foundation of many applications, leveraging their extensive capabilities in processing and understanding natural language. While many open-source LLMs have been released with technical reports, the lack of training details hinders further research and development. This paper presents the development of YuLan, a series of open-source LLMs with $12$ billion parameters. The base model of YuLan is pre-trained on approximately $1.7$T tokens derived from a diverse corpus, including massive English, Chinese, and multilingual texts. We design a three-stage pre-training method to enhance YuLan's overall capabilities. Subsequent phases of training incorporate instruction-tuning and human alignment, employing a substantial volume of high-quality synthesized data. To facilitate the learning of complex and long-tail knowledge, we devise a curriculum-learning framework throughout across these stages, which helps LLMs learn knowledge in an easy-to-hard manner. YuLan's training is finished on Jan, 2024 and has achieved performance on par with state-of-the-art LLMs across various English and Chinese benchmarks. This paper outlines a comprehensive technical roadmap for developing LLMs from scratch. Our model and codes are available at https://github.com/RUC-GSAI/YuLan-Chat

A teosinte-derived allele of ZmSC improves salt tolerance in maize

Maize, a salt-sensitive crop, frequently suffers severe yield losses due to soil salinization. Enhancing salt tolerance in maize is crucial for maintaining yield stability. To address this, we developed an introgression line (IL76) through introgressive hybridization between maize wild relatives Zea perennis, Tripsacum dactyloides, and inbred Zheng58, utilizing the tri-species hybrid MTP as a genetic bridge. Previously, genetic variation analysis identified a polymorphic marker on Zm00001eb244520 (designated as ZmSC), which encodes a vesicle-sorting protein described as a salt-tolerant protein in the NCBI database. To characterize the identified polymorphic marker, we employed gene cloning and homologous cloning techniques. Gene cloning analysis revealed a non-synonymous mutation at the 1847th base of ZmSCIL76, where a guanine-to-cytosine substitution resulted in the mutation of serine to threonine at the 119th amino acid sequence (using ZmSCZ58 as the reference sequence). Moreover, homologous cloning demonstrated that the variation site derived from Z. perennis. Functional analyses showed that transgenic Arabidopsis lines overexpressing ZmSCZ58 exhibited significant reductions in leaf number, root length, and pod number, alongside suppression of the expression of genes in the SOS and CDPK pathways associated with Ca2+ signaling. Similarly, fission yeast strains expressing ZmSCZ58 displayed inhibited growth. In contrast, the ZmSCIL76 allele from Z. perennis alleviated these negative effects in both Arabidopsis and yeast, with the lines overexpressing ZmSCIL76 exhibiting significantly higher abscisic acid (ABA) content compared to those overexpressing ZmSCZ58. Our findings suggest that ZmSC negatively regulates salt tolerance in maize by suppressing downstream gene expression associated with Ca2+ signaling in the CDPK and SOS pathways. The ZmSCIL76 allele from Z. perennis, however, can mitigate this negative regulatory effect. These results provide valuable insights and genetic resources for future maize salt tolerance breeding programs

Association of folic acid dosage with circulating unmetabolized folic acid in Chinese adults with H-type hypertension: a multicenter, double-blind, randomized controlled trial

BackgroundThere is growing concern regarding elevated levels of circulating unmetabolized folic acid (UMFA) due to excessive intake of folic acid (FA). However, no randomized clinical trial has been conducted to examine the FA-UMFA dose-response relationship.ObjectiveThis study aimed to investigate the FA-UMFA dose-response relationship in Chinese adults with hypertension and elevated homocysteine (H-type hypertension), a population with clear clinical indication for FA treatment.MethodsThe data for this study were derived from a randomized, double-blind, multicenter clinical trial of 8 FA dosages on efficacy of homocysteine (Hcy) lowering. The parent trial had three 3 stages: screening period (2–10 days), run-in period (0–2 weeks, baseline visit), and double-blind treatment period (8 weeks) with follow-up visits at the end of the 2nd, 4th, 6th, and 8th weeks of treatment. Participants were randomly assigned to 8 treatment groups corresponding to FA dosages of 0, 0.4, 0.6, 0.8, 1.2, 1.6, 2.0 mg to 2.4 mg.ResultsThis study included 1,567 Chinese adults aged ≥45 years with H-type hypertension. There was a positive but non-linear association between FA supplementation and UMFA levels in the dosage range of 0 mg to 2.4 mg. In the regression analysis, the coefficients for the linear and quadratic terms of FA dosage were both statistically significant (P &lt; 0.001). Notably, the slope for UMFA was greater for FA dosages &gt;0.8 mg (ß = 11.21, 95% CI: 8.97, 13.45) compared to FA dosages ≤0.8 mg (ß = 2.94, 95% CI: 2.59, 3.29). Furthermore, FA dosages higher than 0.8 mg did not confer additional benefits in terms of increasing 5-methyl tetrahydrofolic acid (5-MTHF, active form of folate) or reducing homocysteine (Hcy).ConclusionIn Chinese adults with H-type hypertension, this study showed a positive, non-linear, dosage-response relationship between FA supplementation ranging from 0 to 2.4 mg and circulating UMFA levels. It revealed that 0.8 mg FA is an optimal dosage in terms of balancing efficacy (increasing 5-MTHF and lowering Hcy) while minimizing undesirable elevation of UMFA.Clinical trial registrationhttps://clinicaltrials.gov/ct2/show/NCT03472508?term=NCT03472508&amp;draw=2&amp;rank=1, identifier NCT03472508