88 research outputs found

    FATA-Trans: Field And Time-Aware Transformer for Sequential Tabular Data

    Full text link
    Sequential tabular data is one of the most commonly used data types in real-world applications. Different from conventional tabular data, where rows in a table are independent, sequential tabular data contains rich contextual and sequential information, where some fields are dynamically changing over time and others are static. Existing transformer-based approaches analyzing sequential tabular data overlook the differences between dynamic and static fields by replicating and filling static fields into each transformer, and ignore temporal information between rows, which leads to three major disadvantages: (1) computational overhead, (2) artificially simplified data for masked language modeling pre-training task that may yield less meaningful representations, and (3) disregarding the temporal behavioral patterns implied by time intervals. In this work, we propose FATA-Trans, a model with two field transformers for modeling sequential tabular data, where each processes static and dynamic field information separately. FATA-Trans is field- and time-aware for sequential tabular data. The field-type embedding in the method enables FATA-Trans to capture differences between static and dynamic fields. The time-aware position embedding exploits both order and time interval information between rows, which helps the model detect underlying temporal behavior in a sequence. Our experiments on three benchmark datasets demonstrate that the learned representations from FATA-Trans consistently outperform state-of-the-art solutions in the downstream tasks. We also present visualization studies to highlight the insights captured by the learned representations, enhancing our understanding of the underlying data. Our codes are available at https://github.com/zdy93/FATA-Trans.Comment: This work is accepted by ACM International Conference on Information and Knowledge Management (CIKM) 202

    Ultrastructural insights into cellular organization, energy storage and ribosomal dynamics of an ammonia-oxidizing archaeon from oligotrophic oceans

    Get PDF
    IntroductionNitrososphaeria, formerly known as Thaumarchaeota, constitute a diverse and widespread group of ammonia-oxidizing archaea (AOA) inhabiting ubiquitously in marine and terrestrial environments, playing a pivotal role in global nitrogen cycling. Despite their importance in Earth’s ecosystems, the cellular organization of AOA remains largely unexplored, leading to a significant unanswered question of how the machinery of these organisms underpins metabolic functions.MethodsIn this study, we combined spherical-chromatic-aberration-corrected cryo-electron tomography (cryo-ET), scanning transmission electron microscopy (STEM), and energy dispersive X-ray spectroscopy (EDS) to unveil the cellular organization and elemental composition of Nitrosopumilus maritimus SCM1, a representative member of marine Nitrososphaeria.Results and DiscussionOur tomograms show the native ultrastructural morphology of SCM1 and one to several dense storage granules in the cytoplasm. STEM-EDS analysis identifies two types of storage granules: one type is possibly composed of polyphosphate and the other polyhydroxyalkanoate. With precise measurements using cryo-ET, we observed low quantity and density of ribosomes in SCM1 cells, which are in alignment with the documented slow growth of AOA in laboratory cultures. Collectively, these findings provide visual evidence supporting the resilience of AOA in the vast oligotrophic marine environment

    R&D investment target setting and enterprise innovation strategy: Substantive or symbolic?

    No full text
    Setting research and development (R&D) investment targets is a significant approach for governments to implement innovation-driven strategies. Based on data from Chinese A-share listed firms from 2004 to 2022, this study uses a staggered ‌difference-in-differences model to explore the impact of R&D investment target setting on enterprise innovation strategies. The results demonstrate that R&D investment target setting can promote enterprise innovation, with a stronger effect on symbolic innovation than substantive innovation. Heterogeneity analysis reveals that R&D investment target setting can enhance innovation in mature- and decline-stage enterprises but not growth-stage enterprises. In addition, labor- and capital-intensive enterprises tend toward symbolic innovation, whereas technology-intensive enterprises avoid substantive innovation. Mechanism analysis reveals that R&D investment target-setting drives enterprise innovation by empowering human capital, expanding financing scale, and promoting strategic alliances. Furthermore, economic growth targets are found to strengthen the innovation effect of R&D investment target setting, but only substantive innovation contributes to enterprise growth. These findings are crucial for optimizing government target management and enterprise innovation activities to construct an innovation-driven country

    Exploiting membrane vesicles derived from avian pathogenic Escherichia coli as a cross-protective subunit vaccine candidate against avian colibacillosis

    No full text
    ABSTRACT: Avian pathogenic Escherichia coli (APEC) is a notable pathogen that frequently leads to avian colibacillosis, posing a substantial risk to both the poultry industry and public health. The commercial vaccines against avian colibacillosis are primarily inactivated vaccines, but their effectiveness is limited to specific serotypes. Recent advances have highlighted bacterial membrane vesicles (MV) as a promising candidate in vaccine research. How to produce bacterial MVs vaccines on a large scale is a significant challenge for the industrialization of MVs. The msbB gene encodes an acyltransferase and has been implicated in altering the acylation pattern of lipid A, leading to a decrease in lipid A content in lipopolysaccharides (LPS). Here, we evaluated the immunoprotective efficacy of MVs derived from the LPS low-expressed APEC strain FY26ΔmsbB, which was an APEC mutant strain with a deletion of the msbB gene. The nitrogen cavitation technique was employed to extract APEC MVs, with results indicating a significant increase in MVs yield compared to that obtained under natural culture. The immunization effectiveness was assessed, revealing that FY26ΔmsbB MVs elicited an antibody response of laying hens and facilitated bacterial clearance. Protective efficacy studies demonstrated that immunization with FY26ΔmsbB MVs conferred the immune protection in chickens challenged with the wild-type APEC strain FY26. Notably, LPS low-carried MVs recovered from the mutant FY26ΔmsbB also displayed cross-protective capabilities, and effectively safeguarding against infections caused by O1, O7, O45, O78, and O101 serotypes virulent APEC strains. These findings suggest that MVs generated from the LPS low-expressed APEC strain FY26ΔmsbB represent a novel and empirically validated subunit vaccine for the prevention and control of infections by various APEC serotypes

    Digital-Twins-Driven Semi-Physical Simulation for Testing and Evaluation of Industrial Software in a Smart Manufacturing System

    No full text
    To satisfy the needs of the individualized manufacturing of products, the smart manufacturing system (SMS) is frequently reconfigured. To quickly verify the reliability and adaptability of industrial software in reconfiguring the SMS for new or upgraded product orders, a semi-physical simulation method for testing and evaluation of industrial software is proposed based on digital-twins-driven technology. By establishing a semi-physical simulation model of SMS, the reliability and robustness of the software system are quickly verified by running industrial software in various manufacturing scenarios. In this paper, the key technologies to carry out semi-physical simulation testing and evaluation of industrial software for SMSs are expounded in detail, including how to synchronize cyber and physical systems, how to conduct semi-physical accelerated simulation testing, and how to identify defects quickly in industrial software used in actual production environments. By establishing a semi-physical simulation production line model for stepper motors, the effectiveness and practicality of the proposed approach are verified, and the testing verification time of industrial software is significantly reduced. Finally, the robustness of the industrial software for SMS is further verified by conducting fault injection testing, so as to provide implications for fault prognostics or fault-prevention research

    Digital-Twins-Driven Semi-Physical Simulation for Testing and Evaluation of Industrial Software in a Smart Manufacturing System

    No full text
    To satisfy the needs of the individualized manufacturing of products, the smart manufacturing system (SMS) is frequently reconfigured. To quickly verify the reliability and adaptability of industrial software in reconfiguring the SMS for new or upgraded product orders, a semi-physical simulation method for testing and evaluation of industrial software is proposed based on digital-twins-driven technology. By establishing a semi-physical simulation model of SMS, the reliability and robustness of the software system are quickly verified by running industrial software in various manufacturing scenarios. In this paper, the key technologies to carry out semi-physical simulation testing and evaluation of industrial software for SMSs are expounded in detail, including how to synchronize cyber and physical systems, how to conduct semi-physical accelerated simulation testing, and how to identify defects quickly in industrial software used in actual production environments. By establishing a semi-physical simulation production line model for stepper motors, the effectiveness and practicality of the proposed approach are verified, and the testing verification time of industrial software is significantly reduced. Finally, the robustness of the industrial software for SMS is further verified by conducting fault injection testing, so as to provide implications for fault prognostics or fault-prevention research.</jats:p
    corecore