Situational Judgment Tests: An Overview of Development Practices and Psychometric Characteristics

Situational judgment tests (SJTs) are popular assessment methods often used for personnel selection and promotion. SJTs present problem scenarios to examinees, who then evaluate each response option for addressing the issue described in the scenario. As guidance for practitioners and researchers alike, this paper provides experience- and evidence-based best practices for developing SJTs: writing scenarios and response options, creating response instructions, and selecting a response format. This review describes scoring options, including key stretching and within-person standardization. The authors also describe research on psychometric issues that affect SJTs, including reliability, validity, group differences, presentation modes, faking, and coaching

Molecular, phenotypic, and sample-associated data to describe pluripotent stem cell lines and derivatives

The use of induced pluripotent stem cells (iPSC) derived from independent patients and sources holds considerable promise to improve the understanding of development and disease. However, optimized use of iPSC depends on our ability to develop methods to efficiently qualify cell lines and protocols, monitor genetic stability, and evaluate self-renewal and differentiation potential. To accomplish these goals, 57 stem cell lines from 10 laboratories were differentiated to 7 different states, resulting in 248 analyzed samples. Cell lines were differentiated and characterized at a central laboratory using standardized cell culture methodologies, protocols, and metadata descriptors. Stem cell and derived differentiated lines were characterized using RNA-seq, miRNA-seq, copy number arrays, DNA methylation arrays, flow cytometry, and molecular histology. All materials, including raw data, metadata, analysis and processing code, and methodological and provenance documentation are publicly available for re-use and interactive exploration at https://www.synapse.org/pcbc. The goal is to provide data that can improve our ability to robustly and reproducibly use human pluripotent stem cells to understand development and disease

Scoring method of a Situational Judgment Test:influence on internal consistency reliability, adverse impact and correlation with personality?

textabstractSituational Judgment Tests (SJTs) are increasingly used for medical school selection. Scoring an SJT is more complicated than scoring a knowledge test, because there are no objectively correct answers. The scoring method of an SJT may influence the construct and concurrent validity and the adverse impact with respect to non-traditional students. Previous research has compared only a small number of scoring methods and has not studied the effect of scoring method on internal consistency reliability. This study compared 28 different scoring methods for a rating SJT on internal consistency reliability, adverse impact and correlation with personality. The scoring methods varied on four aspects: the way of controlling for systematic error, and the type of reference group, distance and central tendency statistic. All scoring methods were applied to a previously validated integrity-based SJT, administered to 931 medical school applicants. Internal consistency reliability varied between .33 and .73, which is likely explained by the dependence of coefficient alpha on the total score variance. All scoring methods led to significantly higher scores for the ethnic majority than for the non-Western minorities, with effect sizes ranging from 0.48 to 0.66. Eighteen scoring methods showed a significant small positive correlation with agreeableness. Four scoring methods showed a significant small positive correlation with conscientiousness. The way of controlling for systematic error was the most influential scoring method aspect. These results suggest that the increased use of SJTs for selection into medical school must be accompanied by a thorough examination of the scoring method to be used

Interrogating Encapsulated Protein Structure within Metal–Organic Frameworks at Elevated Temperature

Encapsulating biomacromolecules within metal-organic frameworks (MOFs) can confer thermostability to entrapped guests. It has been hypothesized that the confinement of guest molecules within a rigid MOF scaffold results in heightened stability of the guests, but no direct evidence of this mechanism has been shown. Here, we present a novel analytical method using small-angle X-ray scattering (SAXS) to solve the structure of bovine serum albumin (BSA) while encapsulated within two zeolitic imidazolate frameworks (ZIF-67 and ZIF-8). Our approach comprises subtracting the scaled SAXS spectrum of the ZIF from that of the biocomposite BSA@ZIF to determine the radius of gyration of encapsulated BSA through Guinier, Kratky, and pair distance distribution function analyses. While native BSA exposed to 70 °C became denatured, in situ SAXS analysis showed that encapsulated BSA retained its size and folded state at 70 °C when encapsulated within a ZIF scaffold, suggesting that entrapment within MOF cavities inhibited protein unfolding and thus denaturation. This method of SAXS analysis not only provides insight into biomolecular stabilization in MOFs but may also offer a new approach to study the structure of other conformationally labile molecules in rigid matrices

Distal posterior tibial artery perforator flaps for the management of calcaneal and Achilles tendon injuries in diabetic and non-diabetic patients

Management of Achilles tendon and heel area defects is a common challenge for the reconstructive surgeon due to the lack of soft tissue availability in that region. In this article, we present our experience in covering these defects by using the distal perforator propeller flaps based on the posterior tibial artery. Perforator flaps are based on cutaneous, small diameter vessels that originate from a main pedicle and perforate the fascia or muscle to reach the skin. Their development has followed the understanding of the blood supply from a source artery to the skin. Six patients (five males and one female) underwent reconstruction by using the posterior tibial artery distal perforator flap for covering defects in the distal Achilles tendon region in patients with and without diabetes mellitus. Postoperative complications included a hypertrophic scar formation in one patient, partial marginal flap necrosis in another patient, and a wound infection in a third patient. All wounds were eventually healed by the last postoperative visit. In conclusion, perforator flaps based on the distal posterior tibial artery may be a reliable option for the coverage of small to moderate size defects of the Achilles tendon and heel area regions

A simple spreadsheet-based, MIAME-supportive format for microarray data: MAGE-TAB

BACKGROUND: Sharing of microarray data within the research community has been greatly facilitated by the development of the disclosure and communication standards MIAME and MAGE-ML by the MGED Society. However, the complexity of the MAGE-ML format has made its use impractical for laboratories lacking dedicated bioinformatics support. RESULTS: We propose a simple tab-delimited, spreadsheet-based format, MAGE-TAB, which will become a part of the MAGE microarray data standard and can be used for annotating and communicating microarray data in a MIAME compliant fashion. CONCLUSION: MAGE-TAB will enable laboratories without bioinformatics experience or support to manage, exchange and submit well-annotated microarray data in a standard format using a spreadsheet. The MAGE-TAB format is self-contained, and does not require an understanding of MAGE-ML or XML

Adding a Little Reality to Building Ontologies for Biology

BACKGROUND: Many areas of biology are open to mathematical and computational modelling. The application of discrete, logical formalisms defines the field of biomedical ontologies. Ontologies have been put to many uses in bioinformatics. The most widespread is for description of entities about which data have been collected, allowing integration and analysis across multiple resources. There are now over 60 ontologies in active use, increasingly developed as large, international collaborations. There are, however, many opinions on how ontologies should be authored; that is, what is appropriate for representation. Recently, a common opinion has been the "realist" approach that places restrictions upon the style of modelling considered to be appropriate. METHODOLOGY/PRINCIPAL FINDINGS: Here, we use a number of case studies for describing the results of biological experiments. We investigate the ways in which these could be represented using both realist and non-realist approaches; we consider the limitations and advantages of each of these models. CONCLUSIONS/SIGNIFICANCE: From our analysis, we conclude that while realist principles may enable straight-forward modelling for some topics, there are crucial aspects of science and the phenomena it studies that do not fit into this approach; realism appears to be over-simplistic which, perversely, results in overly complex ontological models. We suggest that it is impossible to avoid compromise in modelling ontology; a clearer understanding of these compromises will better enable appropriate modelling, fulfilling the many needs for discrete mathematical models within computational biology

Facilitating the development of controlled vocabularies for metabolomics technologies with text mining

BACKGROUND: Many bioinformatics applications rely on controlled vocabularies or ontologies to consistently interpret and seamlessly integrate information scattered across public resources. Experimental data sets from metabolomics studies need to be integrated with one another, but also with data produced by other types of omics studies in the spirit of systems biology, hence the pressing need for vocabularies and ontologies in metabolomics. However, it is time-consuming and non trivial to construct these resources manually. RESULTS: We describe a methodology for rapid development of controlled vocabularies, a study originally motivated by the needs for vocabularies describing metabolomics technologies. We present case studies involving two controlled vocabularies (for nuclear magnetic resonance spectroscopy and gas chromatography) whose development is currently underway as part of the Metabolomics Standards Initiative. The initial vocabularies were compiled manually, providing a total of 243 and 152 terms. A total of 5,699 and 2,612 new terms were acquired automatically from the literature. The analysis of the results showed that full-text articles (especially the Materials and Methods sections) are the major source of technology-specific terms as opposed to paper abstracts. CONCLUSIONS: We suggest a text mining method for efficient corpus-based term acquisition as a way of rapidly expanding a set of controlled vocabularies with the terms used in the scientific literature. We adopted an integrative approach, combining relatively generic software and data resources for time- and cost-effective development of a text mining tool for expansion of controlled vocabularies across various domains, as a practical alternative to both manual term collection and tailor-made named entity recognition methods