Using item response theory to explore the psychometric properties of extended matching questions examination in undergraduate medical education

BACKGROUND: As assessment has been shown to direct learning, it is critical that the examinations developed to test clinical competence in medical undergraduates are valid and reliable. The use of extended matching questions (EMQ) has been advocated to overcome some of the criticisms of using multiple-choice questions to test factual and applied knowledge. METHODS: We analysed the results from the Extended Matching Questions Examination taken by 4th year undergraduate medical students in the academic year 2001 to 2002. Rasch analysis was used to examine whether the set of questions used in the examination mapped on to a unidimensional scale, the degree of difficulty of questions within and between the various medical and surgical specialties and the pattern of responses within individual questions to assess the impact of the distractor options. RESULTS: Analysis of a subset of items and of the full examination demonstrated internal construct validity and the absence of bias on the majority of questions. Three main patterns of response selection were identified. CONCLUSION: Modern psychometric methods based upon the work of Rasch provide a useful approach to the calibration and analysis of EMQ undergraduate medical assessments. The approach allows for a formal test of the unidimensionality of the questions and thus the validity of the summed score. Given the metric calibration which follows fit to the model, it also allows for the establishment of items banks to facilitate continuity and equity in exam standards

Multisensory information facilitates reaction speed by enlarging activity difference between superior colliculus hemispheres in rats

Animals can make faster behavioral responses to multisensory stimuli than to unisensory stimuli. The superior colliculus (SC), which receives multiple inputs from different sensory modalities, is considered to be involved in the initiation of motor responses. However, the mechanism by which multisensory information facilitates motor responses is not yet understood. Here, we demonstrate that multisensory information modulates competition among SC neurons to elicit faster responses. We conducted multiunit recordings from the SC of rats performing a two-alternative spatial discrimination task using auditory and/or visual stimuli. We found that a large population of SC neurons showed direction-selective activity before the onset of movement in response to the stimuli irrespective of stimulation modality. Trial-by-trial correlation analysis showed that the premovement activity of many SC neurons increased with faster reaction speed for the contraversive movement, whereas the premovement activity of another population of neurons decreased with faster reaction speed for the ipsiversive movement. When visual and auditory stimuli were presented simultaneously, the premovement activity of a population of neurons for the contraversive movement was enhanced, whereas the premovement activity of another population of neurons for the ipsiversive movement was depressed. Unilateral inactivation of SC using muscimol prolonged reaction times of contraversive movements, but it shortened those of ipsiversive movements. These findings suggest that the difference in activity between the SC hemispheres regulates the reaction speed of motor responses, and multisensory information enlarges the activity difference resulting in faster responses

Internal construct validity of the Warwick-Edinburgh Mental Well-being Scale (WEMWBS): a Rasch analysis using data from the Scottish Health Education Population Survey

Background: The Warwick-Edinburgh Mental Well-Being Scale (WEMWBS) was developed to meet demand for instruments to measure mental well-being. It comprises 14 positively phrased Likert-style items and fulfils classic criteria for scale development. We report here the internal construct validity of WEMWBS from the perspective of the Rasch measurement model. Methods: The model was applied to data collected from 779 respondents in Wave 12 (Autumn 2006) of the Scottish Health Education Population Survey. Respondents were aged 16–74 (average 41.9) yrs. Results: Initial fit to model expectations was poor. The items 'I've been feeling good about myself', 'I've been interested in new things' and 'I've been feeling cheerful' all showed significant misfit to model expectations, and were deleted. This led to a marginal improvement in fit to the model. After further analysis, more items were deleted and a strict unidimensional seven item scale (the Short Warwick Edinburgh Mental Well-Being Scale (SWEMWBS)) was resolved. Many items deleted because of misfit with model expectations showed considerable bias for gender. Two retained items also demonstrated bias for gender but, at the scale level, cancelled out. One further retained item 'I've been feeling optimistic about the future' showed bias for age. The correlation between the 14 item and 7 item versions was 0.954. Given fit to the Rasch model, and strict unidimensionality, SWEMWBS provides an interval scale estimate of mental well-being. Conclusion: A short 7 item version of WEMWBS was found to satisfy the strict unidimensionality expectations of the Rasch model, and be largely free of bias. This scale, SWEMWBS, provides a raw score-interval scale transformation for use in parametric procedures. In terms of face validity, SWEMWBS presents a more restricted view of mental well-being than the 14 item WEMWBS, with most items representing aspects of psychological and eudemonic well-being, and few covering hedonic well-being or affect. However, robust measurement properties combined with brevity make SWEMWBS preferable to WEMWBS at present for monitoring mental well-being in populations. Where face validity is an issue there remain arguments for continuing to collect data on the full 14 item WEMWBS

Radically open-dialectical behavior therapy for adult anorexia nervosa: feasibility and outcomes from an inpatient program

Background Anorexia Nervosa (AN) is a highly life-threatening disorder that is extremely difficult to treat. There is evidence that family-based therapies are effective for adolescent AN, but no treatment has been proven to be clearly effective for adult AN. The methodological challenges associated with studying the disorder have resulted in recommendations that new treatments undergo preliminary testing prior to being evaluated in a randomized clinical trial. The aim of this study was to provide preliminary evidence on the effectiveness of a treatment program based on a novel adaptation of Dialectical Behavior Therapy (DBT) for adult Anorexia Nervosa (Radically Open-DBT; RO-DBT) that conceptualizes AN as a disorder of overcontrol. Methods Forty-seven individuals diagnosed with Anorexia Nervosa-restrictive type (AN-R; mean admission body mass index = 14.43) received the adapted DBT inpatient program (mean length of treatment = 21.7 weeks). Results Seventy-two percent completed the treatment program demonstrating substantial increases in body mass index (BMI; mean change in BMI = 3.57) corresponding to a large effect size (d = 1.91). Thirty-five percent of treatment completers were in full remission, and an additional 55% were in partial remission resulting in an overall response rate of 90%. These same individuals demonstrated significant and large improvements in eating-disorder related psychopathology symptoms (d = 1.17), eating disorder-related quality of life (d = 1.03), and reductions in psychological distress (d = 1.34). Conclusions RO-DBT was associated with significant improvements in weight gain, reductions in eating disorder symptoms, decreases in eating-disorder related psychopathology and increases in eating disorder-related quality of life in a severely underweight sample. These findings provide preliminary support for RO-DBT in treating AN-R suggesting the importance of further evaluation examining long-term outcomes using randomized controlled trial methodology

Effectiveness of a web-based treatment program using intensive therapeutic support for female patients with bulimia nervosa, binge eating disorder and eating disorders not otherwise specified: study protocol of a randomized controlled trial

Background: Disordered eating behavior and body dissatisfaction affect a large proportion of the Dutch population and account for severe psychological, physical and social morbidity. Yet, the threshold for seeking professional care is still high. In the Netherlands, only 7.5% of patients with bulimia nervosa and 33% of patients with anorexia nervosa are treated within the mental health care system. Easily accessible and low-threshold interventions, therefore, are needed urgently. The internet has great potential to offer such interventions. The aim of this study is to determine whether a web-based treatment program for patients with eating disorders can improve eating disorder psychopathology among female patients with bulimia nervosa, binge eating disorder and eating disorders not otherwise specified. Methods/design: This randomized controlled trial will compare the outcomes of an experimental treatment group to a waiting list control group. In the web-based treatment program, participants will communicate personally and asynchronously with their therapists exclusively via the internet. The first part of the program will focus on analyzing eating attitudes and behaviors. In the second part of the program participants will learn how to change their attitudes and behaviors. Participants assigned to the waiting list control group will receive no-reply email messages once every two weeks during the waiting period of 15 weeks, after which they can start the program. The primary outcome measure is an improvement in eating disorder psychopathology as determined by the Eating Disorder Examination Questionnaire. Secondary outcomes include improvements in body image, physical and mental health, body weight, self-esteem, quality of life, and social contacts. In addition, the participants’ motivation for treatment and their acceptability of the program and the therapeutic alliance will be measured. The study will follow the recommendations in the CONSORT statement relating to designing and reporting on RCTs. Discussion: This study protocol presents the design of a RCT for evaluating the effectiveness of a web-based treatment program using intensive therapeutic support for female patients with bulimia nervosa, binge eating disorder and eating disorders not otherwise specified

Body size estimation in women with anorexia nervosa and healthy controls using 3D avatars

A core feature of anorexia nervosa is an over-estimation of body size. However, quantifying this over-estimation has been problematic as existing methodologies introduce a series of artefacts and inaccuracies in the stimuli used for judgements of body size. To overcome these problems, we have: (i) taken 3D scans of 15 women who have symptoms of anorexia (referred to henceforth as anorexia spectrum disorders, ANSD) and 15 healthy control women, (ii) used a 3D modelling package to build avatars from the scans, (iii) manipulated the body shapes of these avatars to reflect biometrically accurate, continuous changes in body mass index (BMI), (iv) used these personalized avatars as stimuli to allow the women to estimate their body size. The results show that women who are currently receiving treatment for ANSD show an over-estimation of body size which rapidly increases as their own BMI increases. By contrast, the women acting as healthy controls can accurately estimate their body size irrespective of their own BMI. This study demonstrates the viability of combining 3D scanning and CGI techniques to create personalised realistic avatars of individual patients to directly assess their body image perception

Venous hemodynamics in neurological disorders: an analytical review with hydrodynamic analysis.

Venous abnormalities contribute to the pathophysiology of several neurological conditions. This paper reviews the literature regarding venous abnormalities in multiple sclerosis (MS), leukoaraiosis, and normal-pressure hydrocephalus (NPH). The review is supplemented with hydrodynamic analysis to assess the effects on cerebrospinal fluid (CSF) dynamics and cerebral blood flow (CBF) of venous hypertension in general, and chronic cerebrospinal venous insufficiency (CCSVI) in particular.CCSVI-like venous anomalies seem unlikely to account for reduced CBF in patients with MS, thus other mechanisms must be at work, which increase the hydraulic resistance of the cerebral vascular bed in MS. Similarly, hydrodynamic changes appear to be responsible for reduced CBF in leukoaraiosis. The hydrodynamic properties of the periventricular veins make these vessels particularly vulnerable to ischemia and plaque formation.Venous hypertension in the dural sinuses can alter intracranial compliance. Consequently, venous hypertension may change the CSF dynamics, affecting the intracranial windkessel mechanism. MS and NPH appear to share some similar characteristics, with both conditions exhibiting increased CSF pulsatility in the aqueduct of Sylvius.CCSVI appears to be a real phenomenon associated with MS, which causes venous hypertension in the dural sinuses. However, the role of CCSVI in the pathophysiology of MS remains unclear

Nothing Lasts Forever: Environmental Discourses on the Collapse of Past Societies

The study of the collapse of past societies raises many questions for the theory and practice of archaeology. Interest in collapse extends as well into the natural sciences and environmental and sustainability policy. Despite a range of approaches to collapse, the predominant paradigm is environmental collapse, which I argue obscures recognition of the dynamic role of social processes that lie at the heart of human communities. These environmental discourses, together with confusion over terminology and the concepts of collapse, have created widespread aporia about collapse and resulted in the creation of mixed messages about complex historical and social processes

Multi-messenger observations of a binary neutron star merger

On 2017 August 17 a binary neutron star coalescence candidate (later designated GW170817) with merger time 12:41:04 UTC was observed through gravitational waves by the Advanced LIGO and Advanced Virgo detectors. The Fermi Gamma-ray Burst Monitor independently detected a gamma-ray burst (GRB 170817A) with a time delay of ~1.7 s with respect to the merger time. From the gravitational-wave signal, the source was initially localized to a sky region of 31 deg2 at a luminosity distance of 40+8-8 Mpc and with component masses consistent with neutron stars. The component masses were later measured to be in the range 0.86 to 2.26 Mo. An extensive observing campaign was launched across the electromagnetic spectrum leading to the discovery of a bright optical transient (SSS17a, now with the IAU identification of AT 2017gfo) in NGC 4993 (at ~40 Mpc) less than 11 hours after the merger by the One- Meter, Two Hemisphere (1M2H) team using the 1 m Swope Telescope. The optical transient was independently detected by multiple teams within an hour. Subsequent observations targeted the object and its environment. Early ultraviolet observations revealed a blue transient that faded within 48 hours. Optical and infrared observations showed a redward evolution over ~10 days. Following early non-detections, X-ray and radio emission were discovered at the transient’s position ~9 and ~16 days, respectively, after the merger. Both the X-ray and radio emission likely arise from a physical process that is distinct from the one that generates the UV/optical/near-infrared emission. No ultra-high-energy gamma-rays and no neutrino candidates consistent with the source were found in follow-up searches. These observations support the hypothesis that GW170817 was produced by the merger of two neutron stars in NGC4993 followed by a short gamma-ray burst (GRB 170817A) and a kilonova/macronova powered by the radioactive decay of r-process nuclei synthesized in the ejecta

Bandit strategies in social search: the case of the DARPA red balloon challenge

Collective search for people and information has tremendously benefited from emerging communication technologies that leverage the wisdom of the crowds, and has been increasingly influential in solving time-critical tasks such as the DARPA Network Challenge (DNC, also known as the Red Balloon Challenge). However, while collective search often invests significant resources in encouraging the crowd to contribute new information, the effort invested in verifying this information is comparable, yet often neglected in crowdsourcing models. This paper studies how the exploration-verification trade-off displayed by the teams modulated their success in the DNC, as teams had limited human resources that they had to divide between recruitment (exploration) and verification (exploitation). Our analysis suggests that team performance in the DNC can be modelled as a modified multi-armed bandit (MAB) problem, where information arrives to the team originating from sources of different levels of veracity that need to be assessed in real time. We use these insights to build a data-driven agent-based model, based on the DNC’s data, to simulate team performance. The simulation results match the observed teams’ behavior and demonstrate how to achieve the best balance between exploration and exploitation for general time-critical collective search tasks.</p