Validity of very short answer versus single best answer questions for undergraduate assessment

Background Single Best Answer (SBA) questions are widely used in undergraduate and postgraduate medical examinations. Selection of the correct answer in SBA questions may be subject to cueing and therefore might not test the student’s knowledge. In contrast to this artificial construct, doctors are ultimately required to perform in a real-life setting that does not offer a list of choices. This professional competence can be tested using Short Answer Questions (SAQs), where the student writes the correct answer without prompting from the question. However, SAQs cannot easily be machine marked and are therefore not feasible as an instrument for testing a representative sample of the curriculum for a large number of candidates. We hypothesised that a novel assessment instrument consisting of very short answer (VSA) questions is a superior test of knowledge than assessment by SBA. Methods We conducted a prospective pilot study on one cohort of 266 medical students sitting a formative examination. All students were assessed by both a novel assessment instrument consisting of VSAs and by SBA questions. Both instruments tested the same knowledge base. Using the filter function of Microsoft Excel, the range of answers provided for each VSA question was reviewed and correct answers accepted in less than two minutes. Examination results were compared between the two methods of assessment. Results Students scored more highly in all fifteen SBA questions than in the VSA question format, despite both examinations requiring the same knowledge base. Conclusions Valid assessment of undergraduate and postgraduate knowledge can be improved by the use of VSA questions. Such an approach will test nascent physician ability rather than ability to pass exams

POTs: Protective Optimization Technologies

Algorithmic fairness aims to address the economic, moral, social, and political impact that digital systems have on populations through solutions that can be applied by service providers. Fairness frameworks do so, in part, by mapping these problems to a narrow definition and assuming the service providers can be trusted to deploy countermeasures. Not surprisingly, these decisions limit fairness frameworks' ability to capture a variety of harms caused by systems. We characterize fairness limitations using concepts from requirements engineering and from social sciences. We show that the focus on algorithms' inputs and outputs misses harms that arise from systems interacting with the world; that the focus on bias and discrimination omits broader harms on populations and their environments; and that relying on service providers excludes scenarios where they are not cooperative or intentionally adversarial. We propose Protective Optimization Technologies (POTs). POTs provide means for affected parties to address the negative impacts of systems in the environment, expanding avenues for political contestation. POTs intervene from outside the system, do not require service providers to cooperate, and can serve to correct, shift, or expose harms that systems impose on populations and their environments. We illustrate the potential and limitations of POTs in two case studies: countering road congestion caused by traffic-beating applications, and recalibrating credit scoring for loan applicants.Comment: Appears in Conference on Fairness, Accountability, and Transparency (FAT* 2020). Bogdan Kulynych and Rebekah Overdorf contributed equally to this work. Version v1/v2 by Seda G\"urses, Rebekah Overdorf, and Ero Balsa was presented at HotPETS 2018 and at PiMLAI 201

High-stakes remote-access open-book examinations

The COVID-19 pandemic has led to unprecedented challenges in medical school assessments. Final year high-stakes assessments have classically used closed book examinations (CBEs). Alternative methods of assessment such as open book examinations (OBEs) are emerging but are not routinely used in final year medical school exams. OBEs encourage the use of problem-solving skills more akin to those used in real-life. There is currently limited data comparing OBEs with CBEs. A systematic review showed there was insufficient evidence to support the exclusive use of either CBEs or OBEs in assessment, however the studies conducted to date have rarely looked at high-stakes assessments due to concerns about the validity of OBEs1

How a Diverse Research Ecosystem Has Generated New Rehabilitation Technologies: Review of NIDILRR’s Rehabilitation Engineering Research Centers

Over 50 million United States citizens (1 in 6 people in the US) have a developmental, acquired, or degenerative disability. The average US citizen can expect to live 20% of his or her life with a disability. Rehabilitation technologies play a major role in improving the quality of life for people with a disability, yet widespread and highly challenging needs remain. Within the US, a major effort aimed at the creation and evaluation of rehabilitation technology has been the Rehabilitation Engineering Research Centers (RERCs) sponsored by the National Institute on Disability, Independent Living, and Rehabilitation Research. As envisioned at their conception by a panel of the National Academy of Science in 1970, these centers were intended to take a “total approach to rehabilitation”, combining medicine, engineering, and related science, to improve the quality of life of individuals with a disability. Here, we review the scope, achievements, and ongoing projects of an unbiased sample of 19 currently active or recently terminated RERCs. Specifically, for each center, we briefly explain the needs it targets, summarize key historical advances, identify emerging innovations, and consider future directions. Our assessment from this review is that the RERC program indeed involves a multidisciplinary approach, with 36 professional fields involved, although 70% of research and development staff are in engineering fields, 23% in clinical fields, and only 7% in basic science fields; significantly, 11% of the professional staff have a disability related to their research. We observe that the RERC program has substantially diversified the scope of its work since the 1970’s, addressing more types of disabilities using more technologies, and, in particular, often now focusing on information technologies. RERC work also now often views users as integrated into an interdependent society through technologies that both people with and without disabilities co-use (such as the internet, wireless communication, and architecture). In addition, RERC research has evolved to view users as able at improving outcomes through learning, exercise, and plasticity (rather than being static), which can be optimally timed. We provide examples of rehabilitation technology innovation produced by the RERCs that illustrate this increasingly diversifying scope and evolving perspective. We conclude by discussing growth opportunities and possible future directions of the RERC program

Cisplatin-induced emesis: systematic review and meta-analysis of the ferret model and the effects of 5-HT3 receptor antagonists

PURPOSE: The ferret cisplatin emesis model has been used for ~30 years and enabled identification of clinically used anti-emetics. We provide an objective assessment of this model including efficacy of 5-HT(3) receptor antagonists to assess its translational validity. METHODS: A systematic review identified available evidence and was used to perform meta-analyses. RESULTS: Of 182 potentially relevant publications, 115 reported cisplatin-induced emesis in ferrets and 68 were included in the analysis. The majority (n = 53) used a 10 mg kg(−1) dose to induce acute emesis, which peaked after 2 h. More recent studies (n = 11) also used 5 mg kg(−1), which induced a biphasic response peaking at 12 h and 48 h. Overall, 5-HT(3) receptor antagonists reduced cisplatin (5 mg kg(−1)) emesis by 68% (45–91%) during the acute phase (day 1) and by 67% (48–86%) and 53% (38–68%, all P < 0.001), during the delayed phase (days 2, 3). In an analysis focused on the acute phase, the efficacy of ondansetron was dependent on the dosage and observation period but not on the dose of cisplatin. CONCLUSION: Our analysis enabled novel findings to be extracted from the literature including factors which may impact on the applicability of preclinical results to humans. It reveals that the efficacy of ondansetron is similar against low and high doses of cisplatin. Additionally, we showed that 5-HT(3) receptor antagonists have a similar efficacy during acute and delayed emesis, which provides a novel insight into the pharmacology of delayed emesis in the ferret

The relevance of cortisol co-secretion from aldosterone-producing adenomas

AIMS AND OBJECTIVES: Adrenal adenomas are usually non-functioning, but can secrete aldosterone or cortisol. It has recently been suggested that many more adenomas than previously thought secrete more than one hormone. This has important implications for their clinical management. Our aim was to determine the frequency of cortisol co-secretion in primary hyperaldosteronism at our institution and investigate the difference in metabolic profiles and clinical outcomes between co-secreting and non-co-secreting patients. DESIGN AND PATIENTS: A retrospective study of 25 patients with primary hyperaldosteronism who also underwent formal dexamethasone suppression tests to determine cortisol co-secretion. MEASUREMENTS: Post-dexamethasone suppression test cortisol, serum ALT, total cholesterol, HDL-cholesterol, LDL-cholesterol, HbA1C (were recorded) and mean arterial pressure are reported in this cohort of patients with primary hyperaldosteronism. RESULTS: Four out of 25 patients with primary hyperaldosteronism failed dexamethasone suppression tests. This suggests a frequency of co-secretion ranging between 4 and 16%. No significant difference was found in serum ALT, total cholesterol, serum HDL-cholesterol, LDL-cholesterol and mean arterial blood pressure at presentation between co-secretors and non-co-secretors. CONCLUSION: A frequency range of 4-16% suggests that a significant proportion of patients with primary hyperaldosteronism co-secrete cortisol. Co-secretors did not have a worse metabolic profile than non-secretors. The impact of co-secretion on metabolic profile and surgical management remains unclear and warrants further study

Frequency of Gestational diabetes mellitus and impaired glucose tolerance in urban Sudanese pregnant women in the third trimester

Background: Impaired glucose tolerance may be defined as intermediate group of individuals whose carbohydrate metabolism does not constitute diabetes but is not entirely normal. It carries a higher risk of developing microvascular disease and a significant percentage of these patientseventually become diabetics.Objective: of the study was to estimate the frequency of gestational diabetes mellitus (GDM) and impaired glucose tolerance (IGT) in urban Sudanese pregnant women in the third trimester. The study also showed the effect of age and parity on IGT.Methodology: The study was carried out on hundred pregnant women in the third trimester.Results: The frequency of gestational diabetes was 2% and it was 6% for the IGT incidence whereas, 92% of the pregnant women revealed normal fasting plasma levels. The IGT pregnant women were older than the control pregnant women but, the age difference was not significant [28.7± 5.5 years (mean ± S.D) vs. 27.3 ± 4.8 respectively, p&gt;0.05] . Also, the IGT pregnant women were found to have mean parity significantly greater than that of the control group [ 6.7 ± 2 (mean ± S.D.) vs. 3.9 ± 2.1 respectively , p&lt;0.001].Conclusion: The frequency of GDM and IGT in Sudanese pregnant women is within the universal estimates and parity is an important risk factor that affects impaired glucose tolerance incidence in pregnancy.Keywords: microvascular, chemical diabetes, carbohydrate intolerance

Theory of magneto-optical effects in metallic thin films.

The formulation of the variational principle of Jones and Sondheimer, which they used to optimise the functional form of the electric field inside a semi-infinite specimen, is modified and extended to examine the effects of size and surfaces on the optical properties in the extreme anomalous relaxation region of a metallic thin film in a constant magnetic field. For this purpose, a variational integral is defined as an expression quadratic in the tangential components of the electric field at the surfaces of the film. The coefficients of this equation are related to four 2x2 tensors, closely related to the usual admittance tensor, in terms of which the reflection and transmission tensors can he written. With the magnetic field parallel to the surface of the specimen the high degree of symmetry enables the cases of longitudinal and transverse propagation to be treated separately. With the sum of two exponentials as a trial function for the electric field inside the film, both classical and non-classical reults for the longitudinal and transverse propagation are obtained for the reflectivity, transmittivity and absorptivity of the film. Numerical calculations have been carried out for a model of a degenerate semiconductor with N=10[18], m*=0.1m[o], epsilon=16, where N is the number of electrons per unit volume, m* the effective mass, m[o] the electronic mass and the permittivity, at various thicknesses, frequencies and magnetic fields. The Voigt effect is also included in the theory and numerical calculations for this hove also been carried out using the same model. The results show that the classical size effects greatly influence the behaviour of the transmittivity, reflectivity, absorptivity and the Voigt rotation. Enhanced absorption due to diffuse scattering of electrons at the surface is also observed

Are All Placebo Effects Equal? Placebo Pills, Sham Acupuncture, Cue Conditioning and Their Association

Placebo treatments and healing rituals have been used to treat pain throughout history. The present within-subject crossover study examines the variability in individual responses to placebo treatment with verbal suggestion and visual cue conditioning by investigating whether responses to different types of placebo treatment, as well as conditioning responses, correlate with one another. Secondarily, this study also examines whether responses to sham acupuncture correlate with responses to genuine acupuncture. Healthy subjects were recruited to participate in two sequential experiments. Experiment one is a five-session crossover study. In each session, subjects received one of four treatments: placebo pills (described as Tylenol), sham acupuncture, genuine acupuncture, or no treatment rest control condition. Before and after each treatment, paired with a verbal suggestion of positive effect, each subject's pain threshold, pain tolerance, and pain ratings to calibrated heat pain were measured. At least 14 days after completing experiment one, all subjects were invited to participate in experiment two, during which their analgesic responses to conditioned visual cues were tested. Forty-eight healthy subjects completed experiment one, and 45 completed experiment two. The results showed significantly different effects of genuine acupuncture, placebo pill and rest control on pain threshold. There was no significant association between placebo pills, sham acupuncture and cue conditioning effects, indicating that individuals may respond to unique healing rituals in different ways. This outcome suggests that placebo response may be a complex behavioral phenomenon that has properties that comprise a state, rather than a trait characteristic. This could explain the difficulty of detecting a signature for “placebo responders.” However, a significant association was found between the genuine and sham acupuncture treatments, implying that the non-specific effects of acupuncture may contribute to the analgesic effect observed in genuine acupuncture analgesia.National Center for Complementary and Alternative Medicine (U.S.) (R01AT005280

Meiotic silencing and fragmentation of the male germline restricted chromosome in zebra finch

During male meiotic prophase in mammals, X and Y are in a largely unsynapsed configuration, which is thought to trigger meiotic sex chromosome inactivation (MSCI). In avian species, females are ZW, and males ZZ. Although Z and W in chicken oocytes show complete, largely heterologous synapsis, they too undergo MSCI, albeit only transiently. The W chromosome is already inactive in early meiotic prophase, and inactive chromatin marks may spread on to the Z upon synapsis. Mammalian MSCI is considered as a specialised form of the general meiotic silencing mechanism, named meiotic silencing of unsynapsed chromatin (MSUC). Herein, we studied the avian form of MSUC, by analysing the behaviour of the peculiar germline restricted chromosome (GRC) that is present as a single copy in zebra finch spermatocytes. In the female germline, this chromosome is present in two copies, which normally synapse and recombine. In contrast, during male meiosis, the single GRC is always eliminated. We found that the GRC in the male germline is silenced from early leptotene onwards, similar to the W chromosome in avian oocytes. The GRC remains largely unsynapsed throughout meiotic prophase I, although patches of SYCP1 staining indicate that part of the GRC may self-synapse. In addition, the GRC is largely devoid of meiotic double strand breaks. We observed a lack of the inner centromere protein INCENP on the GRC and elimination of the GRC following metaphase I. Subsequently, the GRC forms a micronucleus in which the DNA is fragmented. We conclude that in contrast to MSUC in mammals, meiotic silencing of this single chromosome in the avian germline occurs prior to, and independent of DNA double strand breaks and chromosome pairing, hence we have named this phenomenon meiotic silencing prior to synapsis (MSPS)