Scoring method of a Situational Judgment Test:influence on internal consistency reliability, adverse impact and correlation with personality?

textabstractSituational Judgment Tests (SJTs) are increasingly used for medical school selection. Scoring an SJT is more complicated than scoring a knowledge test, because there are no objectively correct answers. The scoring method of an SJT may influence the construct and concurrent validity and the adverse impact with respect to non-traditional students. Previous research has compared only a small number of scoring methods and has not studied the effect of scoring method on internal consistency reliability. This study compared 28 different scoring methods for a rating SJT on internal consistency reliability, adverse impact and correlation with personality. The scoring methods varied on four aspects: the way of controlling for systematic error, and the type of reference group, distance and central tendency statistic. All scoring methods were applied to a previously validated integrity-based SJT, administered to 931 medical school applicants. Internal consistency reliability varied between .33 and .73, which is likely explained by the dependence of coefficient alpha on the total score variance. All scoring methods led to significantly higher scores for the ethnic majority than for the non-Western minorities, with effect sizes ranging from 0.48 to 0.66. Eighteen scoring methods showed a significant small positive correlation with agreeableness. Four scoring methods showed a significant small positive correlation with conscientiousness. The way of controlling for systematic error was the most influential scoring method aspect. These results suggest that the increased use of SJTs for selection into medical school must be accompanied by a thorough examination of the scoring method to be used

Prognostic value of cortically induced motor evoked activity by TMS in chronic stroke: caveats from a very revealing single clinical case

Background: We report the case of a chronic stroke patient (62 months after injury) showing total absence of motor activity evoked by transcranial magnetic stimulation (TMS) of spared regions of the left motor cortex, but near-to-complete recovery of motor abilities in the affected hand. Case presentation: Multimodal investigations included detailed TMS based motor mapping, motor evoked potentials (MEP), and Cortical Silent period (CSP) as well as functional magnetic resonance imaging (fMRI) of motor activity, MRI based lesion analysis and Diffusion Tensor Imaging (DTI) Tractography of corticospinal tract (CST). Anatomical analysis revealed a left hemisphere subinsular lesion interrupting the descending left CST at the level of the internal capsule. The absence of MEPs after intense TMS pulses to the ipsilesional M1, and the reversible suppression of ongoing electromyographic (EMG) activity (indexed by CSP) demonstrate a weak modulation of subcortical systems by the ipsilesional left frontal cortex, but an inability to induce efficient descending volleys from those cortical locations to right hand and forearm muscles. Functional MRI recordings under grasping and finger tapping patterns involving the affected hand showed slight signs of subcortical recruitment, as compared to the unaffected hand and hemisphere, as well as the expected cortical activations. Conclusions: The potential sources of motor voluntary activity for the affected hand in absence of MEPs are discussed. We conclude that multimodal analysis may contribute to a more accurate prognosis of stroke patients

Social Rewards Enhance Offline Improvements in Motor Skill

Motor skill memory is first encoded online in a fragile form during practice and then converted into a stable form by offline consolidation, which is the behavioral stage critical for successful learning. Praise, a social reward, is thought to boost motor skill learning by increasing motivation, which leads to increased practice. However, the effect of praise on consolidation is unknown. Here, we tested the hypothesis that praise following motor training directly facilitates skill consolidation. Forty-eight healthy participants were trained on a sequential finger-tapping task. Immediately after training, participants were divided into three groups according to whether they received praise for their own training performance, praise for another participant's performance, or no praise. Participants who received praise for their own performance showed a significantly higher rate of offline improvement relative to other participants when performing a surprise recall test of the learned sequence. On the other hand, the average performance of the novel sequence and randomly-ordered tapping did not differ between the three experimental groups. These results are the first to indicate that praise-related improvements in motor skill memory are not due to a feedback-incentive mechanism, but instead involve direct effects on the offline consolidation process