Influence of Context on Item Parameters in Forced-Choice Personality Assessments

A fundamental assumption in computerized adaptive testing (CAT) is that item parameters are invariant with respect to context – items surrounding the administered item. This assumption, however, may not hold in forced-choice (FC) assessments, where explicit comparisons are made between items included in the same block. We empirically examined the influence of context on item parameters by comparing parameter estimates from two FC instruments. The first instrument was compiled of blocks of three items, whereas in the second, the context was manipulated by adding one item to each block, resulting in blocks of four. The item parameter estimates were highly similar. However, a small number of significant deviations were observed, confirming the importance of context when designing adaptive FC assessments. Two patterns of such deviations were identified, and methods to reduce their occurrences in a FC CAT setting were proposed. It was shown that with a small proportion of violations of the parameter invariance assumption, score estimation remained stable

Structural, item, and test generalizability of the psychopathology checklist - revised to offenders with intellectual disabilities

The Psychopathy Checklist–Revised (PCL-R) is the most widely used measure of psychopathy in forensic clinical practice, but the generalizability of the measure to offenders with intellectual disabilities (ID) has not been clearly established. This study examined the structural equivalence and scalar equivalence of the PCL-R in a sample of 185 male offenders with ID in forensic mental health settings, as compared with a sample of 1,212 male prisoners without ID. Three models of the PCL-R’s factor structure were evaluated with confirmatory factor analysis. The 3-factor hierarchical model of psychopathy was found to be a good fit to the ID PCL-R data, whereas neither the 4-factor model nor the traditional 2-factor model fitted. There were no cross-group differences in the factor structure, providing evidence of structural equivalence. However, item response theory analyses indicated metric differences in the ratings of psychopathy symptoms between the ID group and the comparison prisoner group. This finding has potential implications for the interpretation of PCL-R scores obtained with people with ID in forensic psychiatric settings

Accelerated in vivo proliferation of memory phenotype CD4+ T-cells in human HIV-1 infection irrespective of viral chemokine co-receptor tropism.

CD4(+) T-cell loss is the hallmark of HIV-1 infection. CD4 counts fall more rapidly in advanced disease when CCR5-tropic viral strains tend to be replaced by X4-tropic viruses. We hypothesized: (i) that the early dominance of CCR5-tropic viruses results from faster turnover rates of CCR5(+) cells, and (ii) that X4-tropic strains exert greater pathogenicity by preferentially increasing turnover rates within the CXCR4(+) compartment. To test these hypotheses we measured in vivo turnover rates of CD4(+) T-cell subpopulations sorted by chemokine receptor expression, using in vivo deuterium-glucose labeling. Deuterium enrichment was modeled to derive in vivo proliferation (p) and disappearance (d*) rates which were related to viral tropism data. 13 healthy controls and 13 treatment-naive HIV-1-infected subjects (CD4 143-569 cells/ul) participated. CCR5-expression defined a CD4(+) subpopulation of predominantly CD45R0(+) memory cells with accelerated in vivo proliferation (p = 2.50 vs 1.60%/d, CCR5(+) vs CCR5(-); healthy controls; P<0.01). Conversely, CXCR4 expression defined CD4(+) T-cells (predominantly CD45RA(+) naive cells) with low turnover rates. The dominant effect of HIV infection was accelerated turnover of CCR5(+)CD45R0(+)CD4(+) memory T-cells (p = 5.16 vs 2.50%/d, HIV vs controls; P<0.05), naïve cells being relatively unaffected. Similar patterns were observed whether the dominant circulating HIV-1 strain was R5-tropic (n = 9) or X4-tropic (n = 4). Although numbers were small, X4-tropic viruses did not appear to specifically drive turnover of CXCR4-expressing cells (p = 0.54 vs 0.72 vs 0.44%/d in control, R5-tropic, and X4-tropic groups respectively). Our data are most consistent with models in which CD4(+) T-cell loss is primarily driven by non-specific immune activation

Conceptualising computerized adaptive testing for measurement of latent variables associated with physical objects

The notion of that more or less of a physical feature affects in different degrees the users' impression with regard to an underlying attribute of a product has frequently been applied in affective engineering. However, those attributes exist only as a premise that cannot directly be measured and, therefore, inferences based on their assessment are error-prone. To establish and improve measurement of latent attributes it is presented in this paper the concept of a stochastic framework using the Rasch model for a wide range of independent variables referred to as an item bank. Based on an item bank, computerized adaptive testing (CAT) can be developed. A CAT system can converge into a sequence of items bracketing to convey information at a user's particular endorsement level. It is through item banking and CAT that the financial benefits of using the Rasch model in affective engineering can be realised

Curtailment and Stochastic Curtailment to Shorten the CES-D

The Center for Epidemiologic Studies-Depression (CES-D) scale is a well-known self-report instrument that is used to measure depressive symptomatology. Respondents who take the full-length version of the CES-D are administered a total of 20 items. This article investigates the use of curtailment and stochastic curtailment (SC), two sequential analysis methods that have recently been proposed for health questionnaires, to reduce the respondent burden associated with taking the CES-D. A post hoc simulation based on 1,392 adolescents' responses to the CES-D was used to compare these methods with a previously proposed computerized adaptive testing (CAT) approach. Curtailment lowered average test lengths by as much as 22% while always matching the classification decision of the full-length CES-D. SC and CAT achieved further reductions in average test length, with SC's classifications exhibiting more concordance with the full-length CES-D than do CAT's. Advantages and disadvantages of each method are discussed. © The Author(s) 2012

Grifonin-1: A Small HIV-1 Entry Inhibitor Derived from the Algal Lectin, Griffithsin

Background: Griffithsin, a 121-residue protein isolated from a red algal Griffithsia sp., binds high mannose N-linked glycans of virus surface glycoproteins with extremely high affinity, a property that allows it to prevent the entry of primary isolates and laboratory strains of T- and M-tropic HIV-1. We used the sequence of a portion of griffithsin's sequence as a design template to create smaller peptides with antiviral and carbohydrate-binding properties. Methodology/Results: The new peptides derived from a trio of homologous β-sheet repeats that comprise the motifs responsible for its biological activity. Our most active antiviral peptide, grifonin-1 (GRFN-1), had an EC50 of 190.8±11.0 nM in in vitro TZM-bl assays and an EC50 of 546.6±66.1 nM in p24gag antigen release assays. GRFN-1 showed considerable structural plasticity, assuming different conformations in solvents that differed in polarity and hydrophobicity. Higher concentrations of GRFN-1 formed oligomers, based on intermolecular β-sheet interactions. Like its parent protein, GRFN-1 bound viral glycoproteins gp41 and gp120 via the N-linked glycans on their surface. Conclusion: Its substantial antiviral activity and low toxicity in vitro suggest that GRFN-1 and/or its derivatives may have therapeutic potential as topical and/or systemic agents directed against HIV-1

Phenotypic Complexity, Measurement Bias, and Poor Phenotypic Resolution Contribute to the Missing Heritability Problem in Genetic Association Studies

Background The variance explained by genetic variants as identified in (genome-wide) genetic association studies is typically small compared to family-based heritability estimates. Explanations of this ‘missing heritability’ have been mainly genetic, such as genetic heterogeneity and complex (epi-)genetic mechanisms. Methodology We used comprehensive simulation studies to show that three phenotypic measurement issues also provide viable explanations of the missing heritability: phenotypic complexity, measurement bias, and phenotypic resolution. We identify the circumstances in which the use of phenotypic sum-scores and the presence of measurement bias lower the power to detect genetic variants. In addition, we show how the differential resolution of psychometric instruments (i.e., whether the instrument includes items that resolve individual differences in the normal range or in the clinical range of a phenotype) affects the power to detect genetic variants. Conclusion We conclude that careful phenotypic data modelling can improve the genetic signal, and thus the statistical power to identify genetic variants by 20-99

Risky business: factor analysis of survey data – assessing the probability of incorrect dimensionalisation

This paper undertakes a systematic assessment of the extent to which factor analysis the correct number of latent dimensions (factors) when applied to ordered categorical survey items (so-called Likert items). We simulate 2400 data sets of uni-dimensional Likert items that vary systematically over a range of conditions such as the underlying population distribution, the number of items, the level of random error, and characteristics of items and item-sets. Each of these datasets is factor analysed in a variety of ways that are frequently used in the extant literature, or that are recommended in current methodological texts. These include exploratory factor retention heuristics such as Kaiser’s criterion, Parallel Analysis and a non-graphical scree test, and (for exploratory and confirmatory analyses) evaluations of model fit. These analyses are conducted on the basis of Pearson and polychoric correlations.We find that, irrespective of the particular mode of analysis, factor analysis applied to ordered-categorical survey data very often leads to over-dimensionalisation. The magnitude of this risk depends on the specific way in which factor analysis is conducted, the number of items, the properties of the set of items, and the underlying population distribution. The paper concludes with a discussion of the consequences of overdimensionalisation, and a brief mention of alternative modes of analysis that are much less prone to such problems

Some recommendations for developing multidimensional computerized adaptive tests for patient-reported outcomes

PURPOSE: Multidimensional item response theory and computerized adaptive testing (CAT) are increasingly used in mental health, quality of life (QoL), and patient-reported outcome measurement. Although multidimensional assessment techniques hold promises, they are more challenging in their application than unidimensional ones. The authors comment on minimal standards when developing multidimensional CATs. METHODS: Prompted by pioneering papers published in QLR, the authors reflect on existing guidance and discussions from different psychometric communities, including guidelines developed for unidimensional CATs in the PROMIS project. RESULTS: The commentary focuses on two key topics: (1) the design, evaluation, and calibration of multidimensional item banks and (2) how to study the efficiency and precision of a multidimensional item bank. The authors suggest that the development of a carefully designed and calibrated item bank encompasses a construction phase and a psychometric phase. With respect to efficiency and precision, item banks should be large enough to provide adequate precision over the full range of the latent constructs. Therefore CAT performance should be studied as a function of the latent constructs and with reference to relevant benchmarks. Solutions are also suggested for simulation studies using real data, which often result in too optimistic evaluations of an item bank's efficiency and precision. DISCUSSION: Multidimensional CAT applications are promising but complex statistical assessment tools which necessitate detailed theoretical frameworks and methodological scrutiny when testing their appropriateness for practical applications. The authors advise researchers to evaluate item banks with a broad set of methods, describe their choices in detail, and substantiate their approach for validation