Systems validation: application to statistical programs

BACKGROUND: In 2003, the United States Food and Drug Administration (FDA) released a guidance document on the scope of "Part 11" enforcement. In this guidance document, the FDA indicates an expectation of a risk-based approach to determining which systems should undergo validation. Since statistical programs manage and manipulate raw data, their implementation should be critically reviewed to determine whether or not they should undergo validation. However, the concepts of validation are not often discussed in biostatistics curriculum. DISCUSSION: This paper summarizes a "Plan, Do, Say" approach to validation that can be incorporated into statistical training so that biostatisticians can understand and implement validation principles in their research. SUMMARY: Validation is a process that requires dedicated attention. The process of validation can be easily understood in the context of the scientific method

The CONSORT statement: revised recommendations for improving the quality of reports of parallel group randomized trials

To comprehend the results of a randomised controlled trial (RCT), readers must understand its design, conduct, analysis, and interpretation. That goal can be achieved only through total transparency from authors. Despite several decades of educational efforts, the reporting of RCTs needs improvement. Investigators and editors developed the original CONSORT (Consolidated Standards of Reporting Trials) statement to help authors improve reporting by use of a checklist and flow diagram. The revised CONSORT statement presented here incorporates new evidence and addresses some criticisms of the original statement. The checklist items pertain to the content of the Title, Abstract, Introduction, Methods, Results, and Discussion. The revised checklist includes 22 items selected because empirical evidence indicates that not reporting this information is associated with biased estimates of treatment effect, or because the information is essential to judge the reliability or relevance of the findings. We intended the flow diagram to depict the passage of participants through an RCT. The revised flow diagram depicts information from four stages of a trial (enrolment, intervention allocation, follow-up, and analysis). The diagram explicitly shows the number of participants, for each intervention group, included in the primary data analysis. Inclusion of these numbers allows the reader to judge whether the authors have done an intention-to-treat analysis. In sum, the CONSORT statement is intended to improve the reporting of an RCT, enabling readers to understand a trial's conduct and to assess the validity of its results

Introducing EMMIE: An evidence rating scale to encourage mixed-method crime prevention synthesis reviews

Objectives This short report describes the need for, and the development of, a coding system to distil the quality and coverage of systematic reviews of the evidence relating to crime prevention interventions. The starting point for the coding system concerns the evidence needs of policymakers and practitioners. Methods The coding scheme (EMMIE) proposed builds on previous scales that have been developed to assess the probity, coverage and utility of evidence both in health and criminal justice. It also draws on the principles of realist synthesis and review. Results The proposed EMMIE scale identifies five dimensions to which systematic reviews intended to inform crime prevention should speak. These are the Effect of intervention, the identification of the causal Mechanism(s) through which interventions are intended to work, the factors that Moderate their impact, the articulation of practical Implementation issues, and the Economic costs of intervention

A systematic review of naturalistic interventions in refugee populations

Naturalistic interventions with refugee populations examine outcomes following mental health interventions in existing refugee service organisations. The current review aimed to examine outcomes of naturalistic interventions and quality of the naturalistic intervention literature in refugee populations with the view to highlight the strengths and limitations of naturalistic intervention studies. Database search was conducted using the search terms ‘refugee’, ‘asylum seeker’, ‘treatment’, ‘therapy’ and ‘intervention. No date limitations were applied, but searches were limited to articles written in English. Seven studies were identified that assessed the outcome of naturalistic interventions on adult refugees or asylum seekers in a country of resettlement using quantitative outcome measures. Results showed significant variation in the outcomes of naturalistic intervention studies, with a trend towards showing decreased symptomatology at post-intervention. However, conclusions are limited by methodological problems of the studies reviewed, particularly poor documentation of intervention methods and lack of control in the design of naturalistic intervention studies. Further examination of outcomes following naturalistic interventions is needed with studies which focus on increasing the rigour of the outcome assessment process

A framework for power analysis using a structural equation modelling procedure

BACKGROUND: This paper demonstrates how structural equation modelling (SEM) can be used as a tool to aid in carrying out power analyses. For many complex multivariate designs that are increasingly being employed, power analyses can be difficult to carry out, because the software available lacks sufficient flexibility. Satorra and Saris developed a method for estimating the power of the likelihood ratio test for structural equation models. Whilst the Satorra and Saris approach is familiar to researchers who use the structural equation modelling approach, it is less well known amongst other researchers. The SEM approach can be equivalent to other multivariate statistical tests, and therefore the Satorra and Saris approach to power analysis can be used. METHODS: The covariance matrix, along with a vector of means, relating to the alternative hypothesis is generated. This represents the hypothesised population effects. A model (representing the null hypothesis) is then tested in a structural equation model, using the population parameters as input. An analysis based on the chi-square of this model can provide estimates of the sample size required for different levels of power to reject the null hypothesis. CONCLUSIONS: The SEM based power analysis approach may prove useful for researchers designing research in the health and medical spheres

Feasibility and Effectiveness of Using Wearable Activity Trackers in Youth: A Systematic Review

Background: The proliferation and popularity of wearable activity trackers (eg, Fitbit, Jawbone, Misfit) may present an opportunity to integrate such technology into physical activity interventions. While several systematic reviews have reported intervention effects of using wearable activity trackers on adults’ physical activity levels, none to date have focused specifically on children and adolescents.Objective: The aim of this review was to examine the effectiveness of wearable activity trackers as a tool for increasing children’s and adolescents’ physical activity levels. We also examined the feasibility of using such technology in younger populations (age range 5-19 years).Methods: We conducted a systematic search of 5 electronic databases, reference lists, and personal archives to identify articles published up until August 2016 that met the inclusion criteria. Articles were included if they (1) specifically examined the use of a wearable device within an intervention or a feasibility study; (2) included participants aged 5-19 years old; (3) had a measure of physical activity as an outcome variable for intervention studies; (4) reported process data concerning the feasibility of the device in feasibility studies; and (5) were published in English. Data were analyzed in August 2016.Results: In total, we identified and analyzed 5 studies (3 intervention, 2 feasibility). Intervention delivery ranged from 19 days to 3 months, with only 1 study using a randomized controlled trial design. Wearable activity trackers were typically combined with other intervention approaches such as goal setting and researcher feedback. While intervention effects were generally positive, the reported differences were largely nonsignificant. The feasibility studies indicated that monitor comfort and design and feedback features were important factors to children and adolescents.Conclusions: There is a paucity of research concerning the effectiveness and feasibility of wearable activity trackers as a tool for increasing children’s and adolescents’ physical activity levels. While there are some preliminary data to suggest these devices may have the potential to increase activity levels through self-monitoring and goal setting in the short term, more research is needed to establish longer-term effects on behavior

Mindfulness-based stress reduction in Parkinson’s disease: a systematic review

Background: Mindfulness based stress reduction (MBSR) is increasingly being used to improve outcomes such as stress and depression in a range of long-term conditions (LTCs). While systematic reviews on MBSR have taken place for a number of conditions there remains limited information on its impact on individuals with Parkinson’s disease (PD). Methods: Medline, Central, Embase, Amed, CINAHAL were searched in March 2016. These databases were searched using a combination of MeSH subject headings where available and keywords in the title and abstracts. We also searched the reference lists of related reviews. Study quality was assessed based on questions from the Cochrane Collaboration risk of bias tool. Results: Two interventions and three papers with a total of 66 participants were included. The interventions were undertaken in Belgium (n = 27) and the USA (n = 39). One study reported significantly increased grey matter density (GMD) in the brains of the MBSR group compared to the usual care group. Significant improvements were reported in one study for a number of outcomes including PD outcomes, depression, mindfulness, and quality of life indicators. Only one intervention was of reasonable quality and both interventions failed to control for potential confounders in the analysis. Adverse events and reasons for drop-outs were not reported. There was also no reporting on the costs/benefits of the intervention or how they affected health service utilisation. Conclusion: This systematic review found limited and inconclusive evidence of the effectiveness of MBSR for PD patients. Both of the included interventions claimed positive effects for PD patients but significant outcomes were often contradicted by other results. Further trials with larger sample sizes, control groups and longer follow-ups are needed before the evidence for MBSR in PD can be conclusively judged

What happens for informal caregivers during transition to increased levels of care for the person with dementia? A systematic review protocol

Abstract Background Dementia is a globally prevalent disease that requires ongoing and increasing levels of care, often provided in the first instance by informal caregivers. Supporting transitions in informal caregiving in dementia is a pertinent issue for caregivers, care providers and governments. There is no existing systematic review that seeks to identify and map the body of literature regarding the review question: ‘What happens for informal caregivers during transition to increased levels of care for the person with dementia?’ Methods/design ASSIA, CINAHL+, MEDLINE, PsycINFO, SCIE, Social Service Abstracts and Web of Science will be systematically searched. Specialist dementia research libraries will be contacted. Reviews identified as relevant during the search process, their reference lists, and reference lists of accepted papers will be hand-searched. Qualitative, quantitative and mixed methods studies that seek to represent the experiences of, or examine the impact upon, informal caregivers during transition to increased formal care for the person with dementia will be eligible for inclusion. Synthesis will be segregated into qualitative and quantitative papers. Findings will be summarised, and the review will be prepared for publication. Discussion The review will seek to identify potentially vulnerable groups in need of support and as such, inform the practice of those offering support. It will also inform future research by highlighting areas in which current literature is insubstantial. Systematic review registration PROSPERO CRD4201706724