Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science

Abstract Background Many interventions found to be effective in health services research studies fail to translate into meaningful patient care outcomes across multiple contexts. Health services researchers recognize the need to evaluate not only summative outcomes but also formative outcomes to assess the extent to which implementation is effective in a specific setting, prolongs sustainability, and promotes dissemination into other settings. Many implementation theories have been published to help promote effective implementation. However, they overlap considerably in the constructs included in individual theories, and a comparison of theories reveals that each is missing important constructs included in other theories. In addition, terminology and definitions are not consistent across theories. We describe the Consolidated Framework For Implementation Research (CFIR) that offers an overarching typology to promote implementation theory development and verification about what works where and why across multiple contexts. Methods We used a snowball sampling approach to identify published theories that were evaluated to identify constructs based on strength of conceptual or empirical support for influence on implementation, consistency in definitions, alignment with our own findings, and potential for measurement. We combined constructs across published theories that had different labels but were redundant or overlapping in definition, and we parsed apart constructs that conflated underlying concepts. Results The CFIR is composed of five major domains: intervention characteristics, outer setting, inner setting, characteristics of the individuals involved, and the process of implementation. Eight constructs were identified related to the intervention (e.g., evidence strength and quality), four constructs were identified related to outer setting (e.g., patient needs and resources), 12 constructs were identified related to inner setting (e.g., culture, leadership engagement), five constructs were identified related to individual characteristics, and eight constructs were identified related to process (e.g., plan, evaluate, and reflect). We present explicit definitions for each construct. Conclusion The CFIR provides a pragmatic structure for approaching complex, interacting, multi-level, and transient states of constructs in the real world by embracing, consolidating, and unifying key constructs from published implementation theories. It can be used to guide formative evaluations and build the implementation knowledge base across multiple studies and settings.http://deepblue.lib.umich.edu/bitstream/2027.42/78272/1/1748-5908-4-50.xmlhttp://deepblue.lib.umich.edu/bitstream/2027.42/78272/2/1748-5908-4-50-S1.PDFhttp://deepblue.lib.umich.edu/bitstream/2027.42/78272/3/1748-5908-4-50-S3.PDFhttp://deepblue.lib.umich.edu/bitstream/2027.42/78272/4/1748-5908-4-50-S4.PDFhttp://deepblue.lib.umich.edu/bitstream/2027.42/78272/5/1748-5908-4-50.pdfhttp://deepblue.lib.umich.edu/bitstream/2027.42/78272/6/1748-5908-4-50-S2.PDFPeer Reviewe

The cost of changing physical activity behaviour: Evidence from a "physical activity pathway" in the primary care setting

Copyright @ 2011 Boehler et al.BACKGROUND: The ‘Physical Activity Care Pathway’ (a Pilot for the ‘Let’s Get Moving’ policy) is a systematic approach to integrating physical activity promotion into the primary care setting. It combines several methods reported to support behavioural change, including brief interventions, motivational interviewing, goal setting, providing written resources, and follow-up support. This paper compares costs falling on the UK National Health Service (NHS) of implementing the care pathway using two different recruitment strategies and provides initial insights into the cost of changing physical activity behaviour. METHODS: A combination of a time driven variant of activity based costing, audit data through EMIS and a survey of practice managers provided patient-level cost data for 411 screened individuals. Self reported physical activity data of 70 people completing the care pathway at three month was compared with baseline using a regression based ‘difference in differences’ approach. Deterministic and probabilistic sensitivity analyses in combination with hypothesis testing were used to judge how robust findings are to key assumptions and to assess the uncertainty around estimates of the cost of changing physical activity behaviour. RESULTS: It cost £53 (SD 7.8) per patient completing the PACP in opportunistic centres and £191 (SD 39) at disease register sites. The completer rate was higher in disease register centres (27.3% vs. 16.2%) and the difference in differences in time spent on physical activity was 81.32 (SE 17.16) minutes/week in patients completing the PACP; so that the incremental cost of converting one sedentary adult to an ‘active state’ of 150 minutes of moderate intensity physical activity per week amounts to £ 886.50 in disease register practices, compared to opportunistic screening. CONCLUSIONS: Disease register screening is more costly than opportunistic patient recruitment. However, additional costs come with a higher completion rate and better outcomes in terms of behavioural change in patients completing the care pathway. Further research is needed to rigorously evaluate intervention efficiency and to assess the link between behavioural change and changes in quality adjusted life years (QALYs).This article is available through the Brunel Open Access Publishing Fund

Clean birth kits to improve birth practices: development and testing of a country level decision support tool

Background: Clean birth practices can prevent sepsis, one of the leading causes of both maternal and newborn mortality. Evidence suggests that clean birth kits (CBKs), as part of package that includes education, are associated with a reduction in newborn mortality, omphalitis, and puerperal sepsis. However, questions remain about how best to approach the introduction of CBKs in country. We set out to develop a practical decision support tool for programme managers of public health systems who are considering the potential role of CBKs in their strategy for care at birth. Methods: Development and testing of the decision support tool was a three-stage process involving an international expert group and country level testing. Stage 1, the development of the tool was undertaken by the Birth Kit Working Group and involved a review of the evidence, a consensus meeting, drafting of the proposed tool and expert review. In Stage 2 the tool was tested with users through interviews (9) and a focus group, with federal and provincial level decision makers in Pakistan. In Stage 3 the findings from the country level testing were reviewed by the expert group. Results: The decision support tool comprised three separate algorithms to guide the policy maker or programme manager through the specific steps required in making the country level decision about whether to use CBKs. The algorithms were supported by a series of questions (that could be administered by interview, focus group or questionnaire) to help the decision maker identify the information needed. The country level testing revealed that the decision support tool was easy to follow and helpful in making decisions about the potential role of CBKs. Minor modifications were made and the final algorithms are presented. Conclusion: Testing of the tool with users in Pakistan suggests that the tool facilitates discussion and aids decision making. However, testing in other countries is needed to determine whether these results can be replicated and to identify how the tool can be adapted to meet country specific needs

Barriers and opportunities for evidence-based health service planning: the example of developing a Decision Analytic Model to plan services for sexually transmitted infections in the UK

Decision Analytic Models (DAMs) are established means of evidence-synthesis to differentiate between health interventions. They have mainly been used to inform clinical decisions and health technology assessment at the national level, yet could also inform local health service planning. For this, a DAM must take into account the needs of the local population, but also the needs of those planning its services. Drawing on our experiences from stakeholder consultations, where we presented the potential utility of a DAM for planning local health services for sexually transmitted infections (STIs) in the UK, and the evidence it could use to inform decisions regarding different combinations of service provision, in terms of their costs, cost-effectiveness, and public health outcomes, we discuss the barriers perceived by stakeholders to the use of DAMs to inform service planning for local populations, including (1) a tension between individual and population perspectives; (2) reductionism; and (3) a lack of transparency regarding models, their assumptions, and the motivations of those generating models

Can screening and brief intervention lead to population-level reductions in alcohol-related harm?

A distinction is made between the clinical and public health justifications for screening and brief intervention (SBI) against hazardous and harmful alcohol consumption. Early claims for a public health benefit of SBI derived from research on general medical practitioners' (GPs') advice on smoking cessation, but these claims have not been realized, mainly because GPs have not incorporated SBI into their routine practice. A recent modeling exercise estimated that, if all GPs in England screened every patient at their next consultation, 96% of the general population would be screened over 10 years, with 70-79% of excessive drinkers receiving brief interventions (BI); assuming a 10% success rate, this would probably amount to a population-level effect of SBI. Thus, a public health benefit for SBI presupposes widespread screening; but recent government policy in England favors targeted versus universal screening, and in Scotland screening is based on new registrations and clinical presentation. A recent proposal for a national screening program was rejected by the UK National Health Service's National Screening Committee because 1) there was no good evidence that SBI led to reductions in mortality or morbidity, and 2) a safe, simple, precise, and validated screening test was not available. Even in countries like Sweden and Finland, where expensive national programs to disseminate SBI have been implemented, only a minority of the population has been asked about drinking during health-care visits, and a minority of excessive drinkers has been advised to cut down. Although there has been research on the relationship between treatment for alcohol problems and population-level effects, there has been no such research for SBI, nor have there been experimental investigations of its relationship with population-level measures of alcohol-related harm. These are strongly recommended. In this article, conditions that would allow a population-level effect of SBI to occur are reviewed, including their political acceptability. It is tentatively concluded that widespread dissemination of SBI, without the implementation of alcohol control measures, might have indirect influences on levels of consumption and harm but would be unlikely on its own to result in public health benefits. However, if and when alcohol control measures were introduced, SBI would still have an important role in the battle against alcohol-related harm

Motivation and incentives of rural maternal and neonatal health care providers: a comparison of qualitative findings from Burkina Faso, Ghana and Tanzania.

In Burkina Faso, Ghana and Tanzania strong efforts are being made to improve the quality of maternal and neonatal health (MNH) care. However, progress is impeded by challenges, especially in the area of human resources. All three countries are striving not only to scale up the number of available health staff, but also to improve performance by raising skill levels and enhancing provider motivation. In-depth interviews were used to explore MNH provider views about motivation and incentives at primary care level in rural Burkina Faso, Ghana and Tanzania. Interviews were held with 25 MNH providers, 8 facility and district managers, and 2 policy-makers in each country. Across the three countries some differences were found in the reasons why people became health workers. Commitment to remaining a health worker was generally high. The readiness to remain at a rural facility was far less, although in all settings there were some providers that were willing to stay. In Burkina Faso it appeared to be particularly difficult to recruit female MNH providers to rural areas. There were indications that MNH providers in all the settings sometimes failed to treat their patients well. This was shown to be interlinked with differences in how the term 'motivation' was understood, and in the views held about remuneration and the status of rural health work. Job satisfaction was shown to be quite high, and was particularly linked to community appreciation. With some important exceptions, there was a strong level of agreement regarding the financial and non-financial incentives that were suggested by these providers, but there were clear country preferences as to whether incentives should be for individuals or teams. Understandings of the terms and concepts pertaining to motivation differed between the three countries. The findings from Burkina Faso underline the importance of gender-sensitive health workforce planning. The training that all levels of MNH providers receive in professional ethics, and the way this is reinforced in practice require closer attention. The differences in the findings across the three settings underscore the importance of in-depth country-level research to tailor the development of incentives schemes

Framework, principles and recommendations for utilising participatory methodologies in the co-creation and evaluation of public health interventions

Background: Due to the chronic disease burden on society, there is a need for preventive public health interventions to stimulate society towards a healthier lifestyle. To deal with the complex variability between individual lifestyles and settings, collaborating with end-users to develop interventions tailored to their unique circumstances has been suggested as a potential way to improve effectiveness and adherence. Co-creation of public health interventions using participatory methodologies has shown promise but lacks a framework to make this process systematic. The aim of this paper was to identify and set key principles and recommendations for systematically applying participatory methodologies to co-create and evaluate public health interventions. Methods: These principles and recommendations were derived using an iterative reflection process, combining key learning from published literature in addition to critical reflection on three case studies conducted by research groups in three European institutions, all of whom have expertise in co-creating public health interventions using different participatory methodologies. Results: Key principles and recommendations for using participatory methodologies in public health intervention co-creation are presented for the stages of: Planning (framing the aim of the study and identifying the appropriate sampling strategy); Conducting (defining the procedure, in addition to manifesting ownership); Evaluating (the process and the effectiveness) and Reporting (providing guidelines to report the findings). Three scaling models are proposed to demonstrate how to scale locally developed interventions to a population level. Conclusions: These recommendations aim to facilitate public health intervention co-creation and evaluation utilising participatory methodologies by ensuring the process is systematic and reproducible

The systematic guideline review: method, rationale, and test on chronic heart failure

Background: Evidence-based guidelines have the potential to improve healthcare. However, their de-novo-development requires substantial resources-especially for complex conditions, and adaptation may be biased by contextually influenced recommendations in source guidelines. In this paper we describe a new approach to guideline development-the systematic guideline review method (SGR), and its application in the development of an evidence-based guideline for family physicians on chronic heart failure (CHF). Methods: A systematic search for guidelines was carried out. Evidence-based guidelines on CHF management in adults in ambulatory care published in English or German between the years 2000 and 2004 were included. Guidelines on acute or right heart failure were excluded. Eligibility was assessed by two reviewers, methodological quality of selected guidelines was appraised using the AGREE instrument, and a framework of relevant clinical questions for diagnostics and treatment was derived. Data were extracted into evidence tables, systematically compared by means of a consistency analysis and synthesized in a preliminary draft. Most relevant primary sources were re-assessed to verify the cited evidence. Evidence and recommendations were summarized in a draft guideline. Results: Of 16 included guidelines five were of good quality. A total of 35 recommendations were systematically compared: 25/35 were consistent, 9/35 inconsistent, and 1/35 un-rateable (derived from a single guideline). Of the 25 consistencies, 14 were based on consensus, seven on evidence and four differed in grading. Major inconsistencies were found in 3/9 of the inconsistent recommendations. We re-evaluated the evidence for 17 recommendations (evidence-based, differing evidence levels and minor inconsistencies) - the majority was congruent. Incongruity was found where the stated evidence could not be verified in the cited primary sources, or where the evaluation in the source guidelines focused on treatment benefits and underestimated the risks. The draft guideline was completed in 8.5 man-months. The main limitation to this study was the lack of a second reviewer. Conclusion: The systematic guideline review including framework development, consistency analysis and validation is an effective, valid, and resource saving-approach to the development of evidence-based guidelines

Incorporating tumour pathology information into breast cancer risk prediction algorithms.

INTRODUCTION: Mutations in BRCA1 and BRCA2 confer high risks of breast cancer and ovarian cancer. The risk prediction algorithm BOADICEA (Breast and Ovarian Analysis of Disease Incidence and Carrier Estimation Algorithm) may be used to compute the probabilities of carrying mutations in BRCA1 and BRCA2 and help to target mutation screening. Tumours from BRCA1 and BRCA2 mutation carriers display distinctive pathological features that could be used to better discriminate between BRCA1 mutation carriers, BRCA2 mutation carriers and noncarriers. In particular, oestrogen receptor (ER)-negative status, triple-negative (TN) status, and expression of basal markers are predictive of BRCA1 mutation carrier status. METHODS: We extended BOADICEA by treating breast cancer subtypes as distinct disease end points. Age-specific expression of phenotypic markers in a series of tumours from 182 BRCA1 mutation carriers, 62 BRCA2 mutation carriers and 109 controls from the Breast Cancer Linkage Consortium, and over 300,000 tumours from the general population obtained from the Surveillance Epidemiology, and End Results database, were used to calculate age-specific and genotype-specific incidences of each disease end point. The probability that an individual carries a BRCA1 or BRCA2 mutation given their family history and tumour marker status of family members was computed in sample pedigrees. RESULTS: The cumulative risk of ER-negative breast cancer by age 70 for BRCA1 mutation carriers was estimated to be 55% and the risk of ER-positive disease was 18%. The corresponding risks for BRCA2 mutation carriers were 21% and 44% for ER-negative and ER-positive disease, respectively. The predicted BRCA1 carrier probabilities among ER-positive breast cancer cases were less than 1% at all ages. For women diagnosed with breast cancer below age 50 years, these probabilities rose to more than 5% in ER-negative breast cancer, 7% in TN disease and 24% in TN breast cancer expressing both CK5/6 and CK14 cytokeratins. Large differences in mutation probabilities were observed by combining ER status and other informative markers with family history. CONCLUSIONS: This approach combines both full pedigree and tumour subtype data to predict BRCA1/2 carrier probabilities. Prediction of BRCA1/2 carrier status, and hence selection of women for mutation screening, may be substantially improved by combining tumour pathology with family history of cancer.RIGHTS : This article is licensed under the BioMed Central licence at http://www.biomedcentral.com/about/license which is similar to the 'Creative Commons Attribution Licence'. In brief you may : copy, distribute, and display the work; make derivative works; or make commercial use of the work - under the following conditions: the original author must be given credit; for any reuse or distribution, it must be made clear to others what the license terms of this work are

Effect of educational outreach on general practice prescribing of antibiotics and antidepressants: a two-year randomised controlled trial

Objective. Prescribing of broad spectrum antibiotics and antidepressants in general practice often does not accord with guidelines. The aim was to determine the effectiveness of educational outreach in improving the prescribing of selected antibiotics and antidepressants, and whether the effect is sustained for two years. Design. Single blind randomized trial. Setting. Twenty-eight general practices in Leicestershire, England. Intervention. Educational outreach visits were undertaken, tailored to barriers to change, 14 practices receiving visits for reducing selected antibiotics and 14 for improving antidepressant prescribing. Main outcome measures. Number of items prescribed per 1000 registered patients for amoxicillin with clavulanic acid (co-amoxiclav) and quinolone antibiotics, and average daily quantities per 1000 patients for lofepramine and fluoxetine antidepressants, measured at the practice level for six-month periods over two years. Results. There was no effect on the prescribing of co-amoxiclav, quinolones, or fluoxetine, but prescribing of lofepramine increased in accordance with the guidelines. The increase persisted throughout two years of follow-up. Conclusion. A simple, group-level educational outreach intervention, designed to take account of identified barriers to change, can have a modest but sustained effect on prescribing levels. However, outreach is not always effective. The context in which change in prescribing practice is being sought, the views of prescribers concerning the value of the drug, or other unrecognised barriers to change may influence the effectiveness of outreach