Designing High-Quality Implementation Research: Development, Application, Feasibility and Preliminary Evaluation of the Implementation Science Research Development (Impres) Tool and Guide

BACKGROUND: Designing implementation research can be a complex and daunting task, especially for applied health researchers who have not received specialist training in implementation science. We developed the Implementation Science Research Development (ImpRes) tool and supplementary guide to address this challenge and provide researchers with a systematic approach to designing implementation research. METHODS: A multi-method and multi-stage approach was employed. An international, multidisciplinary expert panel engaged in an iterative brainstorming and consensus-building process to generate core domains of the ImpRes tool, representing core implementation science principles and concepts that researchers should consider when designing implementation research. Simultaneously, an iterative process of reviewing the literature and expert input informed the development and content of the tool. Once consensus had been reached, specialist expert input was sought on involving and engaging patients/service users; and economic evaluation. ImpRes was then applied to 15 implementation and improvement science projects across the National Institute of Health Research (NIHR) Collaboration for Leadership in Applied Health Research and Care (CLAHRC) South London, a research organisation in London, UK. Researchers who applied the ImpRes tool completed an 11-item questionnaire evaluating its structure, content and usefulness. RESULTS: Consensus was reached on ten implementation science domains to be considered when designing implementation research. These include implementation theories, frameworks and models, determinants of implementation, implementation strategies, implementation outcomes and unintended consequences. Researchers who used the ImpRes tool found it useful for identifying project areas where implementation science is lacking (median 5/5, IQR 4-5) and for improving the quality of implementation research (median 4/5, IQR 4-5) and agreed that it contained the key components that should be considered when designing implementation research (median 4/5, IQR 4-4). Qualitative feedback from researchers who applied the ImpRes tool indicated that a supplementary guide was needed to facilitate use of the tool. CONCLUSIONS: We have developed a feasible and acceptable tool, and supplementary guide, to facilitate consideration and incorporation of core principles and concepts of implementation science in applied health implementation research. Future research is needed to establish whether application of the tool and guide has an effect on the quality of implementation research

Geographically extensive larval surveys reveal an unexpected scarcity of primary vector mosquitoes in a region of persistent malaria transmission in western Zambia

Background The Barotse floodplains of the upper Zambezi River and its tributaries are a highly dynamic environment, with seasonal flooding and transhumance presenting a shifting mosaic of potential larval habitat and human and livestock bloodmeals for malaria vector mosquitoes. However, limited entomological surveillance has been undertaken to characterise the vector community in these floodplains and their environs. Such information is necessary as, despite substantial deployment of insecticide-treated nets (ITNs) and indoor residual spraying (IRS) against Anopheles vectors, malaria transmission persists across Barotseland in Zambia’s Western Province. Methods Geographically extensive larval surveys were undertaken in two health districts along 102 km of transects, at fine spatial resolution, during a dry season and following the peak of the successive wet season. Larvae were sampled within typical Anopheles flight range of human settlements and identified through genetic sequencing of cytochrome c oxidase I and internal transcribed spacer 2 regions of mitochondrial and nuclear DNA. This facilitated detailed comparison of taxon-specific abundance patterns between ecological zones differentiated by hydrological controls. Results An unexpected paucity of primary vectors was revealed, with An. gambiae s.l. and An. funestus representing <2% of 995 sequenced anophelines. Potential secondary vectors predominated in the vector community, primarily An. coustani group species and An squamosus. Whilst the distribution of An. gambiae s.l. in the study area was highly clustered, secondary vector species were ubiquitous across the landscape in both dry and wet seasons, with some taxon-specific relationships between abundance and ecological zones by season. Conclusions The diversity of candidate vector species and their high relative abundance observed across diverse hydro-ecosystems indicates a highly adaptable transmission system, resilient to environmental variation and, potentially, interventions that target only part of the vector community. Larval survey results imply that residual transmission of malaria in Barotseland is being mediated predominantly by secondary vector species, whose known tendencies for crepuscular and outdoor biting renders them largely insensitive to prevalent vector control methods

Evaluation of a community-based performance arts programme for people who have experienced stroke in the UK: protocol for the SHAPER-Stroke Odysseys study

INTRODUCTION: Stroke survivors, once in the community, face challenges with their long-term rehabilitation care and present higher levels of loneliness, depression and anxiety than the rest of the population. A community-based performance arts programme, Stroke Odysseys (SO), has been devised to tackle the challenges of living with stroke in the UK. In this study, we aim to evaluate the implementation, impact and experiences of SO for stroke survivors. METHODS AND ANALYSIS: Scaling-up Health Arts Programmes: Implementation and Effectiveness Research (SHAPER)-SO aims to scale-up SO to 75 participants and 47 stakeholders, while simultaneously evaluating the effectiveness and implementation of the programme. The main research aim is to evaluate the implementation, effectiveness, impact and experiences of a community-based performance arts programme (SO for stroke survivors). This mixed-methods study will evaluate the experience and impact of SO on those participating using mixed methods (interviews, observations and surveys) before and after each stage and carry out non-participant observations during a percentage of the workshops, training and tour. Data will be analysed using quantitative and qualitative approaches. This is a study within the SHAPER programme. ETHICS AND DISSEMINATION: Ethical approval has been granted by the King's College London PNM Research Ethics Panel, REC reference: LRS/DP-20/21-21549. Written informed consent will be sought for participants and stakeholders. The results of the study will be reported and disseminated at international conferences and in peer-reviewed scientific journals. TRIAL REGISTRATION NUMBER: NCT04864470

Protocol for a two-arm feasibility RCT to support postnatal maternal weight management and positive lifestyle behaviour in women from an ethnically diverse inner city population: the SWAN feasibility trial

IntroductionA high BMI during and after pregnancy is linked to poor pregnancy outcomes and contributes to long-term maternal obesity, hypertension, and diabetes. Evidence of feasible, effective postnatal interventions is lacking. This randomised controlled trial will assess the feasibility of conducting a future definitive trial to determine effectiveness and cost-effectiveness of lifestyle information and access to Slimming World® (Alfreton, UK) groups for 12 weeks commencing from 8 to 16 weeks postnatally, in relation to supporting longer-term postnatal weight management in women in an ethnically diverse inner city population. Methods/analysis:Women will be recruited from one maternity unit in London. To be eligible, women will be overweight (BMI 25–29.9 kg/m2) or obese (BMI ≥ 30 kg/m2) as identified at their first antenatal contact, or have a normal BMI (18.5–24.9 kg/m2) at booking but gain excessive gestational weight as assessed at 36 weeks gestation. Women will be aged 18 and over, can speak and read English, expecting a single baby, and will not have accessed weight management groups in this pregnancy. Women will be randomly allocated to standard care plus lifestyle information and access to Slimming World® (Alfreton, UK) groups or standard care only. A sample of 130 women is required. Feasibility trial objectives reflect those considered most important inform a decision about undertaking a definitive future trial. These include estimation of impact of lifestyle information and postnatal access to Slimming World® (Alfreton, UK) on maternal weight change between antenatal booking weight and weight at 12 months postbirth, recruitment rate and time to recruitment, retention rate, influence of lifestyle information and Slimming World® (Alfreton, UK) groups on weight management, diet, physical activity, breastfeeding, smoking cessation, alcohol intake, physical and mental health, infant health, and health-related quality of life 6 and 12 months postnatally. An embedded process evaluation will assess acceptability of study processes and procedures to women. Ethics/dissemination:London–Camberwell St Giles Research Ethics Committee, reference: 16/LO/1422. Outcomes will be disseminated in peer-reviewed journals and presentations at national and international conferences. Trial registration:Trial registration number: ISRCTN 39186148. Protocol version number: v7, 13 August 17. Trial sponsor: King’s College London.</p

Development and psychometric evaluation of the Implementation Science Research Project Appraisal Criteria (ImpResPAC) tool: a study protocol.

INTRODUCTION: The need for quantitative criteria to appraise the quality of implementation research has recently been highlighted to improve methodological rigour. The Implementation Science Research development (ImpRes) tool and supplementary guide provide methodological guidance and recommendations on how to design high-quality implementation research. This protocol reports on the development of the Implementation Science Research Project Appraisal Criteria (ImpResPAC) tool, a quantitative appraisal tool, developed based on the structure and content of the ImpRes tool and supplementary guide, to evaluate the conceptual and methodological quality of implementation research. METHODS AND ANALYSIS: This study employs a three-stage sequential mixed-methods design. During stage 1, the research team will map core domains of the ImpRes tool, guidance and recommendations contained in the supplementary guide and within the literature, to ImpResPAC. In stage 2, an international multidisciplinary expert group, recruited through purposive sampling, will inform the refinement of ImpResPAC, including content, scoring system and user instructions. In stage 3, an extensive psychometric evaluation of ImpResPAC, that was created in stage 1 and refined in stage 2, will be conducted. The scaling assumptions (inter-item and item-total correlations), reliability (internal consistency, inter-rater) and validity (construct and convergent validity) will be investigated by applying ImpResPAC to 50 protocols published in Implementation Science. We envisage developing ImpResPAC in this way will provide implementation research stakeholders, primarily grant reviewers and educators, a comprehensive, transparent and fair appraisal of the conceptual and methodological quality of implementation research, increasing the likelihood of funding research that will generate knowledge and contribute to the advancement of the field. ETHICS AND DISSEMINATION: This study will involve human participants. This study has been registered and minimal risk ethical clearance granted by The Research Ethics Office, King's College London (reference number MRA-20/21-20807). Participants will receive written information on the study via email and will provide e-consent if they wish to participate. We will use traditional academic modalities of dissemination (eg, conferences and publications)

Using the RE-AIM framework to evaluate the implementation of scaling-up the Friendship Bench in Zimbabwe - a quantitative observational study

Background: This study aimed to evaluate the real-world implementation of the Friendship Bench (FB) - an evidence-based brief psychological intervention delivered by community health workers (CHWs) - three years after its implementation in three city health departments in Zimbabwe. Implementation sites were evaluated according to their current performance using the RE-AIM framework making this one of the first evaluations of a scaled-up evidence-based psychological intervention in sub-Saharan Africa (SSA). Methods: Using the RE-AIM guide ( www.re-aim.org ), the authors designed quantitative indicators based on existing FB implementation data. Thirty-six primary health care clinics (PHC) in Harare (n=28), Chitungwiza (n=4) and Gweru (n=4) were included. Among these clinics 20 were large comprehensive health care centers, 7 medium (mostly maternal and child healthcare) and 9 small clinics (basic medical care and acting as referral clinic). Existing data from these clinics, added to additionally collected data through interviews and field observations were used to investigate and compare the performance of the FB across clinics. The focus was on the RE-AIM domains of Reach, Adoption, and Implementation. Results: Small clinics achieved 34% reach, compared to large (15%) and medium clinics (9%). Adoption was high in all clinic types, ranging from 59% to 71%. Small clinics led the implementation domain with 53%, followed by medium sized clinics 43% and large clinics 40%. Small clinics performed better in all indicators and differences in performance between small and large clinics were significant. Program activity and data quality depends on ongoing support for delivering agents and buy-in from health authorities. Conclusion: The Friendship Bench program was implemented over three years transitioning from a research-based implementation program to one led locally. The Reach domain showed the largest gap across clinics where larger clinics performed poorly relative to smaller clinics and should be a target for future implementation improvements. Program data needs to be integrated into existing health information systems. Future studies should seek to optimize scale-up and sustainment strategies to maintain effective task-shared psychological interventions in SSA

Unsettling planning theory

Recent political developments in many parts of the world seem likely to exacerbate rather than ameliorate the planetary-scale challenges of social polarization, inequality and environmental change societies face. In this unconventional multi-authored essay, we therefore seek to explore some of the ways in which planning theory might respond to the deeply unsettling times we live in. Taking the multiple, suggestive possibilities of the theme of unsettlement as a starting point, we aim to create space for reflection and debate about the state of the discipline and practice of planning theory, questioning what it means to produce knowledge capable of acting on the world today. Drawing on exchanges at a workshop attended by a group of emerging scholars in Portland, Oregon in late 2016, the essay begins with an introduction section exploring the contemporary resonances of ‘unsettling’ in, of and for planning theory. This is followed by four, individually authored responses which each connect the idea of unsettlement to key challenges and possible future directions. We end by calling for a reflective practice of theorizing that accepts unsettlement but seeks to act knowingly and compassionately on the uneven terrain that it creates

A feasibility hybrid II randomised controlled trial of volunteer ‘Health Champions’ supporting people with serious mental illness manage their physical health: study protocol

Background People with serious mental illnesses (SMI) such as schizophrenia often also have physical health illnesses and interventions are needed to address the resultant multimorbidity and reduced life expectancy. Research has shown that volunteers can support people with SMI. This protocol describes a feasibility randomised controlled trial (RCT) of a novel intervention involving volunteer ‘Health Champions’ supporting people with SMI to manage and improve their physical health. Methods This is a feasibility hybrid II randomised effectiveness-implementation controlled trial. The intervention involves training volunteers to be ‘Health Champions’ to support individual people with SMI using mental health services. This face-to-face or remote support will take place weekly and last for up to 9 months following initial introduction. This study will recruit 120 participants to compare Health Champions to treatment as usual for people with SMI using secondary community mental health services in South London, UK. We will measure the clinical and cost effectiveness including quality of life. We will measure the implementation outcomes of acceptability, feasibility, appropriateness, fidelity, barriers and enablers, unintended consequences, adoption and sustainability. Discussion There is a need for interventions to support people with SMI with their physical health. If this feasibility trial is successful, a definitive trial will follow to fully evaluate the clinical, cost and implementation effectiveness of Health Champions supporting people with SMI