Taking the heat or taking the temperature? A qualitative study of a large-scale exercise in seeking to measure for improvement, not blame.

Measurement of quality and safety has an important role in improving healthcare, but is susceptible to unintended consequences. One frequently made argument is that optimising the benefits from measurement requires controlling the risks of blame, but whether it is possible to do this remains unclear. We examined responses to a programme known as the NHS Safety Thermometer (NHS-ST). Measuring four common patient harms in diverse care settings with the goal of supporting local improvement, the programme explicitly eschews a role for blame. The study design was ethnographic. We conducted 115 hours of observation across 19 care organisations and conducted 126 interviews with frontline staff, senior national leaders, experts in the four harms, and the NHS-ST programme leadership and development team. We also collected and analysed relevant documents. The programme theory of the NHS-ST was based in a logic of measurement for improvement: the designers of the programme sought to avoid the appropriation of the data for any purpose other than supporting improvement. However, organisational participants - both at frontline and senior levels - were concerned that the NHS-ST functioned latently as a blame allocation device. These perceptions were influenced, first, by field-level logics of accountability and managerialism and, second, by specific features of the programme, including public reporting, financial incentives, and ambiguities about definitions that amplified the concerns. In consequence, organisational participants, while they identified some merits of the programme, tended to identify and categorise it as another example of performance management, rich in potential for blame. These findings indicate that the search to optimise the benefits of measurement by controlling the risks of blame remains challenging. They further suggest that a well-intentioned programme theory, while necessary, may not be sufficient for achieving goals for improvement in healthcare systems dominated by institutional logics that run counter to the programme theory

Did a quality improvement collaborative make stroke care better? A cluster randomized trial

Background: Stroke can result in death and long-term disability. Fast and high-quality care can reduce the impact of stroke, but UK national audit data has demonstrated variability in compliance with recommended processes of care. Though quality improvement collaboratives (QICs) are widely used, whether a QIC could improve reliability of stroke care was unknown. Methods: Twenty-four NHS hospitals in the Northwest of England were randomly allocated to participate either in Stroke 90:10, a QIC based on the Breakthrough Series (BTS) model, or to a control group giving normal care. The QIC focused on nine processes of quality care for stroke already used in the national stroke audit. The nine processes were grouped into two distinct care bundles: one relating to early hours care and one relating to rehabilitation following stroke. Using an interrupted time series design and difference-in-difference analysis, we aimed to determine whether hospitals participating in the QIC improved more than the control group on bundle compliance. Results: Data were available from nine interventions (3,533 patients) and nine control hospitals (3,059 patients). Hospitals in the QIC showed a modest improvement from baseline in the odds of average compliance equivalent to a relative improvement of 10.9% (95% CI 1.3%, 20.6%) in the Early Hours Bundle and 11.2% (95% CI 1.4%, 21.5%) in the Rehabilitation Bundle. Secondary analysis suggested that some specific processes were more sensitive to an intervention effect. Conclusions: Some aspects of stroke care improved during the QIC, but the effects of the QIC were modest and further improvement is needed. The extent to which a BTS QIC can improve quality of stroke care remains uncertain. Some aspects of care may respond better to collaboratives than others. Trial registration ISRCTN13893902.Version of Recor

How collaborative are quality improvement collaboratives:A qualitative study in stroke care

BACKGROUND: Quality improvement collaboratives (QICs) continue to be widely used, yet evidence for their effectiveness is equivocal. We sought to explain what happened in Stroke 90:10, a QIC designed to improve stroke care in 24 hospitals in the North West of England. Our study drew in part on the literature on collective action and inter-organizational collaboration. This literature has been relatively neglected in evaluations of QICs, even though they are founded on principles of co-operation and sharing. METHODS: We interviewed 32 professionals in hospitals that participated in Stroke 90:10, conducted a focus group with the QIC faculty team, and reviewed purposively sampled documents including reports and newsletters. Analysis was based on a modified form of Framework Analysis, combining sensitizing constructs derived from the literature and new, empirically derived thematic categories. RESULTS: Improvements in stroke care were attributed to QIC participation by many professionals. They described how the QIC fostered a sense of community and increased attention to stroke care within their organizations. However, participants’ experiences of the QIC varied. Starting positions were different; some organizations were achieving higher levels of performance than others before the QIC began, and some had more pre-existing experience of quality improvement methods. Some participants had more to learn, others more to teach. Some evidence of free-riding was found. Benchmarking improvement was variously experienced as friendly rivalry or as time-consuming and stressful. Participants’ competitive desire to demonstrate success sometimes conflicted with collaborative aims; some experienced competing organizational pressures or saw the QIC as duplication of effort. Experiences of inter-organizational collaboration were influenced by variations in intra-organizational support. CONCLUSIONS: Collaboration is not the only mode of behavior likely to occur within a QIC. Our study revealed a mixed picture of collaboration, free-riding and competition. QICs should learn from work on the challenges of collective action; set realistic goals; account for context; ensure sufficient time and resources are made available; and carefully manage the collaborative to mitigate the risks of collaborative inertia and unhelpful competitive or anti-cooperative behaviors. Individual organizations should assess the costs and benefits of collaboration as a means of attaining quality improvement

Social networks and support in long-term psychiatric patients

SynopsisThis paper describes quantitative and qualitative aspects of social support in a sample of 40 long-term schizophrenic day patients attending a rehabilitation unit. The influence of symptomatology and experience of life stressors on network and support characteristics was also investigated. The primary networks of these patients were found to be small, comprising on average 7 members, of whom only 3 were seen regularly. Despite this, subjects rated their perceived support as adequate. The secondary networks were of the order of 32. It emerged that greater prevalence of negative symptoms was significantly associated with lower ideal levels of support and this group of patients was significantly less likely to seek support in the event of a life stressor. This may be a protective mechanism to insulate the person from the effects of stressful relationships but at the same time means that they are isolated from potential supports. The clinical implications are discussed in terms of offering optimum support for this marginalized group.</jats:p