Qualitative study exploring the phenomenon of multiple electronic prescribing systems within single hospital organisations

BACKGROUND: A previous census of electronic prescribing (EP) systems in England showed that more than half of hospitals with EP reported more than one EP system within the same hospital. Our objectives were to describe the rationale for having multiple EP systems within a single hospital, and to explore perceptions of stakeholders about the advantages and disadvantages of multiple systems including any impact on patient safety. METHODS: Hospitals were selected from previous census respondents. A decision matrix was developed to achieve a maximum variation sample, and snowball sampling used to recruit stakeholders of different professional backgrounds. We then used an a priori framework to guide and analyse semi-structured interviews. RESULTS: Ten participants, comprising pharmacists and doctors and a nurse, were interviewed from four hospitals. The findings suggest that use of multiple EP systems was not strategically planned. Three co-existing models of EP systems adoption in hospitals were identified: organisation-led, clinician-led and clinical network-led, which may have contributed to multiple systems use. Although there were some perceived benefits of multiple EP systems, particularly in niche specialities, many disadvantages were described. These included issues related to access, staff training, workflow, work duplication, and system interfacing. Fragmentation of documentation of the patient's journey was a major safety concern. DISCUSSION: The complexity of EP systems' adoption and deficiencies in IT strategic planning may have contributed to multiple EP systems use in the NHS. In the near to mid-term, multiple EP systems may remain in place in many English hospitals, which may create challenges to quality and patient safety.Peer reviewe

Evidence-based decision support for pediatric rheumatology reduces diagnostic errors.

BACKGROUND: The number of trained specialists world-wide is insufficient to serve all children with pediatric rheumatologic disorders, even in the countries with robust medical resources. We evaluated the potential of diagnostic decision support software (DDSS) to alleviate this shortage by assessing the ability of such software to improve the diagnostic accuracy of non-specialists. METHODS: Using vignettes of actual clinical cases, clinician testers generated a differential diagnosis before and after using diagnostic decision support software. The evaluation used the SimulConsult® DDSS tool, based on Bayesian pattern matching with temporal onset of each finding in each disease. The tool covered 5405 diseases (averaging 22 findings per disease). Rheumatology content in the database was developed using both primary references and textbooks. The frequency, timing, age of onset and age of disappearance of findings, as well as their incidence, treatability, and heritability were taken into account in order to guide diagnostic decision making. These capabilities allowed key information such as pertinent negatives and evolution over time to be used in the computations. Efficacy was measured by comparing whether the correct condition was included in the differential diagnosis generated by clinicians before using the software ( unaided ), versus after use of the DDSS ( aided ). RESULTS: The 26 clinicians demonstrated a significant reduction in diagnostic errors following introduction of the software, from 28% errors while unaided to 15% using decision support (p \u3c 0.0001). Improvement was greatest for emergency medicine physicians (p = 0.013) and clinicians in practice for less than 10 years (p = 0.012). This error reduction occurred despite the fact that testers employed an open book approach to generate their initial lists of potential diagnoses, spending an average of 8.6 min using printed and electronic sources of medical information before using the diagnostic software. CONCLUSIONS: These findings suggest that decision support can reduce diagnostic errors and improve use of relevant information by generalists. Such assistance could potentially help relieve the shortage of experts in pediatric rheumatology and similarly underserved specialties by improving generalists\u27 ability to evaluate and diagnose patients presenting with musculoskeletal complaints. TRIAL REGISTRATION: ClinicalTrials.gov ID: NCT02205086

A cognitive forcing tool to mitigate cognitive bias:A randomised control trial

Abstract Background Cognitive bias is an important source of diagnostic error yet is a challenging area to understand and teach. Our aim was to determine whether a cognitive forcing tool can reduce the rates of error in clinical decision making. A secondary objective was to understand the process by which this effect might occur. Methods We hypothesised that using a cognitive forcing tool would reduce diagnostic error rates. To test this hypothesis, a novel online case-based approach was used to conduct a single blinded randomized clinical trial conducted from January 2017 to September 2018. In addition, a qualitative series of “think aloud” interviews were conducted with 20 doctors from a UK teaching hospital in 2018. The primary outcome was the diagnostic error rate when solving bias inducing clinical vignettes. A volunteer sample of medical professionals from across the UK, Republic of Ireland and North America. They ranged in seniority from medical student to Attending Physician. Results Seventy six participants were included in the study. The data showed doctors of all grades routinely made errors related to cognitive bias. There was no difference in error rates between groups (mean 2.8 cases correct in intervention vs 3.1 in control group, 95% CI -0.94 – 0.45 P = 0.49). The qualitative protocol revealed that the cognitive forcing strategy was well received and a produced a subjectively positive impact on doctors’ accuracy and thoughtfulness in clinical cases. Conclusions The quantitative data failed to show an improvement in accuracy despite a positive qualitative experience. There is insufficient evidence to recommend this tool in clinical practice, however the qualitative data suggests such an approach has some merit and face validity to users

Comparison of the Full Outline of UnResponsiveness and Glasgow Liege Scale/Glasgow Coma Scale in an Intensive Care Unit Population.

peer reviewedBACKGROUND: The Full Outline of UnResponsiveness (FOUR) has been proposed as an alternative for the Glasgow Coma Scale (GCS)/Glasgow Liege Scale (GLS) in the evaluation of consciousness in severely brain-damaged patients. We compared the FOUR and GLS/GCS in intensive care unit patients who were admitted in a comatose state. METHODS: FOUR and GLS evaluations were performed in randomized order in 176 acutely (<1 month) brain-damaged patients. GLS scores were transformed in GCS scores by removing the GLS brainstem component. Inter-rater agreement was assessed in 20% of the studied population (N = 35). A logistic regression analysis adjusted for age, and etiology was performed to assess the link between the studied scores and the outcome 3 months after injury (N = 136). RESULTS: GLS/GCS verbal component was scored 1 in 146 patients, among these 131 were intubated. We found that the inter-rater reliability was good for the FOUR score, the GLS/GCS. FOUR, GLS/GCS total scores predicted functional outcome with and without adjustment for age and etiology. 71 patients were considered as being in a vegetative/unresponsive state based on the GLS/GCS. The FOUR score identified 8 of these 71 patients as being minimally conscious given that these patients showed visual pursuit. CONCLUSIONS: The FOUR score is a valid tool with good inter-rater reliability that is comparable to the GLS/GCS in predicting outcome. It offers the advantage to be performable in intubated patients and to identify non-verbal signs of consciousness by assessing visual pursuit, and hence minimal signs of consciousness (11% in this study), not assessed by GLS/GCS scales

The challenges of implementing packaged hospital electronic prescribing and medicine administration systems in UK hospitals: premature purchase of immature solutions?

The UK National Health Service is making major efforts to implement Hospital Electronic Prescribing and Medicine Administration (HEPMA) to improve patient safety and quality of care. Substantial public investments have attracted a wide range of UK and overseas suppliers offering Commercial-Off –The-Shelf (COTS) solutions. A lack of (UK) implementation experience and weak supplier-user relationships are reflected in systems with limited configurability, poorly matched to the needs and practices of English hospitals. This situation echoes the history of comparable corporate information infrastructures - Enterprise Resource Planning systems - in the 1980s/1990s. UK government intervention prompted a similar swarming of immature, often unfinished, products into the market. This resulted, in both cases, in protracted and difficult implementation processes as vendors and adopters struggled to get the systems to work and match the circumstances of the adopting organisations. An analysis of the influence of the Installed Base on Information Infrastructures should explore how the evolution of COTS solutions is conditioned by the structure of adopter and vendor ‘communities’

Integration of a nationally procured electronic health record system into user work practices

BACKGROUND: Evidence suggests that many small- and medium-scale Electronic Health Record (EHR) implementations encounter problems, these often stemming from users' difficulties in accommodating the new technology into their work practices. There is the possibility that these challenges may be exacerbated in the context of the larger-scale, more standardised, implementation strategies now being pursued as part of major national modernisation initiatives. We sought to understand how England's centrally procured and delivered EHR software was integrated within the work practices of users in selected secondary and specialist care settings. METHODS: We conducted a qualitative longitudinal case study-based investigation drawing on sociotechnical theory in three purposefully selected sites implementing early functionality of a nationally procured EHR system. The complete dataset comprised semi-structured interview data from a total of 66 different participants, 38.5 hours of non-participant observation of use of the software in context, accompanying researcher field notes, and hospital documents (including project initiation and lessons learnt reports). Transcribed data were analysed thematically using a combination of deductive and inductive approaches, and drawing on NVivo8 software to facilitate coding. RESULTS: The nationally led "top-down" implementation and the associated focus on interoperability limited the opportunity to customise software to local needs. Lack of system usability led users to employ a range of workarounds unanticipated by management to compensate for the perceived shortcomings of the system. These had a number of knock-on effects relating to the nature of collaborative work, patterns of communication, the timeliness and availability of records (including paper) and the ability for hospital management to monitor organisational performance. CONCLUSIONS: This work has highlighted the importance of addressing potentially adverse unintended consequences of workarounds associated with the introduction of EHRs. This can be achieved with customisation, which is inevitably somewhat restricted in the context of attempts to implement national solutions. The tensions and potential trade-offs between achieving large-scale interoperability and local requirements is likely to be the subject of continuous debate in England and beyond with no easy answers in sight

A Prescription for Improving Drug Formulary Decision Making

Gordon Schiff and colleagues present a new tool and checklist to help formularies make decisions about drug inclusion and to guide rational drug use

Bezlotoxumab for Prevention of Recurrent Clostridium difficile Infection

BACKGROUND Clostridium difficile is the most common cause of infectious diarrhea in hospitalized patients. Recurrences are common after antibiotic therapy. Actoxumab and bezlotoxumab are human monoclonal antibodies against C. difficile toxins A and B, respectively. METHODS We conducted two double-blind, randomized, placebo-controlled, phase 3 trials, MODIFY I and MODIFY II, involving 2655 adults receiving oral standard-of-care antibiotics for primary or recurrent C. difficile infection. Participants received an infusion of bezlotoxumab (10 mg per kilogram of body weight), actoxumab plus bezlotoxumab (10 mg per kilogram each), or placebo; actoxumab alone (10 mg per kilogram) was given in MODIFY I but discontinued after a planned interim analysis. The primary end point was recurrent infection (new episode after initial clinical cure) within 12 weeks after infusion in the modified intention-to-treat population. RESULTS In both trials, the rate of recurrent C. difficile infection was significantly lower with bezlotoxumab alone than with placebo (MODIFY I: 17% [67 of 386] vs. 28% [109 of 395]; adjusted difference, −10.1 percentage points; 95% confidence interval [CI], −15.9 to −4.3; P<0.001; MODIFY II: 16% [62 of 395] vs. 26% [97 of 378]; adjusted difference, −9.9 percentage points; 95% CI, −15.5 to −4.3; P<0.001) and was significantly lower with actoxumab plus bezlotoxumab than with placebo (MODIFY I: 16% [61 of 383] vs. 28% [109 of 395]; adjusted difference, −11.6 percentage points; 95% CI, −17.4 to −5.9; P<0.001; MODIFY II: 15% [58 of 390] vs. 26% [97 of 378]; adjusted difference, −10.7 percentage points; 95% CI, −16.4 to −5.1; P<0.001). In prespecified subgroup analyses (combined data set), rates of recurrent infection were lower in both groups that received bezlotoxumab than in the placebo group in subpopulations at high risk for recurrent infection or for an adverse outcome. The rates of initial clinical cure were 80% with bezlotoxumab alone, 73% with actoxumab plus bezlotoxumab, and 80% with placebo; the rates of sustained cure (initial clinical cure without recurrent infection in 12 weeks) were 64%, 58%, and 54%, respectively. The rates of adverse events were similar among these groups; the most common events were diarrhea and nausea. CONCLUSIONS Among participants receiving antibiotic treatment for primary or recurrent C. difficile infection, bezlotoxumab was associated with a substantially lower rate of recurrent infection than placebo and had a safety profile similar to that of placebo. The addition of actoxumab did not improve efficacy. (Funded by Merck; MODIFY I and MODIFY II ClinicalTrials.gov numbers, NCT01241552 and NCT01513239.

Understanding missed opportunities for more timely diagnosis of cancer in symptomatic patients after presentation.

The diagnosis of cancer is a complex, multi-step process. In this paper, we highlight factors involved in missed opportunities to diagnose cancer more promptly in symptomatic patients and discuss responsible mechanisms and potential strategies to shorten intervals from presentation to diagnosis. Missed opportunities are instances in which post-hoc judgement indicates that alternative decisions or actions could have led to more timely diagnosis. They can occur in any of the three phases of the diagnostic process (initial diagnostic assessment; diagnostic test performance and interpretation; and diagnostic follow-up and coordination) and can involve patient, doctor/care team, and health-care system factors, often in combination. In this perspective article, we consider epidemiological 'signals' suggestive of missed opportunities and draw on evidence from retrospective case reviews of cancer patient cohorts to summarise factors that contribute to missed opportunities. Multi-disciplinary research targeting such factors is important to shorten diagnostic intervals post presentation. Insights from the fields of organisational and cognitive psychology, human factors science and informatics can be extremely valuable in this emerging research agenda. We provide a conceptual foundation for the development of future interventions to minimise the occurrence of missed opportunities in cancer diagnosis, enriching current approaches that chiefly focus on clinical decision support or on widening access to investigations.We acknowledge the helpful and incisive comments by Dr Rikke Sand Andersen (Aarhus University, Denmark) in conceptualising this piece and in drafts of the manuscript. The work is independent research supported by different funding schemes. GL was supported by a Post-Doctoral Fellowship by the National Institute for Health Research (PDF-2011-04-047) until the end of 2014 and by a Cancer Research UK Clinician Scientist Fellowship award (A18180) from 2015. HS is supported by the VA Health Services Research and Development Service (CRE 12-033; Presidential Early Career Award for Scientists and Engineers USA 14-274), the VA National Center for Patient Safety, the Agency for Health Care Research and Quality (R01HS022087) and in part by the Houston VA HSR&D Center for Innovations in Quality, Effectiveness and Safety (CIN 13–413). PV was supported by CaP, funded by The Danish Cancer Society and the Novo Nordisk Foundation.This is the final version of the article. It first appeared at http://dx.doi.org/10.1038/bjc.2015.4

The frequency of missed test results and associated treatment delays in a highly computerized health system

<p>Abstract</p> <p>Background:</p> <p>Diagnostic errors associated with the failure to follow up on abnormal diagnostic studies ("missed results") are a potential cause of treatment delay and a threat to patient safety. Few data exist concerning the frequency of missed results and associated treatment delays within the Veterans Health Administration (VA).</p> <p>Objective:</p> <p>The primary objective of the current study was to assess the frequency of missed results and resulting treatment delays encountered by primary care providers in VA clinics.</p> <p>Methods:</p> <p>An anonymous on-line survey of primary care providers was conducted as part of the health systems ongoing quality improvement programs. We collected information from providers concerning their clinical effort (e.g., number of clinic sessions, number of patient visits per session), number of patients with missed abnormal test results, and the number and types of treatment delays providers encountered during the two week period prior to administration of our survey.</p> <p>Results:</p> <p>The survey was completed by 106 out of 198 providers (54 percent response rate). Respondents saw and average of 86 patients per 2 week period. Providers encountered 64 patients with missed results during the two week period leading up to the study and 52 patients with treatment delays. The most common missed results included imaging studies (29 percent), clinical laboratory (22 percent), anatomic pathology (9 percent), and other (40 percent). The most common diagnostic delays were cancer (34 percent), endocrine problems (26 percent), cardiac problems (16 percent), and others (24 percent).</p> <p>Conclusion:</p> <p>Missed results leading to clinically important treatment delays are an important and likely underappreciated source of diagnostic error.</p