Measuring patient-perceived quality of care in US hospitals using Twitter

BACKGROUND: Patients routinely use Twitter to share feedback about their experience receiving healthcare. Identifying and analysing the content of posts sent to hospitals may provide a novel real-time measure of quality, supplementing traditional, survey-based approaches. OBJECTIVE: To assess the use of Twitter as a supplemental data stream for measuring patient-perceived quality of care in US hospitals and compare patient sentiments about hospitals with established quality measures. DESIGN: 404 065 tweets directed to 2349 US hospitals over a 1-year period were classified as having to do with patient experience using a machine learning approach. Sentiment was calculated for these tweets using natural language processing. 11 602 tweets were manually categorised into patient experience topics. Finally, hospitals with ≥50 patient experience tweets were surveyed to understand how they use Twitter to interact with patients. KEY RESULTS: Roughly half of the hospitals in the US have a presence on Twitter. Of the tweets directed toward these hospitals, 34 725 (9.4%) were related to patient experience and covered diverse topics. Analyses limited to hospitals with ≥50 patient experience tweets revealed that they were more active on Twitter, more likely to be below the national median of Medicare patients (p<0.001) and above the national median for nurse/patient ratio (p=0.006), and to be a non-profit hospital (p<0.001). After adjusting for hospital characteristics, we found that Twitter sentiment was not associated with Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) ratings (but having a Twitter account was), although there was a weak association with 30-day hospital readmission rates (p=0.003). CONCLUSIONS: Tweets describing patient experiences in hospitals cover a wide range of patient care aspects and can be identified using automated approaches. These tweets represent a potentially untapped indicator of quality and may be valuable to patients, researchers, policy makers and hospital administrators

Associations between health-related quality of life, physical function and fear of falling in older fallers receiving home care

Falls and injuries in older adults have significant consequences and costs, both personal and to society. Although having a high incidence of falls, high prevalence of fear of falling and a lower quality of life, older adults receiving home care are underrepresented in research on older fallers. The objective of this study is to determine the associations between health-related quality of life (HRQOL), fear of falling and physical function in older fallers receiving home care

Comparative Effectiveness Research: An Empirical Study of Trials Registered in ClinicalTrials.gov

Background The $1.1 billion investment in comparative effectiveness research will reshape the evidence-base supporting decisions about treatment effectiveness, safety, and cost. Defining the current prevalence and characteristics of comparative effectiveness (CE) research will enable future assessments of the impact of this program. Methods We conducted an observational study of clinical trials addressing priority research topics defined by the Institute of Medicine and conducted in the US between 2007 and 2010. Trials were identified in ClinicalTrials.gov. Main outcome measures were the prevalence of comparative effectiveness research, nature of comparators selected, funding sources, and impact of these factors on results. Results 231 (22.3%; 95% CI 19.8%–24.9%) studies were CE studies and 804 (77.7%; 95% CI, 75.1%–80.2%) were non-CE studies, with 379 (36.6%; 95% CI, 33.7%–39.6%) employing a placebo control and 425 (41.1%; 95% CI, 38.1%–44.1%) no control. The most common treatments examined in CE studies were drug interventions (37.2%), behavioral interventions (28.6%), and procedures (15.6%). Study findings were favorable for the experimental treatment in 34.8% of CE studies and greater than twice as many (78.6%) non-CE studies (P<0.001). CE studies were more likely to receive government funding (P = 0.003) and less likely to receive industry funding (P = 0.01), with 71.8% of CE studies primarily funded by a noncommercial source. The types of interventions studied differed based on funding source, with 95.4% of industry trials studying a drug or device. In addition, industry-funded CE studies were associated with the fewest pediatric subjects (P<0.001), the largest anticipated sample size (P<0.001), and the shortest study duration (P<0.001). Conclusions In this sample of studies examining high priority areas for CE research, less than a quarter are CE studies and the majority is supported by government and nonprofits. The low prevalence of CE research exists across CE studies with a broad array of interventions and characteristics.National Library of Medicine (U.S.) (5G08LM009778)National Institutes of Health (U.S.

Results and Outcome Reporting In ClinicalTrials.gov, What Makes it Happen?

At the end of the past century there were multiple concerns regarding lack of transparency in the conduct of clinical trials as well as some ethical and scientific issues affecting the trials' design and reporting. In 2000 ClinicalTrials.gov data repository was developed and deployed to serve public and scientific communities with valid data on clinical trials. Later in order to increase deposited data completeness and transparency of medical research a set of restrains had been imposed making the results deposition compulsory for multiple cases.We investigated efficiency of the results deposition and outcome reporting as well as what factors make positive impact on providing information of interest and what makes it more difficult, whether efficiency depends on what kind of institution was a trial sponsor. Data from the ClinicalTrials.gov repository has been classified based on what kind of institution a trial sponsor was. The odds ratio was calculated for results and outcome reporting by different sponsors' class.As of 01/01/2012 118,602 clinical trials data deposits were made to the depository. They came from 9068 different sources. 35344 (29.8%) of them are assigned as FDA regulated and 25151 (21.2%) as Section 801 controlled substances. Despite multiple regulatory requirements, only about 35% of trials had clinical study results deposited, the maximum 55.56% of trials with the results, was observed for trials completed in 2008.The most positive impact on depositing results, the imposed restrains made for hospitals and clinics. Health care companies showed much higher efficiency than other investigated classes both in higher fraction of trials with results and in providing at least one outcome for their trials. They also more often than others deposit results when it is not strictly required, particularly, in the case of non-interventional studies

Extent of non-publication in cohorts of studies approved by research ethics committees or included in trial registries

BACKGROUND: The synthesis of published research in systematic reviews is essential when providing evidence to inform clinical and health policy decision-making. However, the validity of systematic reviews is threatened if journal publications represent a biased selection of all studies that have been conducted (dissemination bias). To investigate the extent of dissemination bias we conducted a systematic review that determined the proportion of studies published as peer-reviewed journal articles and investigated factors associated with full publication in cohorts of studies (i) approved by research ethics committees (RECs) or (ii) included in trial registries. METHODS AND FINDINGS: Four bibliographic databases were searched for methodological research projects (MRPs) without limitations for publication year, language or study location. The searches were supplemented by handsearching the references of included MRPs. We estimated the proportion of studies published using prediction intervals (PI) and a random effects meta-analysis. Pooled odds ratios (OR) were used to express associations between study characteristics and journal publication. Seventeen MRPs (23 publications) evaluated cohorts of studies approved by RECs; the proportion of published studies had a PI between 22% and 72% and the weighted pooled proportion when combining estimates would be 46.2% (95% CI 40.2%-52.4%, I2 = 94.4%). Twenty-two MRPs (22 publications) evaluated cohorts of studies included in trial registries; the PI of the proportion published ranged from 13% to 90% and the weighted pooled proportion would be 54.2% (95% CI 42.0%-65.9%, I2 = 98.9%). REC-approved studies with statistically significant results (compared with those without statistically significant results) were more likely to be published (pooled OR 2.8; 95% CI 2.2-3.5). Phase-III trials were also more likely to be published than phase II trials (pooled OR 2.0; 95% CI 1.6-2.5). The probability of publication within two years after study completion ranged from 7% to 30%. CONCLUSIONS: A substantial part of the studies approved by RECs or included in trial registries remains unpublished. Due to the large heterogeneity a prediction of the publication probability for a future study is very uncertain. Non-publication of research is not a random process, e.g., it is associated with the direction of study findings. Our findings suggest that the dissemination of research findings is biased

Potential for early warning of viral influenza activity in the community by monitoring clinical diagnoses of influenza in hospital emergency departments

<p>Abstract</p> <p>Background</p> <p>Although syndromic surveillance systems are gaining acceptance as useful tools in public health, doubts remain about whether the anticipated early warning benefits exist. Many assessments of this question do not adequately account for the confounding effects of autocorrelation and trend when comparing surveillance time series and few compare the syndromic data stream against a continuous laboratory-based standard. We used time series methods to assess whether monitoring of daily counts of Emergency Department (ED) visits assigned a clinical diagnosis of influenza could offer earlier warning of increased incidence of viral influenza in the population compared with surveillance of daily counts of positive influenza test results from laboratories.</p> <p>Methods</p> <p>For the five-year period 2001 to 2005, time series were assembled of ED visits assigned a provisional ED diagnosis of influenza and of laboratory-confirmed influenza cases in New South Wales (NSW), Australia. Poisson regression models were fitted to both time series to minimise the confounding effects of trend and autocorrelation and to control for other calendar influences. To assess the relative timeliness of the two series, cross-correlation analysis was performed on the model residuals. Modelling and cross-correlation analysis were repeated for each individual year.</p> <p>Results</p> <p>Using the full five-year time series, short-term changes in the ED time series were estimated to precede changes in the laboratory series by three days. For individual years, the estimate was between three and 18 days. The time advantage estimated for the individual years 2003–2005 was consistently between three and four days.</p> <p>Conclusion</p> <p>Monitoring time series of ED visits clinically diagnosed with influenza could potentially provide three days early warning compared with surveillance of laboratory-confirmed influenza. When current laboratory processing and reporting delays are taken into account this time advantage is even greater.</p

Evaluation of alternative respiratory syndromes for specific syndromic surveillance of influenza and respiratory syncytial virus: a time series analysis

<p>Abstract</p> <p>Background</p> <p>Syndromic surveillance is increasingly being evaluated for its potential for early warning of increased disease activity in the population. However, interpretation is hampered by the difficulty of attributing a causative pathogen. We described the temporal relationship between laboratory counts of influenza and respiratory syncytial virus (RSV) detection and alternative groupings of Emergency Department (ED) respiratory diagnoses.</p> <p>Methods</p> <p>ED and laboratory data were obtained for the south-eastern area of Sydney, NSW for the period 1 June 2001 - 1 December 2006. Counts of ED visits and laboratory confirmed positive RSV and influenza cases were aggregated by week. Semi-parametric generalized additive models (GAM) were used to determine the association between the incidence of RSV and influenza and the incidence of respiratory syndrome ED presentations while controlling for temporal confounders.</p> <p>Results</p> <p>For every additional RSV laboratory count, ED diagnoses of bronchiolitis increased by 3.1% (95%CI: 2.7%-3.5%) in the same week. For every additional influenza laboratory count, ED diagnoses of influenza-like illness increased by 4.7% (95%CI: 4.2%-5.2%) one week earlier.</p> <p>Conclusion</p> <p>In this study, large increases in ED diagnoses of bronchiolitis and influenza-like illness were independent and proxy indicators for RSV and influenza activity, respectively.</p

Value of syndromic surveillance within the Armed Forces for early warning during a dengue fever outbreak in French Guiana in 2006

<p>Abstract</p> <p>Background</p> <p>A dengue fever outbreak occured in French Guiana in 2006. The objectives were to study the value of a syndromic surveillance system set up within the armed forces, compared to the traditional clinical surveillance system during this outbreak, to highlight issues involved in comparing military and civilian surveillance systems and to discuss the interest of syndromic surveillance for public health response.</p> <p>Methods</p> <p>Military syndromic surveillance allows the surveillance of suspected dengue fever cases among the 3,000 armed forces personnel. Within the same population, clinical surveillance uses several definition criteria for dengue fever cases, depending on the epidemiological situation. Civilian laboratory surveillance allows the surveillance of biologically confirmed cases, within the 200,000 inhabitants.</p> <p>Results</p> <p>It was shown that syndromic surveillance detected the dengue fever outbreak several weeks before clinical surveillance, allowing quick and effective enhancement of vector control within the armed forces. Syndromic surveillance was also found to have detected the outbreak before civilian laboratory surveillance.</p> <p>Conclusion</p> <p>Military syndromic surveillance allowed an early warning for this outbreak to be issued, enabling a quicker public health response by the armed forces. Civilian surveillance system has since introduced syndromic surveillance as part of its surveillance strategy. This should enable quicker public health responses in the future.</p

Impact of flu on hospital admissions during 4 flu seasons in Spain, 2000–2004

<p>Abstract</p> <p>Background</p> <p>Seasonal flu epidemics in the European region cause high numbers of cases and deaths. Flu-associated mortality has been estimated but morbidity studies are necessary to understand the burden of disease in the population. Our objective was to estimate the excess hospital admissions in Spain of diseases associated with influenza during four epidemic influenza periods (2000 – 2004).</p> <p>Methods</p> <p>Hospital discharge registers containing pneumonia, chronic bronchitis, heart failure and flu from all public hospitals in Spain were reviewed for the years 2000 to 2004. Epidemic periods were defined by data from the Sentinel Surveillance System. Excess hospitalisations were calculated as the difference between the average number of weekly hospitalisations/100,000 in epidemic and non-epidemic periods. Flu epidemics were defined for seasons 2001/2002, 2002/2003, 2003/2004.</p> <p>Results</p> <p>A(H3N2) was the dominant circulating serotype in 2001/2002 and 2003/2004. Negligible excess hospitalisations were observed during the 2002/2003 epidemic where A(H1N1) was circulating. During 2000/2001, flu activity remained below threshold levels and therefore no epidemic period was defined. In two epidemic periods studied a delay between the peak of the influenza epidemic and the peak of hospitalisations was observed. During flu epidemics with A(H3N2), excess hospitalisations were higher in men and in persons <5 and >64 years higher than 10 per 100,000. Pneumonia accounted for 70% of all flu associated hospitalisations followed by chronic bronchitis. No excess flu-specific hospitalisations were recorded during all seasons.</p> <p>Conclusion</p> <p>Flu epidemics have an impact on hospital morbidity in Spain. Further studies that include other variables, such as temperature and humidity, are necessary and will deepen our understanding of the role of each factor during flu epidemics and their relation with morbidity.</p

Knowledge of ghostwriting and financial conflicts-of-interest reduces the perceived credibility of biomedical research

<p>Abstract</p> <p>Background</p> <p>While the impact of conflicts-of-interest (COI) is of increasing concern in academic medicine, there is little research on the reaction of practicing clinicians to the disclosure of such conflicts. We developed two research vignettes presenting a fictional antidepressant medication study, one in which the principal investigator had no COI and another in which there were multiple COI disclosed. We confirmed the face validity of the COI vignette through consultation with experts. Hospital-based clinicians were randomly assigned to read one of these two vignettes and then administered a credibility scale.</p> <p>Findings</p> <p>Perceived credibility ratings were much lower in the COI group, with a difference of 11.00 points (31.42%) on the credibility scale total as calculated through the Mann-Whitney U test (95% CI = 6.99 - 15.00, <it>p </it>< .001). Clinicians in the COI group were also less likely to recommend the antidepressant medication discussed in the vignette (Odds Ratio = 0.163, 95% CI = .03 = 0.875).</p> <p>Conclusions</p> <p>In this study, increased disclosure of COI resulted in lower credibility ratings.</p