Impact Factor: outdated artefact or stepping-stone to journal certification?

A review of Garfield's journal impact factor and its specific implementation as the Thomson Reuters Impact Factor reveals several weaknesses in this commonly-used indicator of journal standing. Key limitations include the mismatch between citing and cited documents, the deceptive display of three decimals that belies the real precision, and the absence of confidence intervals. These are minor issues that are easily amended and should be corrected, but more substantive improvements are needed. There are indications that the scientific community seeks and needs better certification of journal procedures to improve the quality of published science. Comprehensive certification of editorial and review procedures could help ensure adequate procedures to detect duplicate and fraudulent submissions.Comment: 25 pages, 12 figures, 6 table

Characteristics Associated with Citation Rate of the Medical Literature

BACKGROUND: The citation rate for articles is viewed as a measure of their importance and impact; however, little is known about what features of articles are associated with higher citation rate. METHODOLOGY/PRINCIPAL FINDINGS: We conducted a cohort study of all original articles, regardless of study methodology, published in the Lancet, JAMA, and New England Journal of Medicine, from October 1, 1999 to March 31, 2000. We identified 328 articles. Two blinded, independent reviewers extracted, in duplicate, nine variables from each article, which were analyzed in both univariable and multivariable linear least-squares regression models for their association with the annual rate of citations received by the article since publication. A two-way interaction between industry funding and an industry-favoring result was tested and found to be significant (p = 0.02). In our adjusted analysis, the presence of industry funding and an industry-favoring result was associated with an increase in annual citation rate of 25.7 (95% confidence interval, 8.5 to 42.8) compared to the absence of both industry funding and industry-favoring results. Higher annual rates of citation were also associated with articles dealing with cardiovascular medicine (13.3 more; 95% confidence interval, 3.9 to 22.3) and oncology (12.6 more; 95% confidence interval, 1.2 to 24.0), articles with group authorship (11.1 more; 95% confidence interval, 2.7 to 19.5), larger sample size and journal of publication. CONCLUSIONS/SIGNIFICANCE: Large trials, with group authorship, industry-funded, with industry-favoring results, in oncology or cardiology were associated with greater subsequent citations

Methodology for the development of a Canadian national EMS research agenda

<p>Abstract</p> <p>Background</p> <p>Many health care disciplines use evidence-based decision making to improve patient care and system performance. While the amount and quality of emergency medical services (EMS) research in Canada has increased over the past two decades, there has not been a unified national plan to enable research, ensure efficient use of research resources, guide funding decisions and build capacity in EMS research. Other countries have used research agendas to identify barriers and opportunities in EMS research and define national research priorities. The objective of this project is to develop a national EMS research agenda for Canada that will: 1) explore what barriers to EMS research currently exist, 2) identify current strengths and opportunities that may be of benefit to advancing EMS research, 3) make recommendations to overcome barriers and capitalize on opportunities, and 4) identify national EMS research priorities.</p> <p>Methods/Design</p> <p>Paramedics, educators, EMS managers, medical directors, researchers and other key stakeholders from across Canada will be purposefully recruited to participate in this mixed methods study, which consists of three phases: 1) qualitative interviews with a selection of the study participants, who will be asked about their experience and opinions about the four study objectives, 2) a facilitated roundtable discussion, in which all participants will explore and discuss the study objectives, and 3) an online Delphi consensus survey, in which all participants will be asked to score the importance of each topic discovered during the interviews and roundtable as they relate to the study objectives. Results will be analyzed to determine the level of consensus achieved for each topic.</p> <p>Discussion</p> <p>A mixed methods approach will be used to address the four study objectives. We anticipate that the keys to success will be: 1) ensuring a representative sample of EMS stakeholders, 2) fostering an open and collaborative roundtable discussion, and 3) adhering to a predefined approach to measure consensus on each topic. Steps have been taken in the methodology to address each of these <it>a priori </it>concerns.</p

Primary versus secondary source of data in observational studies and heterogeneity in meta-analyses of drug effects: a survey of major medical journals

The data from individual observational studies included in meta-analyses of drug effects are collected either from ad hoc methods (i.e. "primary data") or databases that were established for non-research purposes (i.e. "secondary data"). The use of secondary sources may be prone to measurement bias and confounding due to over-the-counter and out-of-pocket drug consumption, or non-adherence to treatment. In fact, it has been noted that failing to consider the origin of the data as a potential cause of heterogeneity may change the conclusions of a meta-analysis. We aimed to assess to what extent the origin of data is explored as a source of heterogeneity in meta-analyses of observational studies.publishe

Reporting bias in medical research - a narrative review

Reporting bias represents a major problem in the assessment of health care interventions. Several prominent cases have been described in the literature, for example, in the reporting of trials of antidepressants, Class I anti-arrhythmic drugs, and selective COX-2 inhibitors. The aim of this narrative review is to gain an overview of reporting bias in the medical literature, focussing on publication bias and selective outcome reporting. We explore whether these types of bias have been shown in areas beyond the well-known cases noted above, in order to gain an impression of how widespread the problem is. For this purpose, we screened relevant articles on reporting bias that had previously been obtained by the German Institute for Quality and Efficiency in Health Care in the context of its health technology assessment reports and other research work, together with the reference lists of these articles

Publication bias in animal welfare scientific literature

Animal welfare scientific literature has accumulated rapidly in recent years, but bias may exist which influences understanding of progress in the field. We conducted a survey of articles related to animal welfare or well being from an electronic database. From 8,541 articles on this topic, we randomly selected 115 articles for detailed review in four funding categories: government; charity and/or scientific association; industry; and educational organization. Ninety articles were evaluated after unsuitable articles were rejected. The welfare states of animals in new treatments, conventional treatments or control groups with no treatment were classified as high, medium or low according to one or more. More articles were published in which the welfare of animals in new treatments was better than that of animals in the conventional or no treatment groups, demonstrating a positive result bias. Failure to publish studies with negative or inconclusive results may lead to other scientists unnecessarily repeating the research. The authors' assessments of the welfare state of the groups were similarly rated high, medium or low, and it was found that new treatments were rated lower if the research was funded by industry, and higher when funded by charities, with government funding agencies intermediate. These differences were not evident in the Five Freedoms assessment, demonstrating an authors' assessment bias that appeared to support the funding agencies' interests. North American funded publications rated the welfare of animals in New treatments higher and those in a Conventional or No Treatment lower, compared with European-funded publications. It is concluded that preliminary evidence was provided of several forms of publication bias in animal welfare science

Exotic earthworm effects on hardwood forest floor, nutrient availability and native plants: a mesocosm study

European earthworms are invading previously worm-free hardwood forests across Minnesota and the Great Lakes region. In many of these forests, earthworm invasions have been associated with the loss of a previously thick forest floor. The ability of earthworms to alter and control ecosystem processes has been demonstrated in agricultural systems, but the dynamics and impact of these invasions in native forest ecosystems is largely unknown. The impacts of earthworm invasion are expected to be related to the size and species composition of the earthworm population because different species have different habitat and feeding preferences. We identified four sugar maple dominated forests in north central Minnesota in the Chippewa National Forest with active earthworm invasion. In each site a sample grid of 45 points (30 x 150 m) 10 m apart in three parallel transects with 15 points each was established that spanned a visible leading edge of invasion. Over four years earthworm populations and forest floor thickness were sampled across all transects, thus providing both a space-for-time assessment of decadal scale successional dynamics and a four-year window into shorter time changes. We found a succession of earthworm species across the visible leading edge due to different patterns of colonization by different earthworm species. Marked increases in space and time in earthworm biomass were associated with the development of discrete transition zones where forest floor thickness decreases to zero in as little as 75 m from areas that have forest floor layers up to 10 cm thick with advancement of the visible leading edge of up to 30 m in four years at three of the study sites. The epi-endogeic species Lumbricus rubellus led to the most rapid removal of forest floor material during initial invasion. Epigeic and epi-endogeic species of earthworms may facilitate the establishment of other species of earthworms leading to the establishment of stable populations of endogeic and anecic species, which prevent recovery of the forest floor

Analysis of full-text publication and publishing predictors of abstracts presented at an Italian public health meeting (2005–2007)

BACKGROUND: In Public Health, a thorough review of abstract quality evaluations and the publication history of studies presented at scientific meetings has never been conducted. To analyse the long-term outcome of quality abstracts submitted to conferences of Italian Society of Hygiene and Public Health (SItI) from 2005 to 2007, we conducted a second analysis of previously published material aiming to estimate full-text publication rate of high quality abstract presented at Italian public health meetings, and to identify predictors of full-text publication. METHODS: The search was undertaken through scientific databases and search engines and through the web sites of the major Italian journals of Public Health. For each publication confirmed as a full text paper, the journal name, impact factor, year of publication, gender of the first author, type of study design, characteristics of the results and sample size were collected. RESULTS: The overall publication rate of the abstracts presented is 23.5 %; most of the papers were published in Public Health journals (average impact factor: 3.007). Non universitary affiliation had resulted in a lower probability of publication, while some of the Conference topics had predisposed the studies to an increased likelihood of publication as well as poster form presentation. CONCLUSIONS: The method presented in this study provides a good framework for the evaluation of the scientific evidence. The findings achieved should be taken into consideration by the Scientific Societies during the contributions selection phase, with the aim of achieving a continuous improvement of work quality. In the future, it would be interesting to survey the abstract authors to identify reasons for unpublished data