Dental Research Waste in Design, Analysis, and Reporting: A Scoping Review.

Research waste is highly prevalent across biomedical investigations. We aimed to assess the evidence on the extent of research waste in dental research. We performed a scoping review of empirical evaluations of dental studies assessing the prevalence and impact of limitations in design, conduct, analysis, and reporting of research. PubMed was searched using specific terms to retrieve studies dealing with design, conduct, analysis, and reporting of studies in dentistry, with no year or language restrictions. Of the 1,807 publications identified from the search and from manual searches, 71 were included in this review. The topic and article selection was based on the expert opinion of the authors. The existing evidence suggests that, although there are improvements over time, substantial deficiencies in all areas (design, conduct, analysis, reporting) were prevalent in dental research publications. Waste in research is a multifaceted problem without a simple solution. However, an appreciation of optimal research design and execution is a prerequisite and should be underpinned by policies that include appropriate training in research methods and properly aligned incentives

Empirical assessment of published effect sizes and power in the recent cognitive neuroscience and psychology literature

We have empirically assessed the distribution of published effect sizes and estimated power by analyzing 26,841 statistical records from 3,801 cognitive neuroscience and psychology papers published recently. The reported median effect size was D = 0.93 (interquartile range: 0.64-1.46) for nominally statistically significant results and D = 0.24 (0.11-0.42) for nonsignificant results. Median power to detect small, medium, and large effects was 0.12, 0.44, and 0.73, reflecting no improvement through the past half-century. This is so because sample sizes have remained small. Assuming similar true effect sizes in both disciplines, power was lower in cognitive neuroscience than in psychology. Journal impact factors negatively correlated with power. Assuming a realistic range of prior probabilities for null hypotheses, false report probability is likely to exceed 50% for the whole literature. In light of our findings, the recently reported low replication success in psychology is realistic, and worse performance may be expected for cognitive neuroscience.James S. McDonnell Foundation 21st Century Science Initiative in Understanding Human Cognition (grant number 220020370). Received by DS. The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript

Strengthening the reporting of genetic risk prediction studies: the GRIPS statement

The rapid and continuing progress in gene discovery for complex diseases is fueling interest in the potential application of genetic risk models for clinical and public health practice. The number of studies assessing the predictive ability is steadily increasing, but the quality and completeness of reporting varies. A multidisciplinary workshop sponsored by the Human Genome Epidemiology Network developed a checklist of 25 items recommended for strengthening the reporting of Genetic RIsk Prediction Studies (GRIPS), building on the principles established by prior reporting guidelines. These recommendations aim to enhance the transparency of study reporting, and thereby to improve the synthesis and application of information from multiple studies that might differ in design, conduct, or analysis. A detailed Explanation and Elaboration document is published

Bibliometric Evidence for a Hierarchy of the Sciences

The hypothesis of a Hierarchy of the Sciences, first formulated in the 19(th) century, predicts that, moving from simple and general phenomena (e.g. particle dynamics) to complex and particular (e.g. human behaviour), researchers lose ability to reach theoretical and methodological consensus. This hypothesis places each field of research along a continuum of complexity and "softness", with profound implications for our understanding of scientific knowledge. Today, however, the idea is still unproven and philosophically overlooked, too often confused with simplistic dichotomies that contrast natural and social sciences, or science and the humanities. Empirical tests of the hypothesis have usually compared few fields and this, combined with other limitations, makes their results contradictory and inconclusive. We verified whether discipline characteristics reflect a hierarchy, a dichotomy or neither, by sampling nearly 29,000 papers published contemporaneously in 12 disciplines and measuring a set of parameters hypothesised to reflect theoretical and methodological consensus. The biological sciences had in most cases intermediate values between the physical and the social, with bio-molecular disciplines appearing harder than zoology, botany or ecology. In multivariable analyses, most of these parameters were independent predictors of the hierarchy, even when mathematics and the humanities were included. These results support a "gradualist" view of scientific knowledge, suggesting that the Hierarchy of the Sciences provides the best rational framework to understand disciplines' diversity. A deeper grasp of the relationship between subject matter's complexity and consensus could have profound implications for how we interpret, publish, popularize and administer scientific research

Patient and public involvement in reducing health and care research waste

Background Eighty five per cent of health research expenditure is potentially wasted due to failure to publish research, unclear reporting of research that is published, and the failure of new research studies to systematically review previous research in the same topic area, poor study design and conduct. A great deal of progress has been made to address this issue but the role of patients and the public has not been considered. Main A small survey was undertaken, as part of a larger programme of work on reducing health and care waste, to understand the role of patients in reducing research waste. The study showed that patients are interested in this issue particularly in relation to the prioritisation of research and patient and public involvement. Conclusions Patients undertake key roles in the research process including co-applicancy, project management, or as co-researchers. This brings responsibility for ensuring high quality research and value for money. Responsibility for recognition of the potential for wasteful practices is part of the conduct and operation of research studies

The influence of feature selection methods on accuracy, stability and interpretability of molecular signatures

Motivation: Biomarker discovery from high-dimensional data is a crucial problem with enormous applications in biology and medicine. It is also extremely challenging from a statistical viewpoint, but surprisingly few studies have investigated the relative strengths and weaknesses of the plethora of existing feature selection methods. Methods: We compare 32 feature selection methods on 4 public gene expression datasets for breast cancer prognosis, in terms of predictive performance, stability and functional interpretability of the signatures they produce. Results: We observe that the feature selection method has a significant influence on the accuracy, stability and interpretability of signatures. Simple filter methods generally outperform more complex embedded or wrapper methods, and ensemble feature selection has generally no positive effect. Overall a simple Student's t-test seems to provide the best results. Availability: Code and data are publicly available at http://cbio.ensmp.fr/~ahaury/

Menstrual cycle phase does not predict political conservatism

Recent authors have reported a relationship between women's fertility status, as indexed by menstrual cycle phase, and conservatism in moral, social and political values. We conducted a survey to test for the existence of a relationship between menstrual cycle day and conservatism. 2213 women reporting regular menstrual cycles provided data about their political views. Of these women, 2208 provided information about their cycle date, 1260 provided additional evidence of reliability in self-reported cycle date, and of these, 750 also indicated an absence of hormonal disruptors such as recent hormonal contraception use, breastfeeding or pregnancy. Cycle day was used to estimate day-specific fertility rate (probability of conception); political conservatism was measured via direct self-report and via responses to the "Moral Foundations” questionnaire. We also recorded relationship status, which has been reported to interact with menstrual cycle phase in determining political preferences. We found no evidence of a relationship between estimated cyclical fertility changes and conservatism, and no evidence of an interaction between relationship status and cyclical fertility in determining political attitudes. Our findings were robust to multiple inclusion/exclusion criteria and to different methods of estimating fertility and measuring conservatism. In summary, the relationship between cycle-linked reproductive parameters and conservatism may be weaker or less reliable than previously thought

Too much noise in the Times Higher Education rankings

Several individual indicators from the Times Higher Education Survey (THES) data base—the overall score, the reported staff-to-student ratio, and the peer ratings—demonstrate unacceptably high fluctuation from year to year. The inappropriateness of the summary tabulations for assessing the majority of the “top 200” universities would be apparent purely for reason of this obvious statistical instability regardless of other grounds of criticism. There are far too many anomalies in the change scores of the various indices for them to be of use in the course of university management