The importance of meta-analysis and systematic review: How research legacy can be maximized through adequate reporting

Systematic reviews are widely accepted as a ‘gold standard’ in evidence synthesis and the meta-analysis within provides a powerful means of looking across datasets. Neal Haddaway argues that while certain fields have embraced these reviews, there is a great opportunity for their growth in other fields. One way to encourage secondary synthesis is for researchers to ensure their data is reported in sufficient detail. Thinking carefully about legacy and future use of data is not only sensible, but should be an obligation

Aquatic macroinvertebrate responses to native and non-native predators

Non-native species can profoundly affect native ecosystems through trophic interactions with native species. Native prey may respond differently to non-native versus native predators since they lack prior experience. Here we investigate antipredator responses of two common freshwater macroinvertebrates, Gammarus pulex and Potamopyrgus jenkinsi, to olfactory cues from three predators; sympatric native fish (Gasterosteus aculeatus), sympatric native crayfish (Austropotamobius pallipes), and novel invasive crayfish (Pacifastacus leniusculus). G. pulex responded differently to fish and crayfish; showing enhanced locomotion in response to fish, but a preference for the dark over the light in response to the crayfish. P. jenkinsi showed increased vertical migration in response to all three predator cues relative to controls. These different responses to fish and crayfish are hypothesised to reflect the predators’ differing predation types; benthic for crayfish and pelagic for fish. However, we found no difference in response to native versus invasive crayfish, indicating that prey naiveté is unlikely to drive the impacts of invasive crayfish. The Predator Recognition Continuum Hypothesis proposes that benefits of generalisable predator recognition outweigh costs when predators are diverse. Generalised responses of prey as observed here will be adaptive in the presence of an invader, and may reduce novel predators’ potential impacts

Water chemistry and endangered white-clawed crayfish: A literature review and field study of water chemistry association in Austropotamobius pallipes

Populations of the endangered white-clawed crayfish (Austropotamobius pallipes) have rapidly declined in distribution and density in recent decades as a result of invasive crayfish, disease and habitat degradation. The species is thought to be particularly sensitive to water chemistry, and has been proposed as a bio-indicator of water quality. Here we detail the results of a systematic review of the literature regarding the chemistry of waterbodies inhabited by white-clawed crayfish, along with a wide-scale field study of the chemistry of crayfish-inhabited waterbodies in the UK. We use these data to examine potentially significant variables influencing crayfish distribution. Several variables appear to have thresholds that affect crayfish distribution; crayfish presence was associated with high dissolved oxygen, low conductivity, ammonium, sodium, and phosphate, and to a lesser extent low sulphate, nitrate, and total suspended solids. Some variables (magnesium, potassium, sodium, sulphate, nitrate, and total suspended solids) may be tolerated at moderate to high concentrations in isolation (indicated by the presence of some populations in high levels of these variables), but suites of chemical conditions may act synergistically in situ and must be considered together. Recent efforts to conserve white-clawed crayfish have included relocations to Ark Sites; novel protected habitats with reduced risk of the introduction of disease, invasive crayfish and habitat degradation. We use our findings to propose the first detailed guidelines for common water chemistry variables of potential Ark Sites for the conservation of the species throughout its European range

Updating and amending systematic reviews and systematic maps in environmental management

Systematic reviews and systematic maps aim to provide an overview of the best available evidence to inform research, policy and practice. However, like any form of review, they will require updating periodically to ensure that the most recent evidence has been incorporated. Here we outline two types of review revisions as recognised in medicine: updates and amendments. Updates involve a search for new studies, expanding the evidence base through time. Any other change (e.g. in screening or synthesis) or correction to the original report is an amendment. Decisions as to whether/when it is appropriate to undertake an update or amendment must be made on a case-by-case basis, considering issues such as the reliability and scope of the existing review or map, likely volume of new evidence, resources available, and the likely value of including new information. Careful, consistent reporting is necessary to ensure transparency and repeatability, particularly where there are deviations from the original methods, and authors should highlight key advances relative to the original report. Updating environmental systematic reviews and maps will be an increasingly important activity as the numbers of both primary studies and synthetic reports in the literature continue to grow

8 common problems with literature reviews and how to fix them

Literature reviews are an integral part of the process and communication of scientific research. Whilst systematic reviews have become regarded as the highest standard of evidence synthesis, many literature reviews fall short of these standards and may end up presenting biased or incorrect conclusions. In this post, Neal Haddaway highlights 8 common problems with literature review methods, provides examples for each and provides practical solutions for ways to mitigate them

Open Synthesis : on the need for evidence synthesis to embrace Open Science

Abstract: The Open Science movement can be broadly summarised as aiming to promote integrity, repeatability and transparency across all aspects of research, from data collection to publication. Systematic reviews and systematic maps aim to provide a reliable synthesis of the evidence on a particular topic, making use of methods that seek to maximise repeatability and comprehensives whilst minimising subjectivity and bias. The central tenet of repeatability is operationalised by transparently reporting methodological activities in detail, such that all actions could be replicated and verified. To date, evidence synthesis has only partially embraced Open Science, typically striving for Open Methodology and Open Access, and occasionally providing sufficient information to be considered to have Open Data for some published reviews. Evidence synthesis communities needs to better embrace Open Science not only to balance knowledge access and increase efficiency, but also to increase reliability, trust and reuse of information collected and synthesised within a review: concepts fundamental to systematic reviews and maps. All aspects of Open Science should be embraced: Open Methodology, Open Data, Open Source and Open Access. In doing so, evidence synthesis can be made more equal, more efficient and more trustworthy. I provide concrete recommendations of how CEE and others can fully embrace Open Synthesis

Final report on project SP1210: Lowland peatland systems in England and Wales – evaluating greenhouse gas fluxes and carbon balances

Lowland peatlands represent one of the most carbon-rich ecosystems in the UK. As a result of widespread habitat modification and drainage to support agriculture and peat extraction, they have been converted from natural carbon sinks into major carbon sources, and are now amongst the largest sources of greenhouse gas (GHG) emissions from the UK land-use sector. Despite this, they have previously received relatively little policy attention, and measures to reduce GHG emissions either through re-wetting and restoration or improved management of agricultural land remain at a relatively early stage. In part, this has stemmed from a lack of reliable measurements on the carbon and GHG balance of UK lowland peatlands. This project aimed to address this evidence gap via an unprecedented programme of consistent, multi year field measurements at a total of 15 lowland peatland sites in England and Wales, ranging from conservation managed ‘near-natural’ ecosystems to intensively managed agricultural and extraction sites. The use of standardised measurement and data analysis protocols allowed the magnitude of GHG emissions and removals by peatlands to be quantified across this heterogeneous data set, and for controlling factors to be identified. The network of seven flux towers established during the project is believed to be unique on peatlands globally, and has provided new insights into the processes the control GHG fluxes in lowland peatlands. The work undertaken is intended to support the future development and implementation of agricultural management and restoration measures aimed at reducing the contribution of these important ecosystems to UK GHG emissions

Which agricultural management interventions are most influential on soil organic carbon (using time series data)?

Background Loss of soil organic carbon (SOC) from agricultural land is identified as one of the major threats to soils, as it influences both fertility and the production of ecosystem services from agriculture. Losses of SOC across regions are often determined by monitoring in different land use systems. Results from agricultural field experiments can reveal increasing SOC stocks after implementation of specific management practices compared to a control, though in time series experiments the relative rate of change is often negative and implying an overall loss. Long-term agricultural field experiments are indispensable for quantifying absolute changes in SOC stocks under different management regimes. Since SOC responses are seldom linear over time, time series data from these experiments are particularly valuable. Methods This systematic review is based on studies reporting time series data collated in a recently completed systematic map on the topic restricted to the warm temperate climate zone and the snow climate zone. These 53 studies were identified and selected systematically according to CEE guidelines. An update of the original search for studies will be repeated using Web of Science and Google Scholar to include newly published academic and grey literature in the time since the original search was performed in September 2013. Studies will be subject to critical appraisal of the internal and external validity, followed by full data extraction (meta-data describing study settings and quantitative study results). Where possible, studies will be included in a quantitative synthesis using time series meta-analytical approaches. The implications of the meta-analytical findings will be discussed in terms of policy, practice and research along with a discussion of the nature of the evidence base

Planetary health as a laboratory for enhanced evidence synthesis

Abstract : Please refer to full text to view abstract