The quality and diagnostic value of open narratives in verbal autopsy: a mixed-methods analysis of partnered interviews from Malawi

Background Verbal autopsy (VA), the process of interviewing a deceased’s family or caregiver about signs and symptoms leading up to death, employs tools that ask a series of closed questions and can include an open narrative where respondents give an unprompted account of events preceding death. The extent to which an individual interviewer, who generally does not interpret the data, affects the quality of this data, and therefore the assigned cause of death, is poorly documented. We aimed to examine inter-interviewer reliability of open narrative and closed question data gathered during VA interviews. Methods During the introduction of VA data collection, as part of a larger study in Mchinji district, Malawi, we conducted partner interviews whereby two interviewers independently recorded open narrative and closed questions during the same interview. Closed questions were collected using a smartphone application (mobile-InterVA) and open narratives using pen and paper. We used mixed methods of analysis to evaluate the differences between recorded responses to open narratives and closed questions, causes of death assigned, and additional information gathered by open narrative. Results Eighteen partner interviews were conducted, with complete data for 11 pairs. Comparing closed questions between interviewers, the median number of differences was 1 (IQR: 0.5–3.5) of an average 65 answered; mean inter-interviewer concordance was 92 % (IQR: 92–99 %). Discrepancies in open narratives were summarized in five categories: demographics, history and care-seeking, diagnoses and symptoms, treatment and cultural. Most discrepancies were seen in the reporting of diagnoses and symptoms (e.g., malaria diagnosis); only one pair demonstrated no clear differences. The average number of clinical symptoms reported was 9 in open narratives and 20 in the closed questions. Open narratives contained additional information on health seeking and social issues surrounding deaths, which closed questions did not gather. Conclusions The information gleaned during open narratives was subject to inter-interviewer variability and contained a limited number of symptom indicators, suggesting that their use for assigning cause of death is questionable. However, they contained rich information on care-seeking, healthcare provision and social factors in the lead-up to death, which may be a valuable source of information for promoting accountable health services

Socio-economic determinants of household food security and women's dietary diversity in rural Bangladesh: a cross-sectional study.

BACKGROUND: There has been limited decline in undernutrition rates in South Asia compared with the rest of Asia and one reason for this may be low levels of household food security. However, the evidence base on the determinants of household food security is limited. To develop policies intended to improve household food security, improved knowledge of the determinants of household food security is required. METHODS: Household data were collected in 2011 from a randomly selected sample of 2,809 women of reproductive age. The sample was drawn from nine unions in three districts of rural Bangladesh. Multinomial logistic regression was conducted to measure the relationship between selected determinants of household food security and months of adequate household food provisioning, and a linear regression to measure the association between the same determinants and women's dietary diversity score. RESULTS: The analyses found that land ownership, adjusted relative risk ratio (RRR) 0.28 (CI 0.18, 0.42); relative wealth (middle tertile 0.49 (0.29, 0.84) and top tertile 0.18 (0.10, 0.33)); women's literacy 0.64 (0.46, 0.90); access to media 0.49 (0.33, 0.72); and women's freedom to access the market 0.56 (0.36, 0.85) all significantly reduced the risk of food insecurity. Larger households increased the risk of food insecurity, adjusted RRR 1.46 (CI 1.02, 2.09). Households with vegetable gardens 0.20 (0.11, 0.31), rich households 0.46 (0.24, 0.68) and literate women 0.37 (0.20, 0.54) were significantly more likely to have better dietary diversity scores. CONCLUSION: Household food insecurity remains a key public health problem in Bangladesh, with households suffering food shortages for an average of one quarter of the year. Simple survey and analytical methods are able to identify numerous interlinked factors associated with household food security, but wealth and literacy were the only two determinants associated with both improved food security and dietary diversity. We cannot conclude whether improvements in all determinants are necessarily needed to improve household food security, but new and existing policies that relate to these determinants should be designed and monitored with the knowledge that they could substantially influence the food security and nutritional status of the population

Electronic data capture in a rural African setting: evaluating experiences with different systems in Malawi

Background As hardware for electronic data capture (EDC), such as smartphones or tablets, becomes cheaper and more widely available, the potential for using such hardware as data capture tools in routine healthcare and research is increasing. Objective We aim to highlight the advantages and disadvantages of four EDC systems being used simultaneously in rural Malawi: two for Android devices (CommCare and ODK Collect), one for PALM and Windows OS (Pendragon), and a custom-built application for Android (Mobile InterVA – MIVA). Design We report on the personal field and development experience of fieldworkers, project managers, and EDC system developers. Results Fieldworkers preferred using EDC to paper-based systems, although some struggled with the technology at first. Highlighted features include in-built skip patterns for all systems, and specifically the ‘case’ function that CommCare offers. MIVA as a standalone app required considerably more time and expertise than the other systems to create and could not be customised for our specific research needs; however, it facilitates standardised routine data collection. CommCare and ODK Collect both have user-friendly web-interfaces for form development and good technical support. CommCare requires Internet to build an application and download it to a device, whereas all steps can be done offline with ODK Collect, a desirable feature in low connectivity settings. Pendragon required more complex programming of logic, using a Microsoft Access application, and generally had less technical support. Start-up costs varied between systems, and all were considered more expensive than setting up a paper-based system; however running costs were generally low and therefore thought to be cost-effective over the course of our projects. Conclusions EDC offers many opportunities for efficient data collection, but brings some issues requiring consideration when designing a study; the decision of which hardware and software to use should be informed by the aim of data collection, budget, and local circumstances

Formative evaluation of a participatory women's group intervention to improve reproductive and women's health outcomes in rural Bangladesh: a controlled before and after study.

BACKGROUND: Women's groups using participatory methods reduced newborn mortality in rural areas of low income countries. Our study assessed a participatory women's group intervention that focused on women's health, nutrition and family planning. METHODS: The study was conducted in three districts in Bangladesh between October 2011 and March 2013, covering a population of around 230 000. On the basis of allocation for the preceding cluster randomised trials, three unions per district were randomly allocated to receive a women's group intervention and three per district were control clusters. Outcomes included unmet need for family planning, morbidity, dietary diversity, night blindness, healthcare decision-making and knowledge of sexual and reproductive health, nutrition and anaemia. A difference-in-difference analysis was used to adjust for secular trends and baseline differences between women taking part in the intervention and a random sample from control clusters. RESULTS: We interviewed 5355 (91% response rate) women before the intervention and 5128 after (96% response rate). There were significant improvements in women's dietary diversity score (increase of 0.2 (95% CI 0.1 to 0.3)) and participation in healthcare decision-making (proportion increase (95% CI) 14.0% (10.6% to 17.4%)). There were also increases in knowledge about: contraception (4.2% (2.0% to 6.3%)), ways to treat (55.4% (52.2% to 58.5%)) and prevent (71.0% (68.0% to 74.1%)) sexually transmitted infections, nutrition (46.6% (43.6% to 49.6%)) and anaemia prevention (62.8% (60.9% to 64.6%)). There were no significant differences in unmet need for family planning, morbidity or night blindness. CONCLUSIONS: Participatory women's groups have considerable potential to improve women's health knowledge, but evidence of impact on certain outcomes is lacking. Further formative work and intervention development is needed to optimise the impact of this approach for women's health

Measuring maternal mortality : an overview of opportunities and options for developing countries

Background:There is currently an unprecedented expressed need and demand for estimates of maternal mortality in developing countries. This has been stimulated in part by the creation of a Millennium Development Goal that will be judged partly on the basis of reductions in maternal mortality by 2015. Methods: Since the launch of the Safe Motherhood Initiative in 1987, new opportunities for data capture have arisen and new methods have been developed, tested and used. This paper provides a pragmatic overview of these methods and the optimal measurement strategies for different developing country contexts. Results: There are significant recent advances in the measurement of maternal mortality, yet also room for further improvement, particularly in assessing the magnitude and direction of biases and their implications for different data uses. Some of the innovations in measurement provide efficient mechanisms for gathering the requisite primary data at a reasonably low cost. No method, however, has zero costs. Investment is needed in measurement strategies for maternal mortality suited to the needs and resources of a country, and which also strengthen the technical capacity to generate and use credible estimates. Conclusion: Ownership of information is necessary for it to be acted upon: what you count is what you do. Difficulties with measurement must not be allowed to discourage efforts to reduce maternal mortality. Countries must be encouraged and enabled to count maternal deaths and act.WJG is funded partially by the University of Aberdeen. OMRC is partially funded by the London School of Hygiene and Tropical Medicine. CS and SA are partially funded by Johns Hopkins University. CAZ is funded by the Health Metrics Network at the World Health Organization. WJG, OMRC, CS and SA are also partially supported through an international research program, Immpact, funded by the Bill & Melinda Gates Foundation, the Department for International Development, the European Commission and USAID

Revising the WHO verbal autopsy instrument to facilitate routine cause-of-death monitoring.

OBJECTIVE: Verbal autopsy (VA) is a systematic approach for determining causes of death (CoD) in populations without routine medical certification. It has mainly been used in research contexts and involved relatively lengthy interviews. Our objective here is to describe the process used to shorten, simplify, and standardise the VA process to make it feasible for application on a larger scale such as in routine civil registration and vital statistics (CRVS) systems. METHODS: A literature review of existing VA instruments was undertaken. The World Health Organization (WHO) then facilitated an international consultation process to review experiences with existing VA instruments, including those from WHO, the Demographic Evaluation of Populations and their Health in Developing Countries (INDEPTH) Network, InterVA, and the Population Health Metrics Research Consortium (PHMRC). In an expert meeting, consideration was given to formulating a workable VA CoD list [with mapping to the International Classification of Diseases and Related Health Problems, Tenth Revision (ICD-10) CoD] and to the viability and utility of existing VA interview questions, with a view to undertaking systematic simplification. FINDINGS: A revised VA CoD list was compiled enabling mapping of all ICD-10 CoD onto 62 VA cause categories, chosen on the grounds of public health significance as well as potential for ascertainment from VA. A set of 221 indicators for inclusion in the revised VA instrument was developed on the basis of accumulated experience, with appropriate skip patterns for various population sub-groups. The duration of a VA interview was reduced by about 40% with this new approach. CONCLUSIONS: The revised VA instrument resulting from this consultation process is presented here as a means of making it available for widespread use and evaluation. It is envisaged that this will be used in conjunction with automated models for assigning CoD from VA data, rather than involving physicians

Effect of participatory women's groups facilitated by Accredited Social Health Activists on birth outcomes in rural eastern India: a cluster-randomised controlled trial

BACKGROUND: A quarter of the world's neonatal deaths and 15% of maternal deaths happen in India. Few community-based strategies to improve maternal and newborn health have been tested through the country's government-approved Accredited Social Health Activists (ASHAs). We aimed to test the effect of participatory women's groups facilitated by ASHAs on birth outcomes, including neonatal mortality. METHODS: In this cluster-randomised controlled trial of a community intervention to improve maternal and newborn health, we randomly assigned (1:1) geographical clusters in rural Jharkhand and Odisha, eastern India to intervention (participatory women's groups) or control (no women's groups). Study participants were women of reproductive age (15-49 years) who gave birth between Sept 1, 2009, and Dec 31, 2012. In the intervention group, ASHAs supported women's groups through a participatory learning and action meeting cycle. Groups discussed and prioritised maternal and newborn health problems, identified strategies to address them, implemented the strategies, and assessed their progress. We identified births, stillbirths, and neonatal deaths, and interviewed mothers 6 weeks after delivery. The primary outcome was neonatal mortality over a 2 year follow up. Analyses were by intention to treat. This trial is registered with ISRCTN, number ISRCTN31567106. FINDINGS: Between September, 2009, and December, 2012, we randomly assigned 30 clusters (estimated population 156 519) to intervention (15 clusters, estimated population n=82 702) or control (15 clusters, n=73 817). During the follow-up period (Jan 1, 2011, to Dec 31, 2012), we identified 3700 births in the intervention group and 3519 in the control group. One intervention cluster was lost to follow up. The neonatal mortality rate during this period was 30 per 1000 livebirths in the intervention group and 44 per 1000 livebirths in the control group (odds ratio [OR] 0.69, 95% CI 0·53-0·89). INTERPRETATION: ASHAs can successfully reduce neonatal mortality through participatory meetings with women's groups. This is a scalable community-based approach to improving neonatal survival in rural, underserved areas of India. FUNDING: Big Lottery Fund (UK)

The distribution and effects of child mortality risk factors in Ethiopia: A comparison of estimates from DSS and DHS

Objectives: To conduct a comparative analysis of the distribution and effects of under-five mortality correlates using Demographic and Health Survey (DHS) and Demographic Surveillance System (DSS) data from Ethiopia, and to investigate the methodological bias in DHS-based childhood mortality rates due to the impossibility of including children whose mothers were deceased. Methods: Using all-cause under-5 mortality as an outcome variable, the distribution and effects of risk factors weremodeled using survival analysis. All live births in rural Ethiopia in the 5-year period before the 2005 DSS+ survey and between 01/01/2000 and 31/12/2004 in the DSS in the Butajira Rural Health Program (in the Southern Nations, Nationalities, and People's (SNNP) region of Ethiopia) were included. Results: Overall, similar estimates of hazard rate ratios were derived from both DHS and DSS data and the child mortality risk profile is similar between each data source, with multiple births and living in less populous households being significant risk factors for under-five mortality. Nevertheless, some notable differences were observed. The DSS data was more sensitive to local variations in population composition and health status, whilst the more dispersed DHS approach tended to average out local variation across the country. Excluding children whose mothers were deceased from the DSS analysis had no important effect on risk profiles or estimates of survival functions at age 5 years. DHS survival functions were somewhat lower than DSS estimates (BRHP=0.87, DHS rural Ethiopia=0.67, DHS SNNP=0.66). Conclusion: Despite differing methodologies, cross-sectional DHS and longitudinal DSS data produce estimates of the distribution and effects of under-five mortality risk factors that are broadly similar. The differing methodological characteristics of DHS and DSS mean that when combined, these two data sources have the potential to provide a comprehensive picture of national population composition and health status as well as the extent of local variation –both of which are important for health monitoring and planning

Comparing verbal autopsy cause of death findings as determined by physician coding and probabilistic modelling: a public health analysis of 54 000 deaths in Africa and Asia.

BACKGROUND: Coverage of civil registration and vital statistics varies globally, with most deaths in Africa and Asia remaining either unregistered or registered without cause of death. One important constraint has been a lack of fit-for-purpose tools for registering deaths and assigning causes in situations where no doctor is involved. Verbal autopsy (interviewing care-givers and witnesses to deaths and interpreting their information into causes of death) is the only available solution. Automated interpretation of verbal autopsy data into cause of death information is essential for rapid, consistent and affordable processing. METHODS: Verbal autopsy archives covering 54 182 deaths from five African and Asian countries were sourced on the basis of their geographical, epidemiological and methodological diversity, with existing physician-coded causes of death attributed. These data were unified into the WHO 2012 verbal autopsy standard format, and processed using the InterVA-4 model. Cause-specific mortality fractions from InterVA-4 and physician codes were calculated for each of 60 WHO 2012 cause categories, by age group, sex and source. Results from the two approaches were assessed for concordance and ratios of fractions by cause category. As an alternative metric, the Wilcoxon matched-pairs signed ranks test with two one-sided tests for stochastic equivalence was used. FINDINGS: The overall concordance correlation coefficient between InterVA-4 and physician codes was 0.83 (95% CI 0.75 to 0.91) and this increased to 0.97 (95% CI 0.96 to 0.99) when HIV/AIDS and pulmonary TB deaths were combined into a single category. Over half (53%) of the cause category ratios between InterVA-4 and physician codes by source were not significantly different from unity at the 99% level, increasing to 62% by age group. Wilcoxon tests for stochastic equivalence also demonstrated equivalence. CONCLUSIONS: These findings show strong concordance between InterVA-4 and physician-coded findings over this large and diverse data set. Although these analyses cannot prove that either approach constitutes absolute truth, there was high public health equivalence between the findings. Given the urgent need for adequate cause of death data from settings where deaths currently pass unregistered, and since the WHO 2012 verbal autopsy standard and InterVA-4 tools represent relatively simple, cheap and available methods for determining cause of death on a large scale, they should be used as current tools of choice to fill gaps in cause of death data