Blurring the boundaries between synthesis and evaluation. A customized realist evaluative synthesis into adolescent risk behavior prevention

Realist methodologies have been increasingly advocated for the investigation of complex social issues. Public health programs, such as those designed to prevent adolescent risk behavior, are typically considered complex. In conducting a realist review of the empirical literature relating to such programs, we encountered several challenges, including (a) an overabundance of empirical evidence, (b) a problematic level of heterogeneity within and between methodological approaches, (c) discrepancies between theoretical underpinnings and program operationalization, (d) homogeneity of program outcomes, with very little variation in program effectiveness, and (d) a paucity of description relating to content and process. To overcome these challenges, we developed a customized approach to realist evidence synthesis, drawing on the VICTORE (Volition, Implementation, Contexts, Time, Outcomes, Rivalry, and Emergence) complexity checklist and incorporating stakeholder engagement as primary data to achieve greater depth of understanding relating to contextual and mechanistic factors, and the complex interactions between them. Here we discuss the benefits of this adapted methodology alongside an overview of the research through which the methodology was developed. A key finding from this research was that combining the complexity checklist with primary data from stakeholder engagement enabled us to systematically interrogate the data across data sources, uncovering and evidencing mechanisms which may otherwise have remained hidden, giving greater ontological depth to our research findings. This paper builds on key methodological developments in realist research, demonstrating how realist methodologies can be customized to overcome challenges in developing and refining program theory from the literature, and contributes to the broader literature of innovative approaches to realist research

Screencasts: how effective are they and how do students engage with them?

The use of screencasts as an instructional technology is increasing rapidly in higher education. While there appears to be a consensus around students’ satisfaction with the provision of technology enhanced tools, there is limited evidence revolving around their impact in terms of knowledge acquisition. Moreover, the reasons why students choose to engage (or not) with these resources remain largely unreported. The study assessed the effect of using screencasts on undergraduate students’ understanding and engagement with learning material in one of their modules. Customised screencasts were used as optional additional learning and teaching resources. Grades obtained in a test module (with screencasts) and a control module (without screencasts) were compared to gauge the impact of screencasts on knowledge acquisition. Furthermore, the reasons for students’ engagement (or lack thereof) with the screencasts were explored using questionnaires. A modest but significant impact of screencasts on knowledge acquisition was found and students’ perception of the screencasts was overwhelmingly positive. Students suggested that screencasts should be kept short to summarise lectures or delve in-depth into complex concepts but should not replace whole lectures. Reasons for not using screencasts revolved around a lack of understanding of what the resources were but also a reported lack of fit between the nature of the tool and self-assessed learning style

Screencasts: how effective are they and how do students engage with them?

The use of screencasts as an instructional technology is increasing rapidly in higher education. While there appears to be a consensus around students’ satisfaction with the provision of technology enhanced tools, there is limited evidence revolving around their impact in terms of knowledge acquisition. Moreover, the reasons why students choose to engage (or not) with these resources remain largely unreported. The study assessed the effect of using screencasts on undergraduate students’ understanding and engagement with learning material in one of their modules. Customised screencasts were used as optional additional learning and teaching resources. Grades obtained in a test module (with screencasts) and a control module (without screencasts) were compared to gauge the impact of screencasts on knowledge acquisition. Furthermore, the reasons for students’ engagement (or lack thereof) with the screencasts were explored using questionnaires. A modest but significant impact of screencasts on knowledge acquisition was found and students’ perception of the screencasts was overwhelmingly positive. Students suggested that screencasts should be kept short to summarise lectures or delve in-depth into complex concepts but should not replace whole lectures. Reasons for not using screencasts revolved around a lack of understanding of what the resources were but also a reported lack of fit between the nature of the tool and self-assessed learning style

Impact of irreversibility and uncertainty on the timing of infrastructure projects

This paper argues that because of the irreversibility and uncertainty associated with Build - Operate - Transfer (BOT) infrastructure projects, their financial evaluation should also routinely include the determination of the value of the option to defer the construction start-up. This ensures that project viability is comprehensively assessed before any revenue or loan guarantees are considered by project sponsors to support the project. This paper shows that the framework can be used even in the context of the intuitive binomial lattice model. This requires estimating volatility directly from the evolution of the net operating income while accounting for the correlation between the revenue and costs functions. This approach ensures that the uncertainties usually associated with toll revenues, in particular, are thoroughly investigated and their impact on project viability is thoroughly assessed. This paper illustrates the usefulness of the framework with data from an actual (BOT) toll road project. The results show that by postponing the project for a couple of years the project turns out to be viable, whereas it was not without the deferral. The evaluation approach proposed therefore provides a better framework for determining when and the extent of government financial support, if any, that may be needed to support a BOT project on the basis of project economics. The analysis may also be applicable to private sector investment projects, which are characterized by irreversibility and a high rate of uncertainty

Previous Experiences with Epilepsy and Effectiveness of Information to Change Public Perception of Epilepsy

Differences with regard to the effectiveness of health information and attitude change are suggested between people with direct, behavioral experiences with a health topic and people with indirect, nonbehavioral experiences. The effects of three different methods of health education about epilepsy, frequently used in health education practice, are assessed in a pretest posttest design with control groups, controlling for experiences with epilepsy. Subjects were 132 students from teacher-training colleges. After all treatments, attitudes, and knowledge about epilepsy were changed in a positive way. Treatments were found to be equally effective. Before treatment, direct behavioral experiences were related to knowledge and a more positive attitude towards epilepsy. After treatment, subjects with direct behavioral experiences with epilepsy showed less change of attitude and knowledge as compared with subjects with indirect experiences. Direct experiences appear to restrain the processing of new information and attitude change

A theory-grounded framework of Open Source Software adoption in SMEs

This is a post-peer-review, pre-copyedit version of an article published in European Journal of Information Systems. The definitive publisher-authenticated version Macredie, RD and Mijinyawa, K (2011), "A theory-grounded framework of Open Source Software adoption in SMEs", European Journal of Informations Systems, 20(2), 237-250 is available online at: http://www.palgrave-journals.com/ejis/journal/v20/n2/abs/ejis201060a.html.The increasing popularity and use of Open Source Software (OSS) has led to significant interest from research communities and enterprise practitioners, notably in the small business sector where this type of software offers particular benefits given the financial and human capital constraints faced. However, there has been little focus on developing valid frameworks that enable critical evaluation and common understanding of factors influencing OSS adoption. This paper seeks to address this shortcoming by presenting a theory-grounded framework for exploring these factors and explaining their influence on OSS adoption, with the context of study being small- to medium-sized Information Technology (IT) businesses in the U.K. The framework has implications for this type of business – and, we will suggest, more widely – as a frame of reference for understanding, and as tool for evaluating benefits and challenges in, OSS adoption. It also offers researchers a structured way of investigating adoption issues and a base from which to develop models of OSS adoption. The study reported in this paper used the Decomposed Theory of Planned Behaviour (DTPB) as a basis for the research propositions, with the aim of: (i) developing a framework of empirical factors that influence OSS adoption; and (ii) appraising it through case study evaluation with 10 U.K. Small- to medium-sized enterprises in the IT sector. The demonstration of the capabilities of the framework suggests that it is able to provide a reliable explanation of the complex and subjective factors that influence attitudes, subjective norms and control over the use of OSS. The paper further argues that the DTPB proved useful in this research area and that it can provide a variety of situation-specific insights related to factors that influence the adoption of OSS

A Comparative Study of Public Beliefs about Five Energy Systems

Public perceptions (n=244) of five alternative energy sources (nuclear, coal, oil, hydro, and solar) were examined using an attitude model based upon the underlying beliefs held about the attitude object (e.g., each energy system); the focus was on the differing perceptions of sub-groups (n=50) most PRO and CON the use of nuclear energy. Both PRO and CON groups preferred hydro and solar energy to the other energy sources; but the PRO Nuclear Group preferred nuclear energy to the fossil fuels while, for the CON Nuclear Group, nuclear energy was the least preferred system. Of the theoretically possible significant contributors to near-term Austrian electricity supply which were considered in this study (i.e., nuclear, coal, oil), the PRO Nuclear Group saw oil as the alternative to nuclear energy while the CON Nuclear Group preferred coal to oil as the non-nuclear alternative. Factor analysis found that five, relatively independent belief dimensions characterize public thinking about energy systems: beliefs about future-oriented and political risks; economic benefits; environmental risks; psychological/physical risks; and future technology development. Analysis of the belief systems suggested that both PRO and CON Nuclear Groups preferred hydro and solar energy because these systems were perceived as being the least threatening on all risk-related dimensions. The PRO group saw nuclear energy as the system most likely to lead to economic benefits and future technological developments; their low ratings of fossil fuels were primarily due to beliefs that the fossil fuels could provide only marginal economic benefits while leading to appreciable environmental risks. In contrast, the CON group viewed nuclear energy as only marginally more likely to provide economic and technological benefits than the fossil fuels, but as an appreciably greater threat on the risk-related dimensions

Some considerations concerning the challenge of incorporating social variables into epidemiological models of infectious disease transmission

Incorporation of ‘social’ variables into epidemiological models remains a challenge. Too much detail and models cease to be useful; too little and the very notion of infection —a highly social process in human populations—may be considered with little reference to the social. The French sociologist Emile Durkheim proposed that the scientific study of society required identification and study of ‘social currents.’ Such ‘currents’ are what we might today describe as ‘emergent properties,’ specifiable variables appertaining to individuals and groups, which represent the perspectives of social actors as they experience the environment in which they live their lives. Here we review the ways in which one particular emergent property, hope, relevant to a range of epidemiological situations, might be used in epidemiological modelling of infectious diseases in human populations. We also indicate how such an approach might be extended to include a range of other potential emergent properties to repre

Intention of preserving forest remnants among landowners in the Atlantic Forest: The role of the ecological context via ecosystem services

Unravelling the psychological processes determining landowners' support towards forest conservation is crucial, particularly in rural areas of the tropics, where most forest remnants are within private lands. As human–nature connections are known to shape pro‐environmental behaviours, the intention of preserving forest remnants should ultimately be determined by the ecological context people live in. Here, we investigate the pathways through which the ecological context (forest cover), via direct contact with forests and ecosystem services and disservices, influence the psychological antecedents of conservation behaviour (beliefs, attitude and intention of preserving forest remnants). We conceptualized a model based on the Reasoned Action Approach, using the ecological context and these three forest experiences as background factors, and tested the model using Piecewise Structural Equation Modelling. Data were collected through an interview‐based protocol applied to 106 landowners across 13 landscapes varying in forest cover in a consolidated rural region in the Brazilian Atlantic Forest. Our results indicate that: (a) ecosystem services are more important than disservices for shaping intention of preserving forests, particularly non‐provisioning services; (b) contact with forest has an indirect effect on intention, by positively influencing the frequency of receiving ecosystem services; (c) people living in more forested ecological contexts have more contact with forests, receive ecosystem services more frequently and, ultimately, have stronger intention of preserving forests. Hence, our study suggests a dangerous positive feedback loop between deforestation, the extinction of forest experiences and impairment of human–nature connections. Local demands across the full range of ecosystem services, the balance between services and disservices and the ecological context people live in should be considered when developing conservation initiatives in tropical rural areas

The development of a theory-based intervention to promote appropriate disclosure of a diagnosis of dementia

Background: The development and description of interventions to change professional practice are often limited by the lack of an explicit theoretical and empirical basis. We set out to develop an intervention to promote appropriate disclosure of a diagnosis of dementia based on theoretical and empirical work. Methods: We identified three key disclosure behaviours: finding out what the patient already knows or suspects about their diagnosis; using the actual words 'dementia' or 'Alzheimer's disease' when talking to the patient; and exploring what the diagnosis means to the patient. We conducted a questionnaire survey of older peoples' mental health teams (MHTs) based upon theoretical constructs from the Theory of Planned Behaviour (TPB) and Social Cognitive Theory (SCT) and used the findings to identify factors that predicted mental health professionals' intentions to perform each behaviour. We selected behaviour change techniques likely to alter these factors. Results: The change techniques selected were: persuasive communication to target subjective norm; behavioural modelling and graded tasks to target self-efficacy; persuasive communication to target attitude towards the use of explicit terminology when talking to the patient; and behavioural modelling by MHTs to target perceived behavioural control for finding out what the patient already knows or suspects and exploring what the diagnosis means to the patient. We operationalised these behaviour change techniques using an interactive 'pen and paper' intervention designed to increase intentions to perform the three target behaviours. Conclusion : It is feasible to develop an intervention to change professional behaviour based upon theoretical models, empirical data and evidence based behaviour change techniques. The next step is to evaluate the effect of such an intervention on behavioural intention. We argue that this approach to development and reporting of interventions will contribute to the science of implementation by providing replicable interventions that illuminate the principles and processes underlying change.This project is funded by UK Medical Research Council, Grant reference number G0300999. Jeremy Grimshaw holds a Canada Research Chair in Health Knowledge Transfer and Uptake. Jill Francis is funded by the Chief Scientist Office of the Scottish Government Health Directorate. The views expressed in this study are those of the authors