Beyond A/B Testing: Sequential Randomization for Developing Interventions in Scaled Digital Learning Environments

Randomized experiments ensure robust causal inference that are critical to effective learning analytics research and practice. However, traditional randomized experiments, like A/B tests, are limiting in large scale digital learning environments. While traditional experiments can accurately compare two treatment options, they are less able to inform how to adapt interventions to continually meet learners' diverse needs. In this work, we introduce a trial design for developing adaptive interventions in scaled digital learning environments -- the sequential randomized trial (SRT). With the goal of improving learner experience and developing interventions that benefit all learners at all times, SRTs inform how to sequence, time, and personalize interventions. In this paper, we provide an overview of SRTs, and we illustrate the advantages they hold compared to traditional experiments. We describe a novel SRT run in a large scale data science MOOC. The trial results contextualize how learner engagement can be addressed through inclusive culturally targeted reminder emails. We also provide practical advice for researchers who aim to run their own SRTs to develop adaptive interventions in scaled digital learning environments

Implicit Theories and Their Role in Judgments and Reactions: A Word From Two Perspectives

In this target article, we present evidence for a new model of individual differences in judgments and reactions. The model holds that people's implicit theories about human attributes structure the way they understand and react to human actions and outcomes. We review research showing that when people believe that attributes (such as intelligence or moral character) are fixed, trait-like entities (an entity theory), they tend to understand outcomes and actions in terms of these fixed traits ('I failed the test because I am dumb' or 'He stole the bread because he is dishonest'). In contrast, when people believe that attributes are more dynamic, malleable, and developable (an incremental theory), they tend to focus less on broad traits and, instead, tend to understand outcomes and actions in terms of more specific behavioral or psychological mediators ('I failed the test because of my effort or strategy' or 'He stole the bread because he was desperate'). The two frameworks also appear to foster different reactions: helpless versus mastery-oriented responses to personal setbacks and an emphasis on retribution versus education or rehabilitation for transgressions. These findings are discussed in terms of their implications for personality, motivation, and social perception.published_or_final_versio

Interaction analysis in online maths human tutoring: The case of third space learning

This 'industry' paper reports on the combined effort of researchers and industrial designers and developers to ground the automatic quality assurance of online maths human-to-human tutoring on best practices. We focus on the first step towards this goal. Our aim is to understand the largely under-researched field of online tutoring, to identify success factors in this context and to model best practice in online teaching. We report our research into best practice in online maths teaching and describe and discuss our design and evaluation iterations towards annotation software that can mark up human-to-human online teaching interactions with successful teaching interaction signifiers

Achievement Goal

Achievement goals are self-regulatory commitments that provide direction to individuals as they interpret and respond to competence-relevant situations. Four types of achievement goals have been the primary focus of the literature: Masteryapproach goals (master a task; improve over time), performance-approach goals (outperform others), mastery-avoidance goals (not fall short of mastering a task; not decline over time), and performance-avoidance goals (not be outperformed by others)

The pivotal role of effort beliefs in mediating implicit theories of intelligence and achievement goals & academic motivations

Empirical studies into meaning systems surrounding implicit theories of intelligence typically entail two stringent assumptions: that different implicit theories and different effort beliefs represent opposite poles on a single scale, and that implicit theories directly impact the constructs as achievement goals and academic motivations. Through an empirical study based on a large sample of university students, we aim to demonstrate that relaxing these stringent assumptions, and thereby using the meaning system framework to its full potential, will provide strong benefits: effort beliefs are crucial mediators of relationships between implicit theories and achievement goals and academic motivations, and the different poles of implicit theories and effort beliefs do expose different relationships with goal setting behaviour and academic motivations. A structural equation model, cross-validated by demonstrating gender-invariance of path coefficients, demonstrates that incremental and entity theory views have less predictive power than positive and negative effort beliefs in explaining achievement goals and motivations

Expanding student teachers’ implicit theories about explanations for the science classrooms

This study explored student teachers’ implicit theories about explaining for the science classroom in three courses at diverse universities. Based on microteaching situations, the participants simulated explanations and discussed the elements they considered relevant for giving peer feedback. This led to the design of rubrics for peer assessment, which expressed their implicit theories about what a good explanation for the science classroom would look like. The three rubrics are presented and discussed in the light of the connections between teachers’ thinking and practice. Shulman’s ideas about professional teaching knowledge development, as well as negotiation of meaning, provide theoretical under-pinning for understanding and expanding student teachers’ thinking about explanations for the science classrooms.</p

The role of parental achievement goals in predicting autonomy-supportive and controlling parenting

Although autonomy-supportive and controlling parenting are linked to numerous positive and negative child outcomes respectively, fewer studies have focused on their determinants. Drawing on achievement goal theory and self-determination theory, we propose that parental achievement goals (i.e., achievement goals that parents have for their children) can be mastery, performance-approach or performance-avoidance oriented and that types of goals predict mothers' tendency to adopt autonomy-supportive and controlling behaviors. A total of 67 mothers (aged 30-53 years) reported their goals for their adolescent (aged 13-16 years; 19.4 % girls), while their adolescent evaluated their mothers' behaviors. Hierarchical regression analyses showed that parental performance-approach goals predict more controlling parenting and prevent acknowledgement of feelings, one autonomy-supportive behavior. In addition, mothers who have mastery goals and who endorse performance-avoidance goals are less likely to use guilt-inducing criticisms. These findings were observed while controlling for the effect of maternal anxiety

Has education lost sight of children?

The reflections presented in this chapter are informed by clinical and personal experiences of school education in the UK. There are many challenges for children and young people in the modern education system and for the professionals who support them. In the UK, there are significant gaps between the highly selective education provided to those who pay privately for it and to the majority of those educated in the state-funded system. Though literacy rates have improved around the world, many children, particularly boys, do not finish their education for reasons such as boredom, behavioural difficulties or because education does not ‘pay’. Violence, bullying, and sexual harassment are issues faced by many children in schools and there are disturbing trends of excluding children who present with behavioural problems at school whose origins are not explored. Excluded children are then educated with other children who may also have multiple problems which often just make the situation worse. The experience of clinicians suggests that school-related mental health problems are increasing in severity. Are mental health services dealing with the consequences of an education system that is not meeting children’s needs? An education system that is testing- and performance-based may not be serving many children well if it is driving important decisions about them at increasingly younger ages. Labelling of children and setting them on educational career paths can occur well before they reach secondary schools, limiting potential very early on in their developmental trajectory. Furthermore, the emphasis at school on testing may come at the expense of creativity and other forms of intelligence, which are also valuable and important. Meanwhile the employment marketplace requires people with widely different skills, with an emphasis on innovation, creativity, and problem solving. Is education losing sight of the children it is educating