<i>“We’re Seeking Relevance”</i>: Qualitative Perspectives on the Impact of Learning Analytics on Teaching and Learning

Whilst a significant body of learning analytics research tends to focus on impact from the perspective of usability or improved learning outcomes, this paper proposes an approach based on Affordance Theory to describe awareness and intention as a bridge between usability and impact. 10 educators at 3 European institutions participated in detailed interviews on the affordances they perceive in using learning analytics to support practice in education. Evidence illuminates connections between an educator’s epistemic beliefs about learning and the purpose of education, their perception of threats or resources in delivering a successful learning experience, and the types of data they would consider as evidence in recognising or regulating learning. This evidence can support the learning analytics community in considering the proximity to the student, the role of the educator, and their personal belief structure in developing robust analytics tools that educators may be more likely to use

A Framework for Exploring the Impact of Tutor Practices on Learner Self-regulation in Online Environments

There is increasing interest in the conceptualization of Self-Regulated learning (SRL) as a dynamic process which unfolds over the course of a learning activity. This is partly because this conceptualization could potentially be operationalized and used as the basis for AI and analytics tools which monitor and scaffold SRL in real-time. However, while there is an abundance of research on theories of SRL, little research explicitly reviews and operationalizes such theoretical considerations. Work is needed to develop frameworks for the practical applications of fundamental SRL theories, helping researchers move from conceptual considerations to operationalization in real world settings. In this paper, we propose a theoretically grounded framework for investigating SRL in the context of online tutoring for upper primary school learners. SRL is interpreted as a social learning construct, and the framework proposed is designed to investigate the influence of tutor practices on the development of learners’ SRL. We present the results of a pilot study that explored the applicability of the framework

Relationships between students' conceptions of constructivist learning and their regulation and processing strategies

The present study investigated relationships between students' conceptions of constructivist learning on the one hand, and their regulation and processing strategies on the other hand. Students in a constructivist, problem-based learning curriculum were questioned about their conceptions of knowledge construction and self-regulated learning, as well as their beliefs regarding their own (in)ability to learn and motivation to learn. Two hypothesized models were tested within 98 psychology students, using a structural equation modelling approach: The first model implemented regulation and processing variables of the Inventory of Learning Styles [ILS, Vermunt (Learning styles and regulation of learning in higher education - towards process-oriented instruction in autonomous thinking, 1992)], the second model of the Motivated Strategies for Learning Questionnaire [MSLQ, Pintrich and de Groot (Journal of Educational Psychology, 82, 33-40, 1990)]. Results showed that structural relations exist between conceptions of constructivist learning and regulation and processing strategies. Furthermore, students who express doubt with regard to their own learning capacities are at risk for adopting an inadequate regulation strategy. A three-tiered structure of conceptual, controlling, and operational level appeared valid for the MSLQ variables, but not entirely for those of the ILS

Participatory instructional redesign by students and teachers in secondary education: effects on perceptions of instruction

Könings, K. D., Brand-Gruwel, S., & Van Merriënboer, J. J. G. (2011). Participatory instructional redesign by students and teachers in secondary education: effects on perceptions of instruction. Instructional Science, 39(5), 737–762.Students’ perceptions of instruction are important because they direct the learning of students. The fact that teachers have only limited knowledge of these perceptions is likely to threaten the effectiveness of learning, because congruence between interpretations of an instructional intervention is necesarry for its optimal use. This study examines participatory design as a strategy for taking student perceptions into account in instructional re/design. Participatory design meetings of groups of teachers and seven co-designing students in a secondary education setting identified changes to improve the regular education process. The results on changes in student perceptions, perceived-desired discrepancy, and teacher-student disagreement showed some improvement for the co-designers but, unexpectedly, limited or even negative effects for the non-co-designing students. Possible causes are discussed. Participatory design seems to have potential for improving education, but further research is needed

Using formative assessment to influence self- and co-regulated learning: the role of evaluative judgement

Recently, the concept of evaluative judgement has gained attention as a pedagogical approach to classroom formative assessment practices. Evaluative judgement is the capacity to be able to judge the work of oneself and that of others, which implies developing knowledge about one’s own assessment capability. A focus on evaluative judgement helps us to better understand what is the influence of assessment practices in the regulation of learning. In this paper, we link evaluative judgement to two self-regulated learning models (Zimmerman and Winne) and present a model on the effects on co-regulation of learning. The models help us to understand how students can be self-regulated through developing their evaluative judgement. The co-regulation model visualises how the learner can become more strategic in this process through teacher and peer assessment in which assessment knowledge and regulation strategies are shared with the learner. The connections we make here are crucial to strengthening our understanding of the influence of assessment practices on students’ learnin