The role of the assessment policy in the relation between learning and performance

__Context:__ Optimising student learning and academic performance is a continuous challenge for medical schools. The assessment policy may influence both learning and performance. Previously, the joint contribution of self-regulated learning (SRL) and participation in scheduled learning activities towards academic performance has been reported. However, little is known about the relationships between SRL, participation and academic performance under different assessment policies. __Objectives:__ The goal of this study was to investigate differences in average scores of SRL, participation and academic performance of students under two assessment policies: (i) a conjunctive lower stakes, lower performance standard (old) assessment policy and (ii) a compensatory higher stakes, higher performance standard (new) assessment policy. In addition, this research investigated whether the relationships between academic performance, SRL and participation are similar across both assessment policies. __Methods:__ Year-1 medical students (i) under the old assessment policy (n = 648) and (ii) under the new assessment policy (n = 529) completed the Motivated Strategies for Learning Questionnaire on SRL, and additional items on participation. Year-1 performance was operationalised as students’ average Year-1 course examination grades. manova and structural equation modelling were used for analyses. __Results:__ Generally, students under the new assessment policy showed significantly higher Year-1 performance, SRL and participation, compared with students under the old assessment policy. The relationships between Year-1 performance, SRL and participation were similar across assessment policies. __Conclusions:__ This study indicates that the higher academic performance under a compensatory higher stakes, higher performance standard assessment policy, results from higher SRL and participation, but not from altered relationships between SRL, participation and performance. In sum, assessment policies have the potential to optimise student learning and performance

Raising the Bar: Higher education students’ sensitivity to the assessment policy

This dissertation concerns higher education students' sensitivity to the assessment policy, in terms of their motivation, self-regulation, academic performance and academic progress

Assessment policies and academic progress: differences in performance and selection for progress

Despite the benefits swift academic progress holds for many stakeholders, there is scarce literature on how academic progress may be improved by changes to assessment policies. Therefore, we investigated academic progress of first-year students after an alteration of characteristics of the assessment policies in three large course programmes: business administration (n = 2048) changed the stakes; medicine (n = 1630) changed the stakes and performance standard; psychology (n = 1076) changed the stakes, performance standard and resit standard. Results indicate that students’ academic progress was sensitive to the characteristics of the assessment policy in all three course programmes. The changes in progress could be explained by differences in performance, as well as by differences in selection for progress by the different policies. Implications are that assessment policies seem effective in shaping student progress, although one size does not fit all

Assessment policies and academic performance within a single course: The role of motivation and self-regulation.

Despite the frequently reported association of characteristics of assessment policies with academic performance, the mechanisms through which these policies affect performance are largely unknown. Therefore, the current research investigated performance, motivation and self-regulation for two groups of students following the same statistics course, but under two assessment policies: education and child studies (ECS) students studied under an assessment policy with relatively higher stakes, a higher performance standard and a lower resit standard, compared with Psychology students. Results show similar initial performance, but more use of resits and higher final performance (post-resit) under the ECS policy compared with the psychology policy. In terms of motivation and self-regulation, under the ECS policy significantly higher minimum grade goals, performance self-efficacy, task value, time and study environment management, and test anxiety were observed, but there were no significant differences in aimed grade goals, academic self-efficacy and effort regulation. The relations of motivational and selfregulatory factors with academic performance were similar between both assessment policies. Thus, educators should be keenly aware of how characteristics of assessment policies are related to students’ motivation, self-regulation and academic performance

Large expert-curated database for benchmarking document similarity detection in biomedical literature search

Document recommendation systems for locating relevant literature have mostly relied on methods developed a decade ago. This is largely due to the lack of a large offline gold-standard benchmark of relevant documents that cover a variety of research fields such that newly developed literature search techniques can be compared, improved and translated into practice. To overcome this bottleneck, we have established the RElevant LIterature SearcH consortium consisting of more than 1500 scientists from 84 countries, who have collectively annotated the relevance of over 180 000 PubMed-listed articles with regard to their respective seed (input) article/s. The majority of annotations were contributed by highly experienced, original authors of the seed articles. The collected data cover 76% of all unique PubMed Medical Subject Headings descriptors. No systematic biases were observed across different experience levels, research fields or time spent on annotations. More importantly, annotations of the same document pairs contributed by different scientists were highly concordant. We further show that the three representative baseline methods used to generate recommended articles for evaluation (Okapi Best Matching 25, Term Frequency-Inverse Document Frequency and PubMed Related Articles) had similar overall performances. Additionally, we found that these methods each tend to produce distinct collections of recommended articles, suggesting that a hybrid method may be required to completely capture all relevant articles. The established database server located at https://relishdb.ict.griffith.edu.au is freely available for the downloading of annotation data and the blind testing of new methods. We expect that this benchmark will be useful for stimulating the development of new powerful techniques for title and title/abstract-based search engines for relevant articles in biomedical research.Peer reviewe

Curricular fit perspective on motivation in higher education

In this article, we present a curricular perspective that can be used to understand students’ focus on assessment in higher education. We propose that the degree of alignment between the objectives and assessment of the curriculum plays a crucial role in students’ motivation. In case of perfect alignment, all objectives have an equitable probability of being assessed. Thus, all learning contributes to performance equitably. Consequently, the motivation to perform and the motivation to learn should result in the same learning behaviour and performance. However, in reality, a certain degree of cognitive and operant misalignment of the assessment with the objectives is present. Hence, some objectives will not need to be mastered in order to pass certain assessments. Consequently, a distinction arises between assessed and unassessed learning, and only the assessed learning contributes to performance. Thus, the probability of performing well on assessments is higher when students focus their effort on the assessed learning only, instead of dividing their effort between the assessed and unassessed learning. Therefore, students who are motivated to perform have a motivation that fits in a misaligned curriculum. The article concludes with implications of this curricular fit perspective for assessment practices, as well as for motivational research