Evaluating the strength of evidence in research and education : The theory of anchored narratives

Empirical research based on groups of participants and assessment of the competence of individual students, trainees, and professionals in a given context have at least one thing in common: evidence in favour or against a hypothesis should be established by carefully considering and integrating various pieces of evidence to create a coherent story that has no contradictions, loose ends or missing elements. To provide a coherent framework for this process, this article introduces a modified version of a theory that has been used as a model of legal decision making in criminal cases: the theory of anchored narratives. In this theory, judges in a case judge the quality of pieces of evidence and whether these pieces of evidence can be anchored as narratives to form a chain of evidence that enables a decision beyond reasonable doubt regarding a suspect's guilt. This article provides examples from the domain of medicine to elaborate how a modified version of this theory can provide researchers and educators with a framework in which the assessment of both empirical research and competence is a qualitative professional judgement based on an integration of various sources of qualitative and quantitative information

Validation of a self-efficacy instrument and its relationship to performance of crisis resource management skills

Self-efficacy is thought to be important for resuscitation proficiency in that it influences the development of and access to the associated medical knowledge, procedural skills and crisis resource management (CRM) skills. Since performance assessment of CRM skills is challenging, self-efficacy is often used as a measure of competence in this area. While self-efficacy may influence performance, the true relationship between self-efficacy and performance in this setting has not been delineated. We developed an instrument to measure pediatric residents’ self-efficacy in CRM skills and assessed its content validity, internal structure, and relationship to other variables. After administering the instrument to 125 pediatric residents, critical care fellows and faculty, we performed an exploratory factor analysis within a confirmatory factor analysis as well as a known group comparison. The analyses specified four factors that we defined as: situation awareness, team management, environment management, and decision making. Pediatric residents reported lower self-efficacy than fellows and faculty in each factor. We also examined the correlation between self-efficacy and performance scores for a subset of 30 residents who led video recorded simulated resuscitations and had their performances rated by three observers. We found a significant, positive correlation between residents’ self-efficacy in situation awareness and environment management and their overall performance of CRM skills. Our findings suggest that in a specific context, self-efficacy as a form of self-assessment may be informative with regards to performance

Significance testing as perverse probabilistic reasoning

Truth claims in the medical literature rely heavily on statistical significance testing. Unfortunately, most physicians misunderstand the underlying probabilistic logic of significance tests and consequently often misinterpret their results. This near-universal misunderstanding is highlighted by means of a simple quiz which we administered to 246 physicians at two major academic hospitals, on which the proportion of incorrect responses exceeded 90%. A solid understanding of the fundamental concepts of probability theory is becoming essential to the rational interpretation of medical information. This essay provides a technically sound review of these concepts that is accessible to a medical audience. We also briefly review the debate in the cognitive sciences regarding physicians' aptitude for probabilistic inference

Synchronous Gastric Tumours: Two Different Cases

Continuous professional development (CPD) in Periodontology refers to the overall framework of opportunities that facilitate a life-long learning practice, driven by the learner-practitioner and supported by a variety of institutions and individuals. CPD must address different needs for a great diversity of practitioners. It is clear that no particular methodology or technology is able to successfully accommodate the entire spectrum of CPD in Periodontology. Course designers must choose from and combine a wide array of methodologies and technologies, depending upon the needs of the learners and the objectives of the intended education. Research suggests that ‘interactivity’, ‘flexibility’, ‘continuity’ and ‘relevance to learners’ practice’ are major characteristics of successful CPD. Various methods of mentoring, peer-learning environments and work-based learning have been combined with reflective practice and self-study to form the methodological backbone of CPD courses. Blended learning encompasses a wide array of technologies and methodologies and has been successfully used in CPD courses. Internet-based content learning management systems, portable Internet devices, powerful databases and search engines, together with initiatives such as ‘open access’ and ‘open courseware’ provide an array of effective instructional and communication tools. Assessment remains a key issue in CPD, providing learners with valuable feedback and it ensures the credibility and effectiveness of the learning process. Assessment is a multi-level process using different methods for different learning outcomes, as directed by current evidence and best practices. Finally, quality assurance of the education provided must follow CPD courses at all times through a structured and credible process

Cognitive load theory : Practical implications and an important challenge

The field of medical education has adopted a wide variety of theories from other fields. A fairly recent example is cognitive load theory, which originated in educational psychology. Several empirical studies inspired by cognitive load theory and reviews of practical implications of cognitive load theory have contributed to guidelines for the design of medical education. Simultaneously, several research groups have developed instruments for the measurement of cognitive load in a medical education context. These developments notwithstanding, obtaining evidence for different types of cognitive load remains an important challenge. Therefore, the aim of this article is twofold: to provide medical educators with three key guidelines for the design of instruction and assessment and to discuss several fundamental issues in the remaining challenges presented by different types of cognitive load. The guidelines revolve around minimizing cognitive activity that does not contribute to learning, working with specific learning goals in mind, and appreciating the multifaceted relation between learning and assessment. Key issues around the types of cognitive load include the context in which learning occurs, the continued use of single-item mental effort ratings, and the timing of cognitive load and learning outcome measurements