Azam Meyari; Mahdi Beiglarkhani
Volume 10, Issue 1 , May 2013, , Pages 109-118
Abstract
Background & Objective: The aim of this study was to survey the effect of presenting feedback on improvement of multiple choice questions (MCQ) design in annual residency exams Methods: In this semiexperimental study the structure and taxonomy in MCQs of annual residency exams in 2009 were analyzed ...
Read More
Background & Objective: The aim of this study was to survey the effect of presenting feedback on improvement of multiple choice questions (MCQ) design in annual residency exams Methods: In this semiexperimental study the structure and taxonomy in MCQs of annual residency exams in 2009 were analyzed through Millmans checklist Based on this data an interventional feedback on strengths and weaknesses was presented to question designers who had experience of attending MCQ workshops and designing questions in the past The principles of giving technical feedback in medical education such as objectivity right timing and being direct respectful and without judgment were considered After the annual residency exam in 2010 the questions of designers in both years were compared in respect to Millmans principals and taxonomy before and after the intervention Results: From 2500 questions 2035 questions were entered into the study 652% of the questions developed in 2009 had no structural flaw this increased to 828% after the intervention which was a significant difference (P < 0001) Moreover there was a significant increase in the percentage of questions with a high taxonomy from 38% in 2009 to 531% in 2010 (P < 0001) Conclusion: Giving interventional feedback based on its techniques in medical education to experienced designers of MCQs can affect the improvement of designing quality of questions
Mohammadreza Haghshenas; Kourosh Vahidshahi; Mitra Mahmudi; Leyla Shahbaznejad; Nikoo Parvinnejad; Aazam Emadi
Volume 5, Issue 2 , January 2009, , Pages 120-127
Abstract
Background & Objective : Multiple Choice Questions (MCQs) are the commonest form of exams in medical education which are highly reliable however their structural and content validity taxonomy and structural principles have always been considered by researchers This study was designed to evaluate ...
Read More
Background & Objective : Multiple Choice Questions (MCQs) are the commonest form of exams in medical education which are highly reliable however their structural and content validity taxonomy and structural principles have always been considered by researchers This study was designed to evaluate quality of MCQs in the school medicine Mazandaran University of Medical Sciences regarding taxonomy and structural principles Methods : In this descriptive study all MCQs of written exams held during a whole semester in the school of medical in Mazandaran University of Medical Sciences were evaluated All questions were assessed according to taxonomy (in three levels of recall comprehension and application) and structure using a checklist which was based on Millmans principles for designing stem and choices of questions Results : Among 1478 questions related to 25 exams questions related to lessons of basic sciences physiopathology and clerkship were 287% 187% 526% respectively 774 percent of questions were in Taxonomy I and the rest were designed in Taxonomy II and III 46 percent of all questions had no structural problems while the rest had one or more structural problems Taxonomy and structural problems in exams related to clerkship and physiopathology were significantly less than basic science lessons (p=0023 and p=0001 respectively) Questions of higher taxonomy had less structural problems Conclusion : Our present study showed that the quality of MCQs regarding structural principles and taxonomy were different in exams of different levels which necessitate further revisions
