Abbas Makaren; Hamid Mahdavifard; Hasan Gholami
Abstract
Background Numerous exams are held at different levels and in different fields of medical sciences to evaluate students’ practical knowledge. In pass-fail exams where several examiners score the students, it is important to determine “the minimum passing score” or “the passing ...
Read More
Background Numerous exams are held at different levels and in different fields of medical sciences to evaluate students’ practical knowledge. In pass-fail exams where several examiners score the students, it is important to determine “the minimum passing score” or “the passing score” to determine whether students have passed or failed; this score is sometimes called the “cut-off point” or “standard score.” The objective structured clinical examination (OSCE) method is employed for the final assessment of medical students in Semiotics I in Mashhad University of Medical Sciences, Mashhad, Iran. The commonly used standard scoring method for this lesson is the fixed score method, which sometimes results in a discrepancy between educational management and the lecturers. Hence, the current study aims to compare 4 different methods—the Cohen, borderline-group, borderline regression, and Hofstee methods—of determining the passing score in the semiotics course and comparing the results with those of the fixed score method. Methods A 6-station OSCE was used to assess Semiotics I in Mashhad University of Medical Sciences in 2015. In the current study, in order to determine a standard scale for scoring the students, two forms, Forms 1 and 2, and a checklist were completed for each student. In Form 1, a 5-option Likert scale scoring system, graded from poor to excellent, was used. Data from Form 1 were analyzed using the borderline regression and borderline-group methods. Form 2 included 4 items and the collected data were analyzed using the Hofstee method. Data collected from both forms were analyzed, after the exams, using SPSS version 16. Results The cut-off point established by the Cohen method was very close to that of the common method. In other words, there was no significant difference between the cut-off point determined by the Cohen method (11.73) and that of the common method (12). The other study methods, however, such as borderline regression and borderline-group methods proposed higher cut-off points, which were significantly different from that of the common method: more students failed Semiotics I using these methods. The Hofstee method cannot be used in the OSCE, as the results were insignificant. Conclusions Because there was a significant difference in the number of students who passed the exam based on the fixed score and Cohen methods, and on the borderline-group and borderline regression methods, it is recommended that the latter methods not be widely employed. In addition, it is suggested that different methods should be used to define a mean standard passing score because, according to the statistics, an accurate and efficient estimator with minimum variances accuracy should be employed to evaluate population parameters, and the mean estimator would benefit from such advantages.
Kayumars Rashidi; Abdorrahim Afkhamzadeh; Raheleh Khodabandeh
Volume 10, Issue 1 , May 2013, , Pages 42-49
Abstract
Background & Objective: Evaluation of prescriptions of doctors and particularly medical interns is an essential method for obtaining information about prescribing patterns and drug consumption The present study aimed to assess the ability of prescription writing of medical interns and young ...
Read More
Background & Objective: Evaluation of prescriptions of doctors and particularly medical interns is an essential method for obtaining information about prescribing patterns and drug consumption The present study aimed to assess the ability of prescription writing of medical interns and young doctors for common illnesses Methods: In this crosssectional study the ability of prescription writing of medical interns and recently graduated doctors was evaluated via objective structured clinical examination (OSCE) on ten common diseases in Sanandaj Medical School Iran in 2010 Results: The average number of medicine for each prescription was 21 and the average score of participants in all stations was 62% From the correct prescriptions 815% had appropriate medicine and 344% accurate dosage and 213% with precise course of treatment 241% had administered wrong drugs for patients Half of the cases determined the correct treatment period In terms of related factors the score of girls was better than boys (P = 003) However there was no relationship between their ability and age marital status average mark of interns or their medical exam score in preinternship examination (r = 01 ) Conclusion: Prescription writing ability of participants was relatively acceptable but important issues such as drug dosage frequency of consumption and course of treatment which are essential in disease treatment should be improved Therefore it is necessary to review medical education programs and curriculums
Mohammad Jalili; Sara Mortazhejri
Volume 9, Issue 1 , July 2012, , Pages 77-84
Abstract
Background & Objectives: Different methods have been introduced to determine the cutscores of exams However they have been rarely used in our country In this study we used four methods to set a standard for preinternship objective structured clinical examination (OSCE) in Tehran University of Medical ...
Read More
Background & Objectives: Different methods have been introduced to determine the cutscores of exams However they have been rarely used in our country In this study we used four methods to set a standard for preinternship objective structured clinical examination (OSCE) in Tehran University of Medical Sciences Methods: A prefixed score of 60% was considered in the first approach In the Angoff method a panel including 11faculty members was invited to estimate the probability of passing each station for a borderline student and mean of all estimations was considered as the station standard In borderline regression method a linear regression model for each station was calculated in which the students checklist scores and general scores were considered as dependent and independent variables respectively The station standard was calculated based on grade 2 in Likert scale In Cohens method we set the standard at 60% of the 95th percentile point Results : The standards for the total test in the prefixed score Angoff borderline regression and Cohens methods were respectively 60 4915 4239 and 4274 According to these standards the percentages of passing students were respectively 219% 676% 933% and 924% Conclusion: Using four methods to set standard of an OSCE showed that this approach for determining exams cutscore has significant effect on the calculated standard and the percent of students passing the exam