Document Type : Brief report
Student Research Committee, Birjand University of Medical Sciences, Birjand, Iran
Social Determinants of Health Research Center, Birjand University of Medical Sciences, Birjand, Iran
Department of Medical Education, Tehran University of Medical Sciences, Tehran, Iran
Department of Oral and Maxillofacial Pathology, Faculty of Dentistry, Birjand University of Medical Sciences, Birjand, Iran
Background: Due to the widespread utilization of electronic exams, neglecting their quality is a major threat. Assessing the quality of electronic exams plays a decisive role in determining the efficacy of electronic learning.
Objectives: This study aimed to assess the quality of electronic exams held at the beginning of the coronavirus disease 2019 outbreak.
Methods: Following a cross-sectional design, this study included all electronic exams of the electronic test center of Birjand University of Medical Sciences during the academic year of 2020. Reliability, discrimination index (DI), and difficulty index (DIF) of exams were used to assess the quality. Descriptive statistics and frequency distributions were used to describe the data.
Results: Out of 101 E-exams, 59.4% had appropriate DIF, 61.4% had low DI, and 66.3% had unfavorable reliability. Also, 38.6% of exams had high DIF (easy questions). For all exams, the mean of DIF, DI, and reliability was 0.66±0.14, 0.28±0.08, and 0.56±0.31, respectively. The mean of DI (P= 0.30) and reliability (P= 0.09) was not significantly different based on faculty. The mean of DIF was significantly different according to the faculty (P=0.03).
Conclusion: Concerning the quality of e-exams, most problems are related to the DI and reliability. It is recommended to hold empowerment workshops on how to design exam questions for faculty members to get them acquainted with strategies to increase the reliability and discrimination index of the exam.
- Wibowo S, Grandhi S, Chugh R, Sawir E. A pilot study of an electronic exam system at an Australian University. Journal of Educational Technology Systems. 2016; 45(1):5-33. doi:10.1177/0047239516646746.
- Llamas-Nistal M, Fernández-Iglesias MJ, González-Tato J, Mikic-Fonte FA. Blended e-assessment: migrating classical exams to the digital world. Computers & Education. 2013; 62(1):72-87. doi:10.1016/j.compedu.2012.10.021.
- Merdzhanov I. Advantages of the electronic exam. Knowledge International Journal. 2019; 35(2):553-8.
- Amer ME. Effectiveness of using electronic exams in assessment in Saudi universities: empirical study. International Journal of Educational Technology and Learning. 2020 Jun 25; 8(2):61-9. doi:10.20448/2003.82.61.69.
- Torssonen T. Electronic exam offers opportunities for collaboration and flexibility in Finnish higher education institutes. Proceedings of the EdMedia+ Innovate Learning conference; 2020 June 1-5; Amsterdam, Netherlands.
- Abualrob MMA, Asad NAA, Abu Daqar MAM. Attitudes toward and implications of the computer-based exams at Arab American University of Palestine. Journal of Education and Learning. 2019; 8(1):196-205. doi:10.5539/jel.v8n1p196.
- Biantoro B, Arfianti A. Issues in the Implementation of computer-based national exam (CBNE) in Indonesian secondary schools. Proceedings of the Third International Conference on Sustainable Innovation 2019–Humanity, education and social sciences (IcoSIHESS 2019); 2019 July 30-31; Yogyakarta, Indonesia. doi: 10.2991/icosihess-19.2019.69. [PMID:31406532]. [PMCID:PMC6684423]
- Ganji Arjenaki B. Surveying the quality of electronic tests in the student satisfaction. Med Sci. 2017; 10 (3): 180-8. [In Persian]
- Seif A. Educational measurement, assessment and evaluation. 7th ed. Tehran: Doran Pub; 2019. [In Persian]
- Malek Pourafshar R, Shojaeipour R, Khazaeli P, Bazrafshan A, Beigzadeh A, Dehghani MR. Comparison of analytic indices of in-person vs. online exams in an Iranian medical university in the academic year 2020. Strides Dev Med Educ. 2020 Sep 1; 17(Suppl): e91451.
- Musa A, Shaheen S, Elmardi A, Ahmed A. Item difficulty & item discrimination as quality indicators of physiology MCQ examinations at the Faculty of Medicine Khartoum University. Khartoum Medical Journal. 2018; 11(2): 1477-86.
- Taib F, Yusoff MS. Difficulty index, discrimination index, sensitivity and specificity of long case and multiple-choice questions to predict medical students’ examination performance. Journal of Taibah University Medical Sciences. 2014; 9(2):110-4. doi:10.1016/j.jtumed.2013.12.002.
- Boopathiraj C, Chellamani K. Analysis of test items on difficulty level and discrimination index in the test for research in education International Journal of Social Science & Interdisciplinary Research. 2013 Feb; 2(2):189-93.
- Mahjabeen W, Alam S, Hassan U, Zafar T, Butt R, Konain S, et al. Difficulty index, discrimination index and distractor efficiency in multiple choice questions. Ann PIMS-Shaheed Zulfiqar Ali Bhutto Med Univ. 2017; 13(4):310-5.