Investigation of Consistency Between the Students’ Scores Using Bayesian Intraclass Correlation Coefficient in Postgraduate Students of Kerman University of Medical Sciences in 2013 - 2015

Mohtasham, Fatemeh; Jahani, Yunes; Behrampour, Abbas; Sharififar, Fariba; Aghaei Afshar, Abbas

doi:10.5812/sdme.84285

Investigation of Consistency Between the Students’ Scores Using Bayesian Intraclass Correlation Coefficient in Postgraduate Students of Kerman University of Medical Sciences in 2013 - 2015

Document Type : Original Article

Authors

Fatemeh Mohtasham ¹

Yunes Jahani ¹

Abbas Behrampour ¹

Fariba Sharififar ²

Abbas Aghaei Afshar ³

¹ Modeling in Health Research Center, Institute for Futures Studies in Health, Kerman University of Medical Sciences, Kerman, Iran

² Department of Pharmacy, Faculty of Pharmacy, Kerman University of Medical Sciences, Kerman, Iran

³ Leishmaniasis Research Center, Faculty of Medicine, Kerman University of Medical Sciences, Iran

https://doi.org/10.5812/sdme.84285

Abstract

Background Evaluation of students’ scores helps us indirectly examine the status of education system in university departments. Objectives In this study, in order to assess the education system, consistency between the students’ scores was evaluated by measuring the Bayesian intraclass correlation coefficient (ICC) in postgraduate students of School of Public Health, Kerman University of Medical Sciences during 2013 - 2015. Methods This cross sectional study was conducted on all postgraduate students of the School of Public Health of Kerman University of Medical Sciences during 2013 - 2015. The students’ scores were collected from the Office of Postgraduate Studies. First, the Bayesian ICC of students’ scores was calculated for all fields. Next, cluster analysis was performed on Master’s fields of study, and the Bayesian ICC was recalculated for each cluster. Data were analyzed using R 3.3.2 and OpenBUGS 3.2.3. Results Out of 117 postgraduate students, 102 (87.2%) were MSc students, and 15 (12.8%) were PhD students. The highest ICC was attributed to health education (ICC = 0.345) and the lowest to environmental health engineering (ICC = 0.023). Clustering was effective in most fields, and ICC of the clusters increased. Conclusions According to the results, consistency between the students’ scores was low in the majority of fields; therefore, it is necessary to modify and improve teaching and evaluation methods.

Keywords

Intraclass Correlation

Academic Achievement

Students’ Scores

Bayesian

Cluster Analysis

Aghamolaei T, Zare S, Abedini S. [The quality gap of educational services from the point of view of students in Hormozgan University of Medical Sciences]. Strides Dev Med Educ. 2007;3(2):78–85. Persian.
Ghafourian Boroujerdnia M, Shakurnia AH, Elhampour H. [The opinions of academic members of Ahvaz University of Medical Sciences about the effective factors on their evaluation score variations]. Strides Dev Med Educ. 2006;3(1):19–25. Persian.
Fakharian E, Tagharrobi Z, Mirhoseini F, Rasoulinejad S, Akbari H, Ameli H. [Influential factors on results of comprehensive preinternship exam in medical faculty of Kashan University of Medical Sciences: survey of an 18-year period]. Hakim Res J. 2012;15(3):203–12.Persian.
Mirzaei AR, Kawarizadeh F, Lohrabian V, Yegane Z. [Evaluation methods of the academic achievement of students Ilam University of Medical Sciences]. Educ Strategy Med Sci. 2015;8(2):91–7. Persian.
Haghdoost AA, Esmaeili A. [Educational Achievement in Medical Students Entered University between 1995 and 2003, Kerman University of Medical Sciences]. Strides Dev Med Educ. 2009;5(2):80–7. Persian.
Haghdoost A, Esmaeili A. Internal consistency of medical students’ scores in general and baisc science exams, Kerman University, Iran. J Med Educ. 2006;9(1):3–10.
Casella G, Berger RL. Statistical inference. Pacific Grove, California:Duxbury; 2002.
Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med.2016;15(2):155–63. doi: 10.1016/j.jcm.2016.02.012. [PubMed: 27330520]. [PubMed Central: PMC4913118].
Palmer JL, Broemeling LD. A comparison of bayes and maximum likelihood estimation of the intraclass correlation coefficient. Commun Stat Theory Methods. 1990;19(3):953–75. doi:10.1080/03610929008830241.
Brandimarte P. Handbook in Monte Carlo simulation: Applications in financial engineering, risk management, and economics. New Jersey: John Wiley & Sons; 2014. doi: 10.1002/9781118593264.
Rencher AC. Methods of multivariate analysis. New Jersey: John Wiley & Sons; 2003. doi:10.1002/0471271357.
Danesh Kazemi A, Davari AR, Momeni Sarvestani M. [Correlation between the scores of dental students in theory and practical restoration courses from 1991 till 2012]. Med Educ Dev. 2013;8(2):57–64. Persian.
Smits PBA, Verbeek JHAM, Nauta MCE, Ten Cate TJ, Metz JCM, van Dijk FJH. Factors predictive of successful learning in postgraduate medical education. Medical Education. 2004;38(7):758–66. doi:10.1111/j.1365-2929.2004.01846.x.
Corell A, Regueras LM, Verdu E, Verdu MJ, de Castro JP. Effects of competitive learning tools on medical students: A case study. PLoS One. 2018;13(3). e0194096. doi: 10.1371/journal.pone.0194096. [PubMed:29518123]. [PubMed Central: PMC5843339].