The CIPP Evaluation Model Scale: Development, Reliability and Validity of Evaluation Scale for "Medical Etiquette Courses" in Iranian Medical Curriculum

Document Type : Original Article

Authors

1 Assistant Professor, Department of Midwifery and Reproductive Health, Faculty of Nursing and Midwifery, Iran University of Medical Sciences, Tehran, Iran

2 Professor of Medical Ethics, Department of Medical Ethics, School of Medicine, Shahid Beheshti University of Medical Sciences, Tehran, Iran

3 Associate Professor, Department of Medical Ethics and History of Medicine, School of Persian Medicine, Kerman University of Medical Sciences, Kerman, Iran

4 Professor of Forensic Medicine, Department of Medical Ethics, School of Medicine, Shahid Beheshti University of Medical Sciences, Tehran, Iran

5 Associate Professor, Department of Community and Family Medicine, Afzalipour Faculty of Medicine, Kerman University of Medical Sciences, Kerman, Iran

6 Associate Professor, Reproductive and Family Health Research Center, Kerman University of Medical Sciences, Kerman, Iran

7 MA, Librarian, Department of Central Library and Documentation Center of Kerman University of Medical Sciences, Kerman, Iran

10.22062/sdme.2026.201396.1609
Abstract
Background: Over the years, medical schools worldwide have sought to enhance the learning experience of their students through curriculum updates and diverse teaching methodologies. In this regard, Iranian medical schools have incorporated Medical Etiquette Courses to foster the development of professional skills and behaviors among medical students. Continuous evaluation of these courses is essential to ensure and improve their effectiveness.
Objectives: The purpose of this research was to identify the validity and reliability of a researcher-made evaluation scale, grounded in the principles of Stufflebeam’s CIPP Evaluation Model, for assessing “Medical Etiquette Courses” in the Iranian undergraduate medical curriculum.
Methods: A questionnaire was developed according to the CIPP model of evaluation. The face and content validity of the questionnaire were assessed by an expert panel of
10 faculty members with specialties in medical education and medical ethics. The reliability of the questionnaire was measured through internal consistency using Cronbach's alpha coefficient. Construct validity was evaluated via confirmatory factor analysis using goodness of fit indices. In the pilot study, 171 medical students in the clerkship period who had completed “Medical Etiquette Courses” at Kerman and Shahid Beheshti Universities of Medical Sciences answered the 32-item questionnaire. The data were analyzed using SPSS version 22 and Lisrel 8.8.
Results: The content validity index and content validity ratio were determined as 0.97 and 0.96, respectively. The Cronbach's alpha coefficient of the whole questionnaire was 0.89. Construct validity was confirmed by confirmatory factor analysis. In fact, this model had good fit indices.
Conclusion: The findings from the exploratory and confirmatory factor analyses revealed that the questionnaire is a valid and reliable instrument for assessing the quality of “Medical Etiquette Courses” across the four CIPP dimensions: Context, Input, Process, and Product. By incorporating continuous feedback, the CIPP model facilitates evidence-based decision-making and promotes sustainable educational development.

Highlights

Homa Sadeghi Avval Shahr: (Google Scholar) (PubMed)

Leila Afshar: (Google Scholar) (PubMed)

Mina Mobasher: (Google Scholar) (PubMed)

Shabnam Bazmi: (Google Scholar) (PubMed)

Habibeh Ahmadipour: (Google Scholar) (PubMed)

Atefe Ahamadi: (Google Scholar) (PubMed)

Leila Namdar: (Google Scholar) (PubMed)

Keywords


  1. Başak O, Yaphe J, Spiegel W, Wilm S, Carelli F, Metsemakers JF. Early clinical exposure in medical curricula across Europe: an overview. Eur J Gen Pract. 2009; 15(1): 4-10. doi: 1080/13814780902745930. PMID: 19229784
  2. Ramzan M, Khan KW, Bibi S. Orientation program for first year medical students: A qualitative study. Pakistan Armed Forces Medical Journal. 2018;68(5):1332–8.
  3. Dyrbye LN, Thomas MR, Shanafelt TD. Systematic review of depression, anxiety, and other indicators of psychological distress among U.S. and Canadian medical students. Acad Med. 2006; 81(4):354-73. doi: 1097/00001888-200604000-00009. PMID: 16565188
  4. Cruess SR, Cruess RL, Steinert Y. Supporting the development of a professional identity: General principles. Med Teach. 2019; 41(6):641-649. doi: 1080/0142159X.2018.1536260. PMID: 30739517
  5. Ricchiardi P, Emanuel F. Soft skill assessment in higher education. J Educ Cult Psychol Stud. 2018;2018(17):21–53. doi: 7358/ecps-2018-018-ricc.
  6. Morrell B, Eukel HN, Santurri LE. Soft skills and implications for future professional practice: Qualitative findings of a nursing education escape room. Nurse Educ Today. 2020; 93:104462. doi: 1016/j.nedt.2020.104462. PMID: 32791421
  7. David AS. Foundational orientation program for medical students. Education in Medicine Journal. 2013;5(2): e89-e96. doi: 5959/eimj.v5i2.140.
  8. Bandaru AK. Analysis of orientation program for first year MBBS students to acclimatize to medical institution. International Journal of Scientific Research. 2019; 8(11): 22-3. doi: 36106/ijsr.
  9. Patel J, Akhani P. A study of perception of first-year MBBS students toward orientation program and foundation course at entry level. National Journal of Physiology, Pharmacy and Pharmacology. 2017; 7(9): 920. doi: 5455/njppp.2017.7.0412301052017.
  10. Dyrbye LN, Shanafelt TD. A narrative review on burnout experienced by medical students and residents. Med Educ 2016; 50(1):132-49. doi: 1111/medu.12927. PMID: 26695473
  11. Frenk J, Chen L, Bhutta ZA, Cohen J, Crisp N, Evans T, et al. Health professionals for a new century: transforming education to strengthen health systems in an interdependent world. Lancet. 2010;376(9756):1923-58. doi: 1016/S0140-6736(10)61854-5. PMID: 21112623
  12. Krüger A, Gillmann B, Hardt C, Döring R, Beckers SK, Rossaint R. Teaching non-technical skills for critical incidents: Crisis resource management training for medical students. Anaesthesist. 2009;58(6):582-8. doi: 1007/s00101-009-1511-6. PMID: 19189061
  13. Gordon M, Box H, Halliwell JA, Farrell M, Parker L, Stewart A. Enhancing health care non-technical skills: The TINSELS programme. Clin Teach. 2015;12(6):413-7. doi: 1111/tct.12433. PMID: 26178176
  14. Bhaga PR, Prajapati KM, Bhatt RB, Prajapati VK, Dureja R, Tank GP. Development and introduction of a communication skills module for postgraduate students of ophthalmology. Indian J Ophthalmol. 2019; 67(11): 1810-1815. doi: 4103/ijo.IJO_366_19. PMID: 31638038 PMCID: PMC6836600
  15. Ullah H, Huma S, Yasin G, Ashraf M, Tahir-Ud-Din Q, Shabana H, et al. Curriculum and program evaluation in medical education: a short systematic literature review. Ann Med Surg (Lond). 2024; 86(10): 5988-5994. doi: 1097/MS9.0000000000002518. PMID: 39359811 PMCID: PMC11444604
  16. Stufflebeam DL, Webster WJ. Evaluation as an administrative function. In: Boyan N, editor. Handbook of research on educational administration. White Plains (NY): Longman; 1988: 569–601.
  17. Kyriazos TA. Applied psychometrics: sample size and sample power considerations in factor analysis (EFA, CFA) and SEM in general. Psychology. 2018; 9(8): 2207-30. doi: 4236/psych.2018.98126.
  18. Stufflebeam DL, Zhang G. The CIPP Evaluation Model: How to Evaluate for Improvement and Accountability. New York: Guilford Press; 2017.
  19. Sigudla J, Maritz JE. Exploratory factor analysis of constructs used for investigating research uptake for public healthcare practice and policy in a resource-limited setting, South Africa. BMC Health Serv Res. 2023;23(1):1423. doi: 1186/s12913-023-10165-8. PMID: 38102600 PMCID: PMC10724913
  20. Tavakol M, Wetzel A. Factor analysis: a means for theory and instrument development in support of construct validity. Int J Med Educ. 2020; 11:245-247. doi: 5116/ijme.5f96.0f4a. PMID: 33170146 PMCID: PMC7883798
  21. Stone BM. The ethical use of fit indices in structural equation modeling: Recommendations for psychologists. Front Psychol. 2021; 12:783226. doi: 3389/fpsyg.2021.783226. PMID: 34887821 PMCID: PMC8650002
  22. Lazarus A. Soften up: The importance of soft skills for job success. Physician Exec. 2013;39(5):40-5. PMID: 24180187
  23. Ten Hoeve Y, Jansen G, Roodbol P. The nursing profession: Public image, self-concept and professional identity. A discussion paper. J Adv Nurs. 2014;70(2):295-309. doi: 1111/jan.12177. PMID: 23711235
  24. Lippman LH, Ryberg R, Carney R, Moore KA. Workforce connections: Key “soft skills” that foster youth workforce success: Toward a consensus across fields. Washington (DC): Child Trends; 2015. [cited 2024 Feb 22]. Available from: https://www.voced.edu.au/content/ngv:68660.
  25. Kechagias K. Teaching and assessing soft skills. Neapoli, Greece: School of Thessaloniki; 2011.
  26. Shanley PF. Leaving the "empty glass" of problem-based learning behind: New assumptions and a revised model for case study in preclinical medical education. Acad Med. 2007;82(5):479-85. doi: 1097/ACM.0b013e31803eac4c. PMID: 17457072
  27. Choi E, Lindquist R, Song Y. Effects of problem-based learning vs. traditional lecture on Korean nursing students’ critical thinking, problem-solving, and self-directed learning. Nurse Educ Today. 2014;34(1):52-6. doi: 1016/j.nedt.2013.02.012. PMID: 23535270
  28. Zahid MA, Varghese R, Mohammed AM, Ayed AK. Comparison of the problem based learning-driven with the traditional didactic-lecture-based curricula. Int J Med Educ. 2016; 7:181-7. doi: 5116/ijme.5749.80f5. PMID: 27289331 PMCID: PMC4912697
  29. Kataoka H, Iwase T, Ogawa H, Mahmood S, Sato M, DeSantis J, et al. Can communication skills training improve empathy? A six-year longitudinal study of medical students in Japan. Med Teach. 2019;41(2):195-200. doi: 1080/0142159X.2018.1460657. PMID: 29683011
  30. Pearson E, McLafferty I. The use of simulation as a learning approach to non-technical skills awareness in final year student nurses. Nurse Educ Pract. 2011;11(6):399-405. doi: 1016/j.nepr.2011.03.023. PMID: 21497554
  31. Valipour Khajeghyasi R, Liaghatdar MJ, Nili MR, Shirazi M. Ranking the soft skills of the dental profession based on the importance in job performance: A mixed method study in Isfahan and Mazandaran Universities of Medical Sciences. Dent Res J (Isfahan). 2021; 18:24. doi: 4103/1735-3327.313119. PMID: 34249250 PMCID: PMC8248254
  32. Hausberg MC, Hergert A, Kröger C, Bullinger M, Rose M, Andreas S. Enhancing medical students’ communication skills: Development and evaluation of an undergraduate training program. BMC Med Educ. 2012; 12:16. doi: 1186/1472-6920-12-16. PMID: 22443807 PMCID: PMC3338375
  33. Zabidi-Hussin ZAMH. Curricular trends in Malaysian medical schools: Innovations within. Ann Acad Med Singap. 2006; 35(9):647-54. doi:47102/annals-acadmedsg.V35N9p647. PMID: 17051282
  34. Ahmad A, Yusoff MSB, Wan Mohammad WMZW, Mat Nor MZM. Nurturing professional identity through a community-based education program: Medical students’ experience. J Taibah Univ Med Sci. 2018; 13(2):113-122. doi: 1016/j.jtumed.2017.12.001. PMID: 31435313 PMCID: PMC6694961
  35. Joubert PM, Krüger C, Bergh AM, Pickworth GE, Van Staden CW, Roos JL, et al. Medical students on the value of role models for developing ‘soft skills’: “That’s the way you do it”. South African Psychiatry Review. 2006; 9(1):28–32. doi:4314/ajpsy.v9i1.30204.
  36. Pollard J, Tombs M. Teaching undergraduate medical students non-technical skills: An evaluation study of a simulated ward experience. Adv Med Educ Pract. 2022; 13:485-494. doi: 2147/AMEP.S344301. PMID: 35592356 PMCID: PMC9113035
  37. Imwattana K, Dangprapai Y, Ngamskulrungroj P. Active learning classes in a preclinical year may help improve some soft skills of medical students. Siriraj Medical Journal. 2020;72(5):415–23. doi:33192/Smj.2020.56.
  38. AbdiShahshahani M, Ehsanpour S, Yamani N, Kohan S, Dehghani Z. The development and validation of an instrument to evaluate reproductive health PhD program in Iran based on CIPP evaluation model. Iran J Med Educ. 2014;14(3):252–65. [In Persian]
  39. Khodabandeh S, Rostambeig P, Sabzevari S, Nouhi E. An investigation of medical school curriculum in Kerman University of Medical Sciences, Iran based on the CIPP model. Strides Dev Med Educ. 2016;12(4):663–70. [In Persian]
  40. Ahmadipour H, Alirezaie A, Mobasher M. Psychometric properties of the context, input, process, and product (CIPP) model for the evaluation of medical ethics education. Strides Dev Med Educ. 2023; 20(1): 155–61. doi: 22062/sdme.2023.198729.1240.