Strides in Development of Medical Education

360degree Evaluation Method in Clinical Evaluation of Residents: a Pilot Study on Feasibility Validity and Reliability

Document Type : Original Article

Authors

Nozar Nakhaee 1
Ali Reza Saeed 2

1 Specialist in Community Medicine, Associate Professor Of community Medicine Dept., Physiology Research Center, Kerman University of Medical Sciences, Iran

2 Subspecialist in Orthopedics, Associate Professor Of Orthopedics Dept., Kerman University of Medical Sciences, Iran

Abstract
Background & Objective : The 360degree evaluation method is used to assess residents performance by means other than attends opinions Resident evaluation instruments such as questionnaires for 360degree assessment should be feasible reliable and valid The aim of this study was to examine the feasibility and psychometric properties of the 360degree assessment questionnaires Methods : At first questionnaires were developed based on an extensive literature review and expert panel Sixitem questionnaires were distributed to a consecutive sample of residents (self & peers) medical students nurses and patients Mean scores of respondents in each category were calculated Cronbachs alpha was computed to examine the internal consistency Factor analysis was used to clarify the factoral structure of the data Spearman correlation coefficient was computed to examine the correlation between the evaluators scores Results : Except for faculty members and to some extent patients all evaluators completed the questionnaires The cronbachs alpha for all of the five instruments were above 095 Content validity was acceptable according to the literature reviews and expert panel Factor analysis revealed all six items loaded on a single factor A majority (80%) of correlation coefficients were not significant for evaluators scores Conclusion : Based on this pilot study 360degree assessment tools are feasible reliable and valid measures to evaluate core competencies of residents

Keywords

Questionnaire
evaluation
medical education
Residents
  1. Overeem K, Wollersheim H, Driessen E, Lombarts K, Van De Ven G, Grol R, et al. Doctors’ perceptions of why 360-degree feedback does (not) work: A qualitative study. Med Educ 2009; 43 (9): 874-82.
  2. Lelliott P, Williams R, Mears A, Andiappan M, Owen H, Reading P, et al. Questionnaires for 360-degree assessment of consultant psychiatrists: Development and psychometric properties. Br J Psychiatry 2008; 193 (2): 156-60.
  3. Stark R, Korenstein D, Karani R. Impact of a 360-degree professionalism assessment on faculty comfort and skills in feedback delivery. J Gen Intern Med 2008; 23 (7): 969-72.
  4. Weigelt JA, Brasel KJ, Bragg D, Simpson D. The 360-degree evaluation: Increased work with little return? Curr Surg 2004; 61 (6): 616-26; Discussion 627-8.
  5. Joshi R, Ling FW, Jaeger J. Assessment of a 360-degree instrument to evaluate residents’ competency in interpersonal and communication skills. Acad Med 2004; 79(5): 458-63.
  6. Griffiths CE. Competency assessment of dermatology trainees in the UK. Clin Exp Dermatol 2004; 29 (5): 571-5.
  7. Overeem K, Faber MJ, Arah OA, Elwyn G, Lombarts KM, Wollersheim HC, et al. Doctor performance assessment in daily practice: Does it help doctors or not? A systematic review. Med Educ 2007; 41 (11): 1039-49.
  8. Accreditation Council on Graduate Medical Education. ACGME Outcome Project 1999 Available From: URL: http://www.acgme.org/outcome/comp/compMin.asp. Accessed November 3, 2009.
  9. Meng L, Patel RM, Metro DG. A study of a 360-degree assessment instrument for PACU education and evaluation. Available From:URL: http:// www.docstoc.com/ docs/ 2358046/ A-Study-of-a-360-DegreeAssessment-Instrument-For-PACUEducation, Accessed on 12 Nov 2009.
  10. Massagli TL, Carline JD. Reliability of a 360-degree evaluation to assess resident competence. Am J Phys Med Rehabil 2007; 86 (10): 845-52.
  11. Gross RH, Greene J, Haynes R, Schafer MF. AOA symposium. Orthopedic residency training: Are we meeting expectations? J Bone Joint Surg Am 2008; 90 (2): 429-37.
  12. Swanson JA, Antonoff MB, D’Cunha J, Maddaus MA, Schmitz CC. Developing surgical leaders: Assessing the personal and professional development needs of surgical residents. J Surg Res 2010; 158 (2): 247.
  13. Goldstein R, Zuckerman B. A perspective on 360-degree evaluations. J Pediatr 2010; 156(1): 1-2.
  14. Ogunyemi D, Gonzalez G, Fong A, Alexander C, Finke D, Donnon T, et al. From the eye of the nurses: 360-degree evaluation of residents. J Contin Educ Health Prof 2009; 29 (2): 105-10.
Strides in Development of Medical Education
Volume 7, Issue 2
2011
Pages 99-103

Home

Editorial Policy

Submit Manuscript

Guide for Authors

Peer Review Process

Guide for Reviewers

Publication Ethics Policy

Forms

Suggestion and Complain

FAQ

Contact Us