Document Type : Original Article
Authors
1 Doctor of Dental Surgery (D.D.S.), School of Dentistry, Babol University of Medical Sciences, Babol, Iran
2 Assistant Professor, Department of Community Oral and Dental Health, School of Dentistry, Mashhad University of Medical Sciences, Mashhad, Iran
Abstract
Background: Assessing dental students’ attitudes toward providing services to disadvantaged populations is essential for improving community-based training programs. Up to now, few scales have been developed to measure dental students' attitudes about deprived groups, among which the “Dental Students’ Attitudes Toward Underserved populations instrument” (DSATU) is a reliable questionnaire.
Objectives: This study aimed to assess and confirm the validity and reliability of Persian version of the DSATU questionnaire.
Methods: In this validation study, translation and cultural adaptation were made by translation and back-translation method. A panel of experts assessed the face and content validity qualitatively. The content validity was assessed using a quantitative approach (which included the Content Validity Ratio (CVR) and the Content Validity Index (CVI). The item’s impact score was evaluated by dental students. The test-retest method and Cronbach’s alpha were used to determine the reliability.
Results: The questionnaire was revised and modified based on the validation results. Regarding CVR, two questions were excluded. Moreover, according to CVI and impact score results, eight questions were modified and corrected. Total cronbach’s alpha coefficient
(= 0.831) and intraclass correlation coefficient (0.83) were acceptable. The Pearson and Spearman’s rank correlation coefficient indicated that the reliability was appropriate.
Conclusion: The introduced Persian version of the DSATU questionnaire is a culturally appropriate, valid, and reliable instrument for Persian researchers who intend to evaluate the attitude of dental students toward underserved populations. Moreover, it can be used to evaluate the effectiveness of community-based training programs in longitudinal studies.
Keywords
Background
Oral health is one of the most critical aspects of overall health. Oral diseases are widespread and adversely influence the quality of life. The distribution of oral diseases in the population is affected by socioeconomic levels. Studies have shown that underserved people who live in low-income areas are more deprived of access to oral health services due to the increase in social inequalities (1-3). One of the major challenges may be a lack of adequately qualified dental personnel to meet the disadvantaged population’s oral health needs (4). Furthermore, a fairly common belief among oral health care providers that these groups are challenging to handle could exacerbate the issue (2, 3, 5-7).
Dentists’ willingness or reluctance to treat underserved patients may be influenced by their dental education (8-10). Several studies demonstrated that community-based educational experiences are correlated with dental students’ tendency to provide dental services to underserved populations (5, 9, 11, 12). Nevertheless, some other authors documented that student’s attitude does not necessarily depend on educational courses
(5, 13, 14). It is, however, commonly accepted that dental education must promote access to oral health services and, eventually, close the oral health inequalities gap. Dental schools are supposed to train dental practitioners who embrace a social obligation to provide oral health services for underserved communities (6, 7, 11).
Recently, dental schools have integrated community-based programs into the dental curricula to improve the care of less privileged communities. Overall, the findings of these programs imply a better understanding of oral health disparities among dental students. Moreover, they acquired higher competency in providing oral health services for people experiencing poverty (15, 16).
Assessing students’ attitudes toward community-based activities and providing services to vulnerable and underserved populations can help evaluate the achievement of goals and the effectiveness of these training programs (13, 17, 18). A popular instrument was designed to evaluate Medical Students’ Attitudes towards Providing Care for the Underserved populations (MSATU questionnaire) by Crandall and Loemker in 1993 (19). In 2011, Habibian et al. modified this questionnaire to introduce a new tool for assessing Dental Students Attitude toward Underserved Populations (DSATU). This tool consists of 23 Likert scale questions divided into four domains that address societal expectations, student responsibility, personal efficacy, and access to care (5). So far, no study has been conducted in this field in Iran, and the appropriate instrument has not been designed in Persian. Therefore, this study aimed to translate and validate the Persian version of the DSATU questionnaire.
Objectives
This study aimed to assess and confirm the validity and reliability of Persian version of the DSATU questionnaire.
Methods
Study design: This validation study was carried out at Mashhad Dental School, one of the major active educational centers in community-based programs among Iranian dental schools.
DSATU questionnaire: This tool consists of 23 Likert scale questions divided into four domains: societal expectations, dental student/dentist responsibility, personal efficacy, and access to care. The choices vary from 1 (extremely disagree) to 5 (extremely agree), giving a total score ranging from 23 to 115. The items 1-7-11-20 were reverse questions, so their scoring was done upside-down.
Translation: In the first step in the transcultural adaptation process, the original version of the questionnaire was translated from English to Persian by two bilingual professionals whose native language is Persian. Afterward, the two translated versions were merged, and the research team evaluated and agreed on it. The resulting questionnaire was back-translated into English by another language expert who did not know the English context of the questionnaire. Finally, a comparison of the original and back-translated versions showed the accuracy of the translation process.
Qualitative and Quantitative Evaluation of the Content and Face Validity: The questionnaire was introduced to nine academic tutors with PhD in community oral health for qualitative assessment of the content and face validity. They provided written feedback on the accuracy, completeness, scoring system, and placement of the items in the proper order.
The content validity ratio (CVR), based on the Lawshe scale (20), as well as the content validity index (CVI), were used for quantitative validation. The questionnaire was sent to the email addresses of 30 community oral health experts and professors from various Iranian dental schools. Nine experts completed the CVR/CVI checklist. Regarding the CVR formula (20), the panel members classify the necessity of each question based on the Likert scale into three categories: “3 = necessary”, “2 = useful but unnecessary”, and “1 = unnecessary”. The CVR is calculated based on the ratio of the total number of experts who deemed the item necessary to the total number of the expert panel. The Lawshe table determines the minimal acceptable CVR score (Table 1).
Table 1. Lawshe table for minimal acceptable CVR values based on number of panelists
Number of panel members |
CVR values |
5 |
0.99 |
6 |
0.99 |
7 |
0.99 |
8 |
0.75 |
9 |
0.78 |
10 |
0.62 |
11 |
0.59 |
12 |
0.56 |
13 |
0.54 |
14 |
0.51 |
15 |
0.49 |
Item-CVI and scale level-CVI approaches were considered to determine relevance, clarity, and simplicity.
I-CVI: panel members rated relevance, clarity, and simplicity based on four- option on the Likert scale. The relevance of each item was defined with the options of 1 (not relevant), 2 (somewhat relevant), 3 (quite relevant), and 4 (highly relevant). The clarity and simplicity of each item were assessed with a similar pattern. The CVI was then determined for each item as the number of experts giving 3 or 4 rankings, divided by the total number of experts. If the items’ CVI scores were under 0.79, the item requires further revision and modifications (21).
S-CVI: Average S-CVI was calculated by dividing the sum of I-CVIs by the all of items.
Impact Score: The questionnaire was presented to four dental students as a sample of the target group. They were asked to determine the importance of each item on the Likert scale with five options of 1 to 5
(not important to very important). The impact score for each item was calculated using the formula: Percent of selected 4 and 5 scores × mean score of the item. The item is considered important if the impact score is greater than 1.5.
Questionnaire reliability: Finally, the questionnaire reliability was assessed. The questionnaire was emailed to 40 students of Mashhad and Tehran dental schools. They were asked to complete the questionnaire two weeks later again. The internal consistency was assessed using Cronbach’s alpha coefficient. The Intraclass Correlation Coefficient (ICC) and Pearson/Spearman’s rank correlation coefficient were used to assess reliability. The statistical analysis was performed using SPSS version 22. Figure 1 shows the stages of translation and psychometric assessment of the Persian version of the DASTU questionnaire.
Results
The translated questionnaire was reviewed and modified after receiving the expert panel comments. The questionnaire's items and psychometric properties (CVR, CVI, impact score) are presented in Appendix 1.
Validity: Except for eight items, other items gained the acceptable CVR value. All items, except for items 2 and 6 of the first domain, had a CVI score of 0.78 or higher. Furthermore, Scale-level CVI (S-CVI = 0.98) was excellent. The impact scores showed that 20 questions had acceptable values (a score equal to or greater than 1.5).
Reliability: The test retest method, and Cronbach’s alpha were used to evaluate the reliability. Twenty-five students (16 females and nine males) completed
the questionnaire. The mean age of participants was 24.52 ± 1.91 years, ranging from 21 to 29 years. The average academic term of students was 10.56 (range 5 to 12).
Cronbach's alpha was used to examine the internal consistency of the items within the questionnaire. The total score of Cronbach’s alpha (= 0.831) coefficient was acceptable. The Cronbach’s alpha for the questionnaire domains, including societal expectations, student responsibility, personal efficacy, and access to care, were 0.617, 0.633, 0.739, and 0.489, respectively. Cronbach’s alpha was assessed in the case of each item deleted too. The results showed that the alpha value of related domains would decrease in the case of deletion of 16 items.
Moreover, in the test-retest method, spearman’s correlation coefficient was used to evaluate the correlation between the scores of each item. A significant correlation between 22 items was found that implied acceptable repeatability. The pearson’s correlation coefficient was used to evaluate the correlation between each domain's scores and the questionnaire's total score (Table 2).
Table 2. Correlation values between questionnaire domains in test-retest
|
Pearson's correlation coefficient |
P-value |
Societal expectations, |
0.627 |
0.001 |
Dental student/dentist responsibility |
0.684 |
0.001 |
Personal efficacy |
0.861 |
0.001 |
Access to care |
0.678 |
0.001 |
Total DSATU score |
0.700 |
0.001 |
There was a significant correlation between each domain and the total score of the questionnaire. The correlation coefficient of the total scores of the questionnaire was 0.7. The findings of the ICC analysis are presented in Table 3. The intra-class correlation coefficient between all of the domains was acceptable.
According to the results, two questions were removed from the questionnaire after validity evaluation: item 2 in the social expectations domain and item 1 in the dentist's responsibilities. Also, according to the opinions of the honorable panel, questions 3 and 6 of the first domain, questions 2, 3, 4, 5, and 7 in the second domain, and question 3 in the third domain were revised and rewritten. Also, according to the results of Cronbach's alpha, question 3 was left out of the fourth domain, and the fourth score of Cronbach’s alpha elevated to 0.537.
Table 3. Intra class correlation coefficient of each domain and total of the questionnaire
|
ICC |
P-value |
Societal expectations, |
0.726 |
0.001 |
Dental student/dentist responsibility |
0.853 |
< 0.0001 |
Personal efficacy |
0.801 |
< 0.0001 |
Access to care |
0.918 |
< 0.0001 |
Total DSATU score |
0.841 |
< 0.0001 |
ICC: Intraclass correlation coefficient
Discussion
Dental students can be positively influenced due to the collaboration engendered by common attitudes. On the other hand, the shared attitudes can be counterproductive to student learning (2, 3, 12). Although there is a lack of instruments to evaluate dental students’ attitudes toward providing services to deprived populations, the dental version of the MSATU questionnaire is the most commonly used and comprehensive instrument (2, 5, 10, 19). The DSATU questionnaire includes four domains to measure students’ attitudes toward societal expectations, student responsibility, personal efficacy, and access to care (5). Steinberg et al. used the DSATU questionnaire to assess the effectiveness of a medical ethics course in surgery. Findings showed that the ethical course improves students’ attitudes toward disadvantaged groups (12). Moreover, Wayne et al. used this questionnaire in the New Mexico School of Medicine. Their study revealed that the attitude scores have dropped for most students during study courses (22). In line with this survey, Crandall et al. concluded that attitude scores of pharmacy students were more stable over time, while the MSATU scores of medical students decreased over four years (15). Although the results of the Habibian study showed that dental students’ attitude scores decreased significantly over four years, students with a history of working as social volunteers had a significantly higher responsibility score. Moreover, females scored significantly higher than male students (5).
Dande et al.’s questionnaire was designed to assess students’ personal efficacy in providing care for rural populations (2). Additionally, the Health Professional Attitudes toward the Homeless Inventory (HPATHI) questionnaire was first introduced and validated by Buck et al. (23). All the HPATHI’s items limit to provision services to the homeless population. Komaromy, et al.’s questionnaire, was designed and validated to evaluate the willingness of California physicians to provide dental health services for poor patients (10). The Komaromy questionnaire only addresses why some physicians are reluctant to treat poor and uninsured patients. Wieland et al. introduced a questionnaire to assess resident physician attitudes and behaviors regarding care for underserved patients. Although this questionnaire is similar to the DSATU questionnaire, some items (racial disparities) were not culturally appropriate to the Iranian context (24). In conclusion, the DSATU instrument seems to be an appropriate and fruitful questionnaire compared to the other relevant alternatives.
Habibian et al. used the opinions of six dental professors to check the questionnaire's validity qualitatively. So, using qualitative and quantitative assessments of validity could be considered one of this study's advantages (5).
Conclusion
The introduced Persian version of the DSATU questionnaire is a culturally adapted, valid, and reliable instrument for Persian researchers who intend to evaluate the attitude of dental students toward underserved and deprived populations. The coherence of all questions and domains was deemed appropriate. Moreover, it can be helpful to assess the influence of community-based programs in longitudinal studies.
- O'Neil E, Ngai S. An opportunity for reform in oral health service. Am J Public Health. 2011 Oct;101(10):e1-3. doi: 2105/AJPH.2011.300359. [PMID: 21917617] [PMCID: PMC3222363]
- Dande R, Gone H, Saikrishna H, Sayini A, Malgari ST, Paramkusham V. Attitudes and practices of dental students in providing oral health-care services to underserved rural patients attending dental institutions of Telangana, India. J Pharm Bioallied Sci. 2019 Feb;11(Suppl 1):S36-S41. doi: 4103/jpbs.JPBS_215_18. [PMID: 30923429] [PMCID: PMC6398311]
- Furlini L, Noushi N, Castonguay G, Allison P, Bedos C, De Souza R, et al. Assessing Dental Students' Readiness to Treat Populations That Are Underserved: A Scoping Review. J Dent Educ. 2018 May;82(5):483-491. doi: 21815/JDE.018.053. [PMID: 29717072]
- Satcher D, Nottingham JH. Revisiting oral health in America: a report of the surgeon general. American Journal of Public Health. 2017 May;107(S1):S32-3. doi: 2105/AJPH.2017.303687. [PMID: 28661821]
- Habibian M, Seirawan H, Mulligan R. Dental students' attitudes toward underserved populations across four years of dental school. J Dent Educ. 2011;75(8):1020-9. doi: 1002/j.0022-0337.2011.75.8.tb05146.x. [PMID: 21828295]
- Fenton SJ, Hood H, Holder M, May PB Jr, Mouradian WE. The American Academy of Developmental Medicine and Dentistry: eliminating health disparities for individuals with mental retardation and other developmental disabilities. J Dent Educ. 2003 Dec;67(12):1337-44. doi: 1002/j.0022-0337.2003.67.12.tb03727.x. [PMID: 14733266]
- Krause M, Vainio L, Zwetchkenbaum S, Inglehart MR. Dental education about patients with special needs: a survey of U.S. and Canadian dental schools. J Dent Educ. 2010 Nov;74(11): 1179-89. doi: 1002/j.0022-0337.2010.74.11.tb04991.x. [PMID: 21045222]
- Lu SH, McQuistan MR, Qian F. Predictors of Dental Students' Anticipated Willingness to Treat Underserved Populations Five Years After Graduation. J Dent Educ. 2019 Nov;83(11): 1253-1262. doi: 21815/JDE.019.143. [PMID: 31451558]
- McKenzie CT, Mitchell SC. Dental Students' Attitudes About Treating Populations That Are Low-Income Rural, Non-White, and with Special Needs: A Survey of Four Classes at a U.S. Dental School. J Dent Educ. 2019 Jun;83(6):669-678. doi: 21815/JDE.019.074. [PMID: 30910924]
- Komaromy M, Lurie N, Bindman AB. California physicians' willingness to care for the poor. West J Med. 1995 Feb;162(2): 127-32. [PMID: 7725684] [PMCID: PMC1022646]
- Major N, McQuistan MR, Qian F. Changes in Dental Students' Attitudes About Treating Underserved Populations: A Longitudinal Study. J Dent Educ. 2016 May;80(5):517-25. doi: 1002/j.0022-0337.2016.80.5.tb06111.x. [PMID: 27139202]
- Steinberg JR, Bryant TS, Carroll AL, Marin-Nevarez P, Lee EW, Anderson TN, et al. Service through surgery: A
quasi-experimental comparison study on the impact of a preclinical seminar course on diverse mentorship and attitudes towards the underserved. Am J Surg. 2020 Jun;219(6):918-925. doi: 1016/j.amjsurg.2019.07.031. [PMID: 31376950] - Volvovsky M, Vodopyanov D, Inglehart MR. Dental students and faculty members' attitudes towards care for underserved patients and community service: do community-based dental education and voluntary service-learning matter? J Dent Educ. 2014; 78(8): 1127-38. doi: 1002/j.0022-0337.2014.78.8.tb05783.x. [PMID: 25086145]
- Fine AG, Zhang T, Hwang SW. Attitudes towards homeless people among emergency department teachers and learners: a cross-sectional study of medical students and emergency physicians. BMC Med Educ. 2013 Aug 23:13:112. doi: 1186/1472-6920-13-112. [PMID: 23968336] [PMCID: PMC3765267]
- Crandall SJ, Davis SW, Broeseker AE, Hildebrandt C. A longitudinal comparison of pharmacy and medical students' attitudes toward the medically underserved. Am J Pharm Educ. 2008 Dec 15;72(6):148. doi: 5688/aj7206148. [PMID: 19325964] [PMCID: PMC2661153]
- Crandall SJ, Reboussin BA, Michielutte R, Anthony JE, Naughton MJ. Medical students' attitudes toward underserved patients: a longitudinal comparison of problem-based and traditional medical curricula. Adv Health Sci Educ Theory Pract. 2007 Feb;12(1): 71-86. doi: 1007/s10459-005-2297-1. [PMID: 17041814]
- Smith CS, Ester TV, Inglehart MR. Dental Education and Care for Underserved Patients: An Analysis of Students’ Intentions and Alumni Behavior. J Dent Educ. 2006 Apr;70(4):398-408. doi: 1002/j.0022-0337.2006.70.4.tb04094.x. [PMID: 16595532]
- Brown G, Manogue M, Rohlin M. Assessing attitudes in dental education: is it worthwhile? Br Dent J. 2002 Dec 21;193(12): 703-7. doi: 1038/sj.bdj.4801665. [PMID: 12529727]
- Crandall SJ, Volk RJ, Loemker V. Medical students' attitudes toward providing care for the underserved. Are we training socially responsible physicians? JAMA. 1993 May 19;269(19):2519-23. doi: 1001/jama.269.19.2519. [PMID: 8487415]
- Lawshe CH. A quantitative approach to content validity. Personnel psychology. 1975;28(4):563-75. doi: 1111/j.1744-6570.1975.tb01393.x.
- Waltz CF, Bausell RB. Nursing research: Design, statistics, and computer analysis. Philadelphia: FA Davis Co; 1981.
- Wayne S, Dellmore D, Serna L, Jerabek R, Timm C, Kalishman S. The association between intolerance of ambiguity and decline in medical students' attitudes toward the underserved. Acad Med. 2011 Jul;86(7):877-82. doi: 1097/ACM.0b013e31821dac01. [PMID: 21617507]
- Buck DS, Monteiro FM, Kneuper S, Rochon D, Clark DL, Melillo A, et al. Design and validation of the Health Professionals' Attitudes Toward the Homeless Inventory (HPATHI). BMC Med Educ. 2005 Jan 10;5(1):2. doi: 1186/1472-6920-5-2. [PMID: 15642125] [PMCID: PMC545068]
- Wieland ML, Beckman TJ, Cha SS, Beebe TJ, McDonald FS. Residents' attitudes and behaviors regarding care for underserved patients: a multi-institutional survey. J Grad Med Educ. 2011 Sep;3(3):337-44. doi: 4300/JGME-03-03-41. [PMID: 22942959] [PMCID: PMC3179238]