Camille M Biorn, Rachelle Williams, Cyndee Harmon, Carly Simpson
{"title":"学生自我评价录像测试:一项随机交叉研究。","authors":"Camille M Biorn, Rachelle Williams, Cyndee Harmon, Carly Simpson","doi":"","DOIUrl":null,"url":null,"abstract":"<p><p><b>Purpose</b> Graduates of dental hygiene programs must acquire competence in critical reasoning by developing proficiency in self-assessment. The purpose of this study was to investigate the effectiveness of video-recorded testing compared to direct observation testing on student self-assessment scores, self-assessment accuracy and student retest scores, and to ascertain which modality was preferred by faculty and students.<b>Methods</b> A randomized crossover AB/BA research design evaluated video-recorded testing compared to traditional, direct observation testing. First year dental hygiene students (n=33) were randomly assigned to an AB or BA sequence for preclinical instrumentation skills testing and were evaluated by faculty (n=13). Student self-assessment test scores, faculty test scores, student accuracy scores, and student/faculty surveys were evaluated. Descriptive statistics and parametric independent samples t-tests (<i>p</i><0.05) were used to analyze the data.<b>Results</b> Mean student self-assessment scores were slightly higher with video testing (93.64%) than with direct observation testing (91.98%). Retest scores were similar between the two testing modalities (video 90.74%; direct observation 93.86%). Mean student accuracy scores were nearly equal with the two modalities (video 93.24%; direct observation 93.1%). There were no statistically significant differences in student accuracy, retest, and self-assessment scores for instrumentation skills testing when comparing the modalities. A majority of students (80%) preferred video testing while all faculty members preferred the direct observation testing modality.<b>Conclusion</b> Students preferred video testing for self-assessment compared to direct observational testing, noting the increased ability to identify and correct mistakes. Faculty acknowledged video-recorded evaluation methods as advantageous in enhancing student self-assessment skills. However, faculty preferred direct observation testing, stating it allowed for a more thorough evaluation of skills. Additional research is needed using high-quality video equipment and longitudinal studies.</p>","PeriodicalId":52471,"journal":{"name":"Journal of dental hygiene : JDH / American Dental Hygienists'' Association","volume":"99 5","pages":"29-38"},"PeriodicalIF":0.0000,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Video-Recorded Testing for Student Self-Assessment: A randomized crossover study.\",\"authors\":\"Camille M Biorn, Rachelle Williams, Cyndee Harmon, Carly Simpson\",\"doi\":\"\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p><b>Purpose</b> Graduates of dental hygiene programs must acquire competence in critical reasoning by developing proficiency in self-assessment. The purpose of this study was to investigate the effectiveness of video-recorded testing compared to direct observation testing on student self-assessment scores, self-assessment accuracy and student retest scores, and to ascertain which modality was preferred by faculty and students.<b>Methods</b> A randomized crossover AB/BA research design evaluated video-recorded testing compared to traditional, direct observation testing. First year dental hygiene students (n=33) were randomly assigned to an AB or BA sequence for preclinical instrumentation skills testing and were evaluated by faculty (n=13). Student self-assessment test scores, faculty test scores, student accuracy scores, and student/faculty surveys were evaluated. Descriptive statistics and parametric independent samples t-tests (<i>p</i><0.05) were used to analyze the data.<b>Results</b> Mean student self-assessment scores were slightly higher with video testing (93.64%) than with direct observation testing (91.98%). Retest scores were similar between the two testing modalities (video 90.74%; direct observation 93.86%). Mean student accuracy scores were nearly equal with the two modalities (video 93.24%; direct observation 93.1%). There were no statistically significant differences in student accuracy, retest, and self-assessment scores for instrumentation skills testing when comparing the modalities. A majority of students (80%) preferred video testing while all faculty members preferred the direct observation testing modality.<b>Conclusion</b> Students preferred video testing for self-assessment compared to direct observational testing, noting the increased ability to identify and correct mistakes. Faculty acknowledged video-recorded evaluation methods as advantageous in enhancing student self-assessment skills. However, faculty preferred direct observation testing, stating it allowed for a more thorough evaluation of skills. Additional research is needed using high-quality video equipment and longitudinal studies.</p>\",\"PeriodicalId\":52471,\"journal\":{\"name\":\"Journal of dental hygiene : JDH / American Dental Hygienists'' Association\",\"volume\":\"99 5\",\"pages\":\"29-38\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2025-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of dental hygiene : JDH / American Dental Hygienists'' Association\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"Dentistry\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of dental hygiene : JDH / American Dental Hygienists'' Association","FirstCategoryId":"1085","ListUrlMain":"","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"Dentistry","Score":null,"Total":0}
Video-Recorded Testing for Student Self-Assessment: A randomized crossover study.
Purpose Graduates of dental hygiene programs must acquire competence in critical reasoning by developing proficiency in self-assessment. The purpose of this study was to investigate the effectiveness of video-recorded testing compared to direct observation testing on student self-assessment scores, self-assessment accuracy and student retest scores, and to ascertain which modality was preferred by faculty and students.Methods A randomized crossover AB/BA research design evaluated video-recorded testing compared to traditional, direct observation testing. First year dental hygiene students (n=33) were randomly assigned to an AB or BA sequence for preclinical instrumentation skills testing and were evaluated by faculty (n=13). Student self-assessment test scores, faculty test scores, student accuracy scores, and student/faculty surveys were evaluated. Descriptive statistics and parametric independent samples t-tests (p<0.05) were used to analyze the data.Results Mean student self-assessment scores were slightly higher with video testing (93.64%) than with direct observation testing (91.98%). Retest scores were similar between the two testing modalities (video 90.74%; direct observation 93.86%). Mean student accuracy scores were nearly equal with the two modalities (video 93.24%; direct observation 93.1%). There were no statistically significant differences in student accuracy, retest, and self-assessment scores for instrumentation skills testing when comparing the modalities. A majority of students (80%) preferred video testing while all faculty members preferred the direct observation testing modality.Conclusion Students preferred video testing for self-assessment compared to direct observational testing, noting the increased ability to identify and correct mistakes. Faculty acknowledged video-recorded evaluation methods as advantageous in enhancing student self-assessment skills. However, faculty preferred direct observation testing, stating it allowed for a more thorough evaluation of skills. Additional research is needed using high-quality video equipment and longitudinal studies.
期刊介绍:
The Journal of Dental Hygiene is the refereed, scientific publication of the American Dental Hygienists’ Association. It promotes the publication of original research related to the practice and education of dental hygiene. It supports the development and dissemination of a dental hygiene body of knowledge through scientific inquiry in basic, applied, and clinical research.