Toward Understanding Impacts of Virtual Visits on Accreditation Review Effectiveness, Quality, and Best Practices

John R. Haughery, A. M. Doggett, G. Mosher, J. Hildebrant
{"title":"Toward Understanding Impacts of Virtual Visits on Accreditation Review Effectiveness, Quality, and Best Practices","authors":"John R. Haughery, A. M. Doggett, G. Mosher, J. Hildebrant","doi":"10.31274/jtmae.14478","DOIUrl":null,"url":null,"abstract":"Accreditation standards and criteria motivate much of the efforts to continuously improve public higher education institutions in the United States. A key mechanism in this accreditation process for many agencies is an onsite physical visitation of the institution and/or program by an accreditation visiting team. This visit can provide tangible information, observation, and characterization of the institution or program under review, which informs a final accreditation decision. Due to the 2019 coronavirus disease (COVID-19) pandemic and the ensuing travel and physical distancing protocols, many accrediting agencies were required to hold traditional onsite visits virtually during the spring of 2020.Not only was this an ad hoc transition, but it was also made without full knowledge of the impact that the shift in evaluation mode would have on the effectiveness and quality of accreditation reviews against accreditation standards and criteria. Therefore, a critical need exists to evaluate the efficacy of the virtual mode of accreditation review. This study analyzed the impacts of virtual site visits on accreditation review effectiveness and quality. Using survey data collected from the Association of Technology, Management, and Applied Engineering (ATMAE)’s Board of Accreditation, from visiting team members, and from institutional contacts involved in the 2020 accreditation visits, an assessment of the effectiveness and quality of accreditation reviews was performed. Qualitatively, strong themes were found in the data set revealing the impacts of the virtual modality on accreditation review effectiveness and quality; advantages, disadvantages, and opportunities to leverage the remote modality were also discovered and are highlighted. Quantitatively, the virtual modality was overwhelmingly reported to be effective for most accreditation standards, whereas impacts on quality were more negligible. The results of this study help characterize the impacts on accreditation amid the COVID-19 pandemic, provide a picture of lessons learned from the use of this modality, and begin to lay a preliminary foundation for best practices for future virtual accreditation site visits.","PeriodicalId":130456,"journal":{"name":"The Journal of Technology, Management, and Applied Engineering","volume":"93 6 Pt 2 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-04-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"The Journal of Technology, Management, and Applied Engineering","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.31274/jtmae.14478","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Accreditation standards and criteria motivate much of the efforts to continuously improve public higher education institutions in the United States. A key mechanism in this accreditation process for many agencies is an onsite physical visitation of the institution and/or program by an accreditation visiting team. This visit can provide tangible information, observation, and characterization of the institution or program under review, which informs a final accreditation decision. Due to the 2019 coronavirus disease (COVID-19) pandemic and the ensuing travel and physical distancing protocols, many accrediting agencies were required to hold traditional onsite visits virtually during the spring of 2020.Not only was this an ad hoc transition, but it was also made without full knowledge of the impact that the shift in evaluation mode would have on the effectiveness and quality of accreditation reviews against accreditation standards and criteria. Therefore, a critical need exists to evaluate the efficacy of the virtual mode of accreditation review. This study analyzed the impacts of virtual site visits on accreditation review effectiveness and quality. Using survey data collected from the Association of Technology, Management, and Applied Engineering (ATMAE)’s Board of Accreditation, from visiting team members, and from institutional contacts involved in the 2020 accreditation visits, an assessment of the effectiveness and quality of accreditation reviews was performed. Qualitatively, strong themes were found in the data set revealing the impacts of the virtual modality on accreditation review effectiveness and quality; advantages, disadvantages, and opportunities to leverage the remote modality were also discovered and are highlighted. Quantitatively, the virtual modality was overwhelmingly reported to be effective for most accreditation standards, whereas impacts on quality were more negligible. The results of this study help characterize the impacts on accreditation amid the COVID-19 pandemic, provide a picture of lessons learned from the use of this modality, and begin to lay a preliminary foundation for best practices for future virtual accreditation site visits.
了解虚拟访问对认证审查有效性、质量和最佳实践的影响
认证标准和标准激励了美国公立高等教育机构不断改进的努力。对许多机构来说,这个认证过程中的一个关键机制是由认证访问小组对机构和/或项目进行现场实际访问。这次访问可以提供具体的信息,观察,并在审查机构或项目的特点,这为最终的认证决定提供信息。由于2019年冠状病毒病(COVID-19)大流行以及随之而来的旅行和保持身体距离协议,许多认证机构被要求在2020年春季进行传统的现场访问。这不仅是一种临时过渡,而且在进行这种过渡时也没有充分认识到评价方式的转变将对按照认可标准和准则进行的认可审查的效力和质量产生的影响。因此,迫切需要评估虚拟认证审查模式的有效性。本研究分析了虚拟实地考察对评审有效性和质量的影响。利用从美国技术、管理和应用工程协会(ATMAE)认证委员会、访问团队成员以及参与2020年认证访问的机构联系人收集的调查数据,对认证审查的有效性和质量进行了评估。在定性方面,数据集中发现了强有力的主题,揭示了虚拟模式对认证审查有效性和质量的影响;还发现并强调了利用远程模式的优点、缺点和机会。从数量上讲,绝大多数报告称虚拟模式对大多数认证标准有效,而对质量的影响则可以忽略不计。本研究的结果有助于描述COVID-19大流行对认证的影响,提供了从使用这种模式中吸取的经验教训,并开始为未来虚拟认证现场访问的最佳实践奠定初步基础。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信