Virtual reality interview with feedback framework for situational practice of gaze among autistic adults

IF 2.2 4区医学 Q1 EDUCATION, SPECIAL

Research in Autism Spectrum Disorders Pub Date : 2024-10-01 DOI:10.1016/j.rasd.2024.102494

Saygin Artiran , Shana Cohen , Pamela Cosman

{"title":"Virtual reality interview with feedback framework for situational practice of gaze among autistic adults","authors":"Saygin Artiran , Shana Cohen , Pamela Cosman","doi":"10.1016/j.rasd.2024.102494","DOIUrl":null,"url":null,"abstract":"<div><h3>Background</h3><div>Autistic individuals commonly seek employment; however, only a small fraction are in the workforce. In part, this might be due to mismatches between their social patterns of attention and gaze, and society’s normative expectations during interviews.</div></div><div><h3>Method</h3><div>To help mitigate such disadvantages through a solo situational practice tool, we present a framework that consists of a virtual reality (VR) based job interview simulation and a coaching component. Employing data visualization, video modeling, and VR role-play of the targeted behavior, the coaching support could be done in a self-deliverable practice manner. A participatory design session with two autistic design partners was important in the co-creation of the feedback methods, making them easier to understand, and including positive reinforcement.</div></div><div><h3>Results</h3><div>Fourteen autistic individuals used the VR job interview simulation tool. Eleven received the gaze analysis and support stage and participated in a second VR simulation session. Preliminary results were positive, in that participant scores on average eye contact duration, average time without eye contact, and percentage of eye contact while listening and while speaking generally approached the corresponding medians of the non-autistic reference dataset. Participants were surveyed about the utility of the tool after the second feedback session and two months later. All survey respondents perceived the tool to be useful and the provided feedback to be helpful in daily social interactions.</div></div><div><h3>Conclusions</h3><div>This study provides insights towards the development of a VR job interview simulation and feedback framework that can enable solo situational practice of gaze and common interview questions.</div></div>","PeriodicalId":48255,"journal":{"name":"Research in Autism Spectrum Disorders","volume":"118 ","pages":"Article 102494"},"PeriodicalIF":2.2000,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Research in Autism Spectrum Disorders","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1750946724001697","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION, SPECIAL","Score":null,"Total":0}

引用次数: 0

Abstract

Background

Autistic individuals commonly seek employment; however, only a small fraction are in the workforce. In part, this might be due to mismatches between their social patterns of attention and gaze, and society’s normative expectations during interviews.

Method

To help mitigate such disadvantages through a solo situational practice tool, we present a framework that consists of a virtual reality (VR) based job interview simulation and a coaching component. Employing data visualization, video modeling, and VR role-play of the targeted behavior, the coaching support could be done in a self-deliverable practice manner. A participatory design session with two autistic design partners was important in the co-creation of the feedback methods, making them easier to understand, and including positive reinforcement.

Results

Fourteen autistic individuals used the VR job interview simulation tool. Eleven received the gaze analysis and support stage and participated in a second VR simulation session. Preliminary results were positive, in that participant scores on average eye contact duration, average time without eye contact, and percentage of eye contact while listening and while speaking generally approached the corresponding medians of the non-autistic reference dataset. Participants were surveyed about the utility of the tool after the second feedback session and two months later. All survey respondents perceived the tool to be useful and the provided feedback to be helpful in daily social interactions.

Conclusions

This study provides insights towards the development of a VR job interview simulation and feedback framework that can enable solo situational practice of gaze and common interview questions.

查看原文本刊更多论文

虚拟现实访谈与反馈框架，用于自闭症成人的凝视情景练习

背景自闭症患者通常会求职，但只有一小部分人进入了劳动力市场。方法为了通过一个单独的情景练习工具来帮助减轻这种不利因素，我们提出了一个由基于虚拟现实（VR）的求职面试模拟和辅导部分组成的框架。通过数据可视化、视频建模和目标行为的 VR 角色扮演，辅导支持可以通过可自我交付的练习方式完成。与两名自闭症设计伙伴进行的参与式设计会议对于共同创造反馈方法、使其更易于理解并包括积极的强化措施非常重要。其中 11 人接受了凝视分析和支持阶段，并参加了第二次 VR 模拟课程。初步结果是积极的，因为参与者在平均目光接触持续时间、平均无目光接触时间、倾听时和发言时目光接触的百分比等方面的得分普遍接近非自闭症参考数据集的相应中值。在第二次反馈会后和两个月后，我们对参与者进行了有关该工具实用性的调查。所有接受调查的人都认为该工具很有用，所提供的反馈对日常社交互动很有帮助。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Research in Autism Spectrum Disorders Multiple-

CiteScore

4.20

自引率

8.00%

发文量

108

期刊介绍： Research in Autism Spectrum Disorders (RASD) publishes high quality empirical articles and reviews that contribute to a better understanding of Autism Spectrum Disorders (ASD) at all levels of description; genetic, neurobiological, cognitive, and behavioral. The primary focus of the journal is to bridge the gap between basic research at these levels, and the practical questions and difficulties that are faced by individuals with ASD and their families, as well as carers, educators and clinicians. In addition, the journal encourages submissions on topics that remain under-researched in the field. We know shamefully little about the causes and consequences of the significant language and general intellectual impairments that characterize half of all individuals with ASD. We know even less about the challenges that women with ASD face and less still about the needs of individuals with ASD as they grow older. Medical and psychological co-morbidities and the complications they bring with them for the diagnosis and treatment of ASD represents another area of relatively little research. At RASD we are committed to promoting high-quality and rigorous research on all of these issues, and we look forward to receiving many excellent submissions.