The Voice Experience Inventory (VOXI): Validating a consensus-driven instrument for measuring user impressions of computer voice

IF 5.1 2区计算机科学 Q1 COMPUTER SCIENCE, CYBERNETICS

International Journal of Human-Computer Studies Pub Date : 2025-07-16 DOI:10.1016/j.ijhcs.2025.103576

Katie Seaborn , Maximilian Altmeyer , Ge “Rikaku” Li , Bonhee Ku , Sota Kobuki , Jacqueline Urakami

{"title":"The Voice Experience Inventory (VOXI): Validating a consensus-driven instrument for measuring user impressions of computer voice","authors":"Katie Seaborn , Maximilian Altmeyer , Ge “Rikaku” Li , Bonhee Ku , Sota Kobuki , Jacqueline Urakami","doi":"10.1016/j.ijhcs.2025.103576","DOIUrl":null,"url":null,"abstract":"<div><div>Voice interaction has entered daily life. Yet, the measurement of voice user experience (voice UX) remains underdeveloped. We took a consensus-based approach to the creation of a new instrument grounded in the work of voice UX researchers. For this, we conducted a systemic review of the literature from ACM, IEEE, and Web of Science (<span><math><mrow><mi>N</mi><mo>=</mo><mn>49</mn></mrow></math></span>) to gather a corpus of instruments, measures, and methodological perspectives. We then carried out two validation studies on a range of computer voices, showing through exploratory (<span><math><mrow><mi>N</mi><mo>=</mo><mn>100</mn></mrow></math></span>) and confirmatory factor analyses (<span><math><mrow><mi>N</mi><mo>=</mo><mn>150</mn></mrow></math></span>) that five underlying factors unify the consensus-derived measures. We offer the 24-item Voice Experience Inventory (VOXI) alongside three comprehensive frameworks on key independent and dependent variables and their relationships, anchored to the material that guided our instrument development process. This work represents a timely and community-centred path towards rigorous and standardized measurement of voice UX.</div></div>","PeriodicalId":54955,"journal":{"name":"International Journal of Human-Computer Studies","volume":"203 ","pages":"Article 103576"},"PeriodicalIF":5.1000,"publicationDate":"2025-07-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Human-Computer Studies","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1071581925001338","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, CYBERNETICS","Score":null,"Total":0}

引用次数: 0

Abstract

Voice interaction has entered daily life. Yet, the measurement of voice user experience (voice UX) remains underdeveloped. We took a consensus-based approach to the creation of a new instrument grounded in the work of voice UX researchers. For this, we conducted a systemic review of the literature from ACM, IEEE, and Web of Science (

N = 49

) to gather a corpus of instruments, measures, and methodological perspectives. We then carried out two validation studies on a range of computer voices, showing through exploratory (

N = 100

) and confirmatory factor analyses (

N = 150

) that five underlying factors unify the consensus-derived measures. We offer the 24-item Voice Experience Inventory (VOXI) alongside three comprehensive frameworks on key independent and dependent variables and their relationships, anchored to the material that guided our instrument development process. This work represents a timely and community-centred path towards rigorous and standardized measurement of voice UX.

查看原文本刊更多论文

语音体验清单（VOXI）：验证一个共识驱动的工具，用于测量用户对计算机语音的印象

语音交互已经进入日常生活。然而，语音用户体验（voice UX）的测量仍然不发达。我们采用基于共识的方法来创建一种基于语音用户体验研究人员工作的新工具。为此，我们对来自ACM、IEEE和Web of Science （N=49）的文献进行了系统回顾，以收集工具、测量和方法学观点的语料库。然后，我们对一系列计算机语音进行了两项验证性研究，通过探索性（N=100）和验证性因素分析（N=150）显示，五个潜在因素统一了共识衍生的度量。我们提供24项语音体验清单（VOXI）以及三个关于关键自变量和因变量及其关系的综合框架，锚定在指导我们仪器开发过程的材料上。这项工作代表了一条及时的、以社区为中心的道路，通向严格和标准化的语音用户体验测量。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

International Journal of Human-Computer Studies 工程技术-计算机：控制论

CiteScore

11.50

自引率

5.60%

发文量

108

审稿时长

3 months

期刊介绍： The International Journal of Human-Computer Studies publishes original research over the whole spectrum of work relevant to the theory and practice of innovative interactive systems. The journal is inherently interdisciplinary, covering research in computing, artificial intelligence, psychology, linguistics, communication, design, engineering, and social organization, which is relevant to the design, analysis, evaluation and application of innovative interactive systems. Papers at the boundaries of these disciplines are especially welcome, as it is our view that interdisciplinary approaches are needed for producing theoretical insights in this complex area and for effective deployment of innovative technologies in concrete user communities. Research areas relevant to the journal include, but are not limited to: • Innovative interaction techniques • Multimodal interaction • Speech interaction • Graphic interaction • Natural language interaction • Interaction in mobile and embedded systems • Interface design and evaluation methodologies • Design and evaluation of innovative interactive systems • User interface prototyping and management systems • Ubiquitous computing • Wearable computers • Pervasive computing • Affective computing • Empirical studies of user behaviour • Empirical studies of programming and software engineering • Computer supported cooperative work • Computer mediated communication • Virtual reality • Mixed and augmented Reality • Intelligent user interfaces • Presence ...