User Experience of Alexa when controlling music: comparison of face and construct validity of four questionnaires

Proceedings of the 2nd Conference on Conversational User Interfaces Pub Date : 2020-07-13 DOI:10.1145/3405755.3406122

Birgit Brüggemeier, Michael Breiter, Miriam Kurz, Johanna Schiwy

{"title":"User Experience of Alexa when controlling music: comparison of face and construct validity of four questionnaires","authors":"Birgit Brüggemeier, Michael Breiter, Miriam Kurz, Johanna Schiwy","doi":"10.1145/3405755.3406122","DOIUrl":null,"url":null,"abstract":"We evaluate the user experience (UX) of Amazon's Alexa when users play and control music. For measuring UX we use established UX metrics (SASSI, SUISQ-R, SUS, AttrakDiff). We investigated face validity by asking users to rate how well they think a questionnaire measures what it is supposed to measure and we assessed construct validity by correlating UX scores of questionnaires with each other. We find a mismatch between face and construct validity of the evaluated questionnaires. Specifically, users feel that SASSI represents their experience better than other questionnaires, however this is not supported by correlations between questionnaires, which suggest that all investigated questionnaires measure UX to a similar extent. Importantly, the fact that face validity and construct validity diverge is not surprising as this has been observed before. Our work adds to existing literature by providing face and construct validity scores of UX questionnaires for interactions with the common speech assistant Alexa.","PeriodicalId":380130,"journal":{"name":"Proceedings of the 2nd Conference on Conversational User Interfaces","volume":"34 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-07-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"10","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 2nd Conference on Conversational User Interfaces","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3405755.3406122","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 10

Abstract

We evaluate the user experience (UX) of Amazon's Alexa when users play and control music. For measuring UX we use established UX metrics (SASSI, SUISQ-R, SUS, AttrakDiff). We investigated face validity by asking users to rate how well they think a questionnaire measures what it is supposed to measure and we assessed construct validity by correlating UX scores of questionnaires with each other. We find a mismatch between face and construct validity of the evaluated questionnaires. Specifically, users feel that SASSI represents their experience better than other questionnaires, however this is not supported by correlations between questionnaires, which suggest that all investigated questionnaires measure UX to a similar extent. Importantly, the fact that face validity and construct validity diverge is not surprising as this has been observed before. Our work adds to existing literature by providing face and construct validity scores of UX questionnaires for interactions with the common speech assistant Alexa.

查看原文本刊更多论文

Alexa在控制音乐时的用户体验:四份问卷的面孔与结构效度比较

我们评估了亚马逊Alexa在用户播放和控制音乐时的用户体验(UX)。为了测量用户体验，我们使用既定的用户体验指标(SASSI, SUISQ-R, SUS, AttrakDiff)。我们通过让用户评价他们认为问卷测量了它应该测量的内容的程度来调查脸效度，我们通过将问卷的用户体验分数相互关联来评估结构效度。我们发现被评估问卷的面孔效度与构念效度不匹配。具体来说，用户觉得SASSI比其他问卷更能代表他们的体验，然而，这并没有得到问卷之间相关性的支持，这表明所有调查的问卷都以相似的程度衡量用户体验。重要的是，面孔效度和构念效度的差异并不令人惊讶，因为这在之前已经被观察到。我们的工作通过提供与常见语音助手Alexa交互的用户体验问卷的面部和构造有效性分数来增加现有文献。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Proceedings of the 2nd Conference on Conversational User Interfaces

自引率

0.00%

发文量