Eye-Mind reader: an intelligent reading interface that promotes long-term comprehension by detecting and responding to mind wandering

IF 4.5 2区工程技术 Q1 COMPUTER SCIENCE, CYBERNETICS

Human-Computer Interaction Pub Date : 2021-07-04 DOI:10.1080/07370024.2020.1716762

Caitlin Mills, Julie M. Gregg, R. Bixler, S. D’Mello

{"title":"Eye-Mind reader: an intelligent reading interface that promotes long-term comprehension by detecting and responding to mind wandering","authors":"Caitlin Mills, Julie M. Gregg, R. Bixler, S. D’Mello","doi":"10.1080/07370024.2020.1716762","DOIUrl":null,"url":null,"abstract":"ABSTRACT We zone out roughly 20-40% of the time during reading – a rate that is concerning given the negative relationship between mind-wandering and comprehension. We tested if Eye-Mind Reader – an intelligent interface that targeted mind-wandering as it occurred – could mitigate its negative impact on reading comprehension. When an eye-gaze-based classifier indicated that a reader was mind-wandering, those in a MW-Intervention condition were asked to self-explain the concept they were reading about. If the self-explanation quality was deemed subpar by an automated scoring mechanism, readers were asked to re-read parts of the text in order to correct their comprehension deficits and improve their self-explanation. Each participant in the MW-Intervention condition was paired with a Yoked-Control counterpart who received the exact same interventions regardless of whether they were mind-wandering. Results indicate that re-reading improved self-explanation quality for the MW-Intervention group, but not the control group. The two conditions performed equally well on textbase (i.e. fact-based) and inference-level comprehension questions immediately after reading. However, after a week-long delay, the MW-Intervention condition significantly outperformed the yoked-control condition on both comprehension assessments (ds = .352 and .307). Our findings suggest that real-time interventions during critical periods of mind-wandering can promote long-term retention and comprehension.","PeriodicalId":56306,"journal":{"name":"Human-Computer Interaction","volume":"51 1","pages":"306 - 332"},"PeriodicalIF":4.5000,"publicationDate":"2021-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"35","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Human-Computer Interaction","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1080/07370024.2020.1716762","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, CYBERNETICS","Score":null,"Total":0}

引用次数: 35

Abstract

ABSTRACT We zone out roughly 20-40% of the time during reading – a rate that is concerning given the negative relationship between mind-wandering and comprehension. We tested if Eye-Mind Reader – an intelligent interface that targeted mind-wandering as it occurred – could mitigate its negative impact on reading comprehension. When an eye-gaze-based classifier indicated that a reader was mind-wandering, those in a MW-Intervention condition were asked to self-explain the concept they were reading about. If the self-explanation quality was deemed subpar by an automated scoring mechanism, readers were asked to re-read parts of the text in order to correct their comprehension deficits and improve their self-explanation. Each participant in the MW-Intervention condition was paired with a Yoked-Control counterpart who received the exact same interventions regardless of whether they were mind-wandering. Results indicate that re-reading improved self-explanation quality for the MW-Intervention group, but not the control group. The two conditions performed equally well on textbase (i.e. fact-based) and inference-level comprehension questions immediately after reading. However, after a week-long delay, the MW-Intervention condition significantly outperformed the yoked-control condition on both comprehension assessments (ds = .352 and .307). Our findings suggest that real-time interventions during critical periods of mind-wandering can promote long-term retention and comprehension.

查看原文本刊更多论文

眼心阅读器:一种智能阅读界面，通过检测和响应走神来促进长期理解

我们在阅读过程中大约有20-40%的时间是走神的——考虑到走神与理解能力之间的负相关关系，这一比例令人担忧。我们测试了眼心术阅读器——一种智能界面，可以在走神发生时针对走神——是否能减轻其对阅读理解的负面影响。当基于眼睛注视的分类器显示读者在走神时，那些在mw干预条件下的人被要求自我解释他们正在阅读的概念。如果自动评分机制认为自我解释的质量低于标准，读者被要求重读部分文本，以纠正他们的理解缺陷，提高他们的自我解释能力。每一个mw干预组的参与者都与一个轭控组的参与者配对，不管他们是否走神，他们都接受了完全相同的干预。结果表明，重读提高了mw干预组的自我解释质量，而对照组没有。这两种情况在文本基础(即基于事实的)和阅读后立即推理级理解问题上的表现一样好。然而，在一周的延迟后，mw -干预条件在两项理解评估上都显著优于联合对照条件(ds = 0.352和0.307)。我们的研究结果表明，在走神的关键时期进行实时干预可以促进长期记忆和理解。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Human-Computer Interaction 工程技术-计算机：控制论

CiteScore

12.20

自引率

3.80%

发文量

审稿时长

>12 weeks

期刊介绍： Human-Computer Interaction (HCI) is a multidisciplinary journal defining and reporting on fundamental research in human-computer interaction. The goal of HCI is to be a journal of the highest quality that combines the best research and design work to extend our understanding of human-computer interaction. The target audience is the research community with an interest in both the scientific implications and practical relevance of how interactive computer systems should be designed and how they are actually used. HCI is concerned with the theoretical, empirical, and methodological issues of interaction science and system design as it affects the user.