Systematic Performance Evaluation of WebGazer Webcam-Based Eye Tracking with Spatial and Angular Error Analysis.

IF 2.2 4区 心理学 Q3 OPHTHALMOLOGY
Evgenia Psarra, Vassilios Krassanakis, Anastasios L Kesidis
{"title":"Systematic Performance Evaluation of WebGazer Webcam-Based Eye Tracking with Spatial and Angular Error Analysis.","authors":"Evgenia Psarra, Vassilios Krassanakis, Anastasios L Kesidis","doi":"10.3390/jemr19050099","DOIUrl":null,"url":null,"abstract":"<p><p>Eye tracking technologies have become increasingly accessible through webcam-based solutions such as WebGazer, enabling large-scale and low-cost experimentation. However, their performance remains sensitive to several experimental and device-related parameters. This study presents a controlled experimental framework developed to systematically evaluate WebGazer under configurable experimental conditions. Within this framework, we design and implement a controlled experimental protocol to investigate the effect of key parameters, including (i) joint calibration/evaluation point-density configuration, (ii) evaluation-point distribution, (iii) target presentation duration, (iv) stimulus color, and (v) stimulus (target) size. WebGazer's performance is assessed using both device-pixel spatial error metrics and angular error (delta), providing complementary measures of gaze accuracy. Results from 20 participants show that denser point configurations were associated with lower mean spatial error, from 1383 to 1009 device pixels, and lower mean angular error, from 13.556 to 10.322 degrees, within the tested conditions. Across the aggregated condition summaries, the joint point-density configuration showed the widest spatial-error range, whereas target presentation duration showed the widest angular-error range. Taken together, these two factors displayed the clearest descriptive differences, followed by evaluation-point distribution. Pseudo-random layouts were associated with moderately higher errors than fixed layouts. In contrast, visual properties such as color and size showed comparatively smaller and less consistent differences, with stimulus size displaying a non-monotonic pattern. Overall, temporal and calibration-related settings showed the clearest descriptive associations with WebGazer performance, while visual design choices showed smaller differences. This study provides a practical quantitative framework for systematically assessing webcam-based eye tracking systems under realistic usage conditions.</p>","PeriodicalId":15813,"journal":{"name":"Journal of Eye Movement Research","volume":"19 5","pages":""},"PeriodicalIF":2.2000,"publicationDate":"2026-09-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13600206/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Eye Movement Research","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.3390/jemr19050099","RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"OPHTHALMOLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

Eye tracking technologies have become increasingly accessible through webcam-based solutions such as WebGazer, enabling large-scale and low-cost experimentation. However, their performance remains sensitive to several experimental and device-related parameters. This study presents a controlled experimental framework developed to systematically evaluate WebGazer under configurable experimental conditions. Within this framework, we design and implement a controlled experimental protocol to investigate the effect of key parameters, including (i) joint calibration/evaluation point-density configuration, (ii) evaluation-point distribution, (iii) target presentation duration, (iv) stimulus color, and (v) stimulus (target) size. WebGazer's performance is assessed using both device-pixel spatial error metrics and angular error (delta), providing complementary measures of gaze accuracy. Results from 20 participants show that denser point configurations were associated with lower mean spatial error, from 1383 to 1009 device pixels, and lower mean angular error, from 13.556 to 10.322 degrees, within the tested conditions. Across the aggregated condition summaries, the joint point-density configuration showed the widest spatial-error range, whereas target presentation duration showed the widest angular-error range. Taken together, these two factors displayed the clearest descriptive differences, followed by evaluation-point distribution. Pseudo-random layouts were associated with moderately higher errors than fixed layouts. In contrast, visual properties such as color and size showed comparatively smaller and less consistent differences, with stimulus size displaying a non-monotonic pattern. Overall, temporal and calibration-related settings showed the clearest descriptive associations with WebGazer performance, while visual design choices showed smaller differences. This study provides a practical quantitative framework for systematically assessing webcam-based eye tracking systems under realistic usage conditions.

基于空间和角度误差分析的WebGazer网络摄像头眼动追踪系统性能评价。
通过WebGazer等基于网络摄像头的解决方案,眼动追踪技术变得越来越容易获得,从而实现了大规模和低成本的实验。然而,它们的性能对几个实验和设备相关参数仍然敏感。本研究提出了一个受控的实验框架,用于在可配置的实验条件下系统地评估WebGazer。在此框架内,我们设计并实施了一个受控实验方案,以研究关键参数的影响,包括(i)联合校准/评估点密度配置,(ii)评估点分布,(iii)目标呈现时间,(iv)刺激颜色和(v)刺激(目标)大小。WebGazer的性能是使用设备像素空间误差度量和角度误差(delta)来评估的,它们提供了凝视精度的补充度量。来自20个参与者的结果表明,在测试条件下,更密集的点配置与更低的平均空间误差(从1383到1009个设备像素)和更低的平均角度误差(从13.556到10.322度)相关。在综合条件总结中,关节点密度配置的空间误差范围最大,而目标呈现持续时间的角度误差范围最大。综上所述,这两个因素表现出最明显的描述性差异,其次是评价点分布。伪随机布局比固定布局的错误率要高一些。相比之下,颜色和大小等视觉属性的差异相对较小且不太一致,刺激大小呈现非单调模式。总的来说,时间和校准相关的设置显示出与WebGazer性能最清晰的描述性关联,而视觉设计选择显示出较小的差异。本研究为在实际使用条件下系统评估基于网络摄像头的眼动追踪系统提供了一个实用的定量框架。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
2.90
自引率
33.30%
发文量
10
审稿时长
10 weeks
期刊介绍: The Journal of Eye Movement Research is an open-access, peer-reviewed scientific periodical devoted to all aspects of oculomotor functioning including methodology of eye recording, neurophysiological and cognitive models, attention, reading, as well as applications in neurology, ergonomy, media research and other areas,
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书