Evgenia Psarra, Vassilios Krassanakis, Anastasios L Kesidis
{"title":"Systematic Performance Evaluation of WebGazer Webcam-Based Eye Tracking with Spatial and Angular Error Analysis.","authors":"Evgenia Psarra, Vassilios Krassanakis, Anastasios L Kesidis","doi":"10.3390/jemr19050099","DOIUrl":null,"url":null,"abstract":"<p><p>Eye tracking technologies have become increasingly accessible through webcam-based solutions such as WebGazer, enabling large-scale and low-cost experimentation. However, their performance remains sensitive to several experimental and device-related parameters. This study presents a controlled experimental framework developed to systematically evaluate WebGazer under configurable experimental conditions. Within this framework, we design and implement a controlled experimental protocol to investigate the effect of key parameters, including (i) joint calibration/evaluation point-density configuration, (ii) evaluation-point distribution, (iii) target presentation duration, (iv) stimulus color, and (v) stimulus (target) size. WebGazer's performance is assessed using both device-pixel spatial error metrics and angular error (delta), providing complementary measures of gaze accuracy. Results from 20 participants show that denser point configurations were associated with lower mean spatial error, from 1383 to 1009 device pixels, and lower mean angular error, from 13.556 to 10.322 degrees, within the tested conditions. Across the aggregated condition summaries, the joint point-density configuration showed the widest spatial-error range, whereas target presentation duration showed the widest angular-error range. Taken together, these two factors displayed the clearest descriptive differences, followed by evaluation-point distribution. Pseudo-random layouts were associated with moderately higher errors than fixed layouts. In contrast, visual properties such as color and size showed comparatively smaller and less consistent differences, with stimulus size displaying a non-monotonic pattern. Overall, temporal and calibration-related settings showed the clearest descriptive associations with WebGazer performance, while visual design choices showed smaller differences. This study provides a practical quantitative framework for systematically assessing webcam-based eye tracking systems under realistic usage conditions.</p>","PeriodicalId":15813,"journal":{"name":"Journal of Eye Movement Research","volume":"19 5","pages":""},"PeriodicalIF":2.2000,"publicationDate":"2026-09-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13600206/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Eye Movement Research","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.3390/jemr19050099","RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"OPHTHALMOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Eye tracking technologies have become increasingly accessible through webcam-based solutions such as WebGazer, enabling large-scale and low-cost experimentation. However, their performance remains sensitive to several experimental and device-related parameters. This study presents a controlled experimental framework developed to systematically evaluate WebGazer under configurable experimental conditions. Within this framework, we design and implement a controlled experimental protocol to investigate the effect of key parameters, including (i) joint calibration/evaluation point-density configuration, (ii) evaluation-point distribution, (iii) target presentation duration, (iv) stimulus color, and (v) stimulus (target) size. WebGazer's performance is assessed using both device-pixel spatial error metrics and angular error (delta), providing complementary measures of gaze accuracy. Results from 20 participants show that denser point configurations were associated with lower mean spatial error, from 1383 to 1009 device pixels, and lower mean angular error, from 13.556 to 10.322 degrees, within the tested conditions. Across the aggregated condition summaries, the joint point-density configuration showed the widest spatial-error range, whereas target presentation duration showed the widest angular-error range. Taken together, these two factors displayed the clearest descriptive differences, followed by evaluation-point distribution. Pseudo-random layouts were associated with moderately higher errors than fixed layouts. In contrast, visual properties such as color and size showed comparatively smaller and less consistent differences, with stimulus size displaying a non-monotonic pattern. Overall, temporal and calibration-related settings showed the clearest descriptive associations with WebGazer performance, while visual design choices showed smaller differences. This study provides a practical quantitative framework for systematically assessing webcam-based eye tracking systems under realistic usage conditions.
期刊介绍:
The Journal of Eye Movement Research is an open-access, peer-reviewed scientific periodical devoted to all aspects of oculomotor functioning including methodology of eye recording, neurophysiological and cognitive models, attention, reading, as well as applications in neurology, ergonomy, media research and other areas,