Filippo Baldisserotto, Krzysztof Krejtz, I. Krejtz
{"title":"A Review of Eye Tracking in Advanced Driver Assistance Systems: An Adaptive Multi-Modal Eye Tracking Interface Solution","authors":"Filippo Baldisserotto, Krzysztof Krejtz, I. Krejtz","doi":"10.1145/3588015.3589512","DOIUrl":"https://doi.org/10.1145/3588015.3589512","url":null,"abstract":"Advanced driving assistance systems are a useful technology that helps improve driving safety. These systems provide the driver with multi-modal information about the driving performance, however, the interaction between the driver and these interfaces is complex and requires the systems to adapt to the requests of the driving task. The proposed solution address this challenge, presenting an overview of the literature on the subject, with the objective of proposing an adaptive multi-modal interface based on eye tracking monitoring.","PeriodicalId":263409,"journal":{"name":"Proceedings of the 2023 Symposium on Eye Tracking Research and Applications","volume":"186 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124722667","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Erwan J. David, Jesús Gutiérrez, M. Võ, A. Coutrot, Matthieu Perreira da Silva, P. Le Callet
{"title":"The Salient360! Toolbox: Processing, Visualising and Comparing Gaze Data in 3D","authors":"Erwan J. David, Jesús Gutiérrez, M. Võ, A. Coutrot, Matthieu Perreira da Silva, P. Le Callet","doi":"10.1145/3588015.3588406","DOIUrl":"https://doi.org/10.1145/3588015.3588406","url":null,"abstract":"Eye tracking can serve as a gateway to studying the mind. For this reason it has been adopted by a diverse range of scientific communities. With the improvement of the quality of head-mounted virtual reality devices (HMDs) over the past 10 years, eye tracking has been added to capture gaze in immersive environments. The use of HMDs with eye tracking is increasing significantly and so is the need for a toolbox enabling consensus about eye tracking methods in 3D. We present the Salient360! toolbox: it implements functions to identify saccades and fixations and output gaze characteristics (e.g., fixation duration or saccade directions), to generate saliency maps, fixation maps, and scanpath data. It also implements routines made to compare gaze data that were adapted to 3D. We hope that this toolbox will spark discussions about the methodology of 3D gaze processing, facilitate running experiments, and improve the gaze study in 3D. https://github.com/David-Ef/salient360Toolbox","PeriodicalId":263409,"journal":{"name":"Proceedings of the 2023 Symposium on Eye Tracking Research and Applications","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124936943","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Foveated Noise Reduction: Visual Search Tasks under Spatio-Temporal Control Synchronized with Eye Movements","authors":"Yuki Kubota, T. Hayakawa, Masatoshi Ishikawa","doi":"10.1145/3588015.3590119","DOIUrl":"https://doi.org/10.1145/3588015.3590119","url":null,"abstract":"The authors propose a spatiotemporal noise reduction system called Foveated Noise Reduction. This system reduces ambient motion noise synchronized with eye movements and spatiotemporal blurring in peripheral vision. Preliminary experiments were conducted with the visual search task in ambient motion noise. The authors evaluated task performance when varying spatiotemporal blurring parameters. The results suggest that the spatial reduction affected the task performance, and the blur size would be suitable under the visual search task with ambient noise.","PeriodicalId":263409,"journal":{"name":"Proceedings of the 2023 Symposium on Eye Tracking Research and Applications","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128833046","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The effect of intersemiotic relations on L2 learners’ multimodal reading","authors":"Sheida Marzban, Gyöngyi Fábián, B. Weiss","doi":"10.1145/3588015.3589196","DOIUrl":"https://doi.org/10.1145/3588015.3589196","url":null,"abstract":"The paper adopts a mixed-method approach (online and eye-tracking experiments) to investigate which image-text relation in multimodal texts, namely image-subordinate-to-text (IST) and text-subordinate-to-image (TSI), creates a strong visual or verbal mental representation in the case of second language (L2) learners. Thirty-eight Hungarian L2 learners with B1 English language proficiency attended the online experiment to read and respond to the multimodal texts with IST and TSI relations. Furthermore, during the eye-tracking experiment, second language learners’ (N=9) gaze patterns were examined while reading IST and TSI multimodal texts. The initial study results reveal that while the semantic gap between the image and text encourages more intermodal interactions and longer eye fixations, redundancy, involving the duplication of information via image and text, also develops a strong mental model of the meaning. The present research may contribute to the development of a more comprehensive model of L2 multimodal and multimedia learning.","PeriodicalId":263409,"journal":{"name":"Proceedings of the 2023 Symposium on Eye Tracking Research and Applications","volume":"10 12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117327395","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ruoyan Kong, Ruixuan Sun, Charles Chuankai Zhang, Chen Chen, Sneha Patri, Gayathri Gajjela, J. Konstan
{"title":"Getting the Most from Eye-Tracking: User-Interaction Based Reading Region Estimation Dataset and Models","authors":"Ruoyan Kong, Ruixuan Sun, Charles Chuankai Zhang, Chen Chen, Sneha Patri, Gayathri Gajjela, J. Konstan","doi":"10.1145/3588015.3588404","DOIUrl":"https://doi.org/10.1145/3588015.3588404","url":null,"abstract":"A single digital newsletter usually contains many messages (regions). Users’ reading time spent on, and read level (skip/skim/read-in-detail) of each message is important for platforms to understand their users’ interests, personalize their contents, and make recommendations. Based on accurate but expensive-to-collect eyetracker-recorded data, we built models that predict per-region reading time based on easy-to-collect Javascript browser tracking data. With eye-tracking, we collected 200k ground-truth datapoints on participants reading news on browsers. Then we trained machine learning and deep learning models to predict message-level reading time based on user interactions like mouse position, scrolling, and clicking. We reached 27% percentage error in reading time estimation with a two-tower neural network based on user interactions only, against the eye-tracking ground truth data, while the heuristic baselines have around 46% percentage error. We also discovered the benefits of replacing per-session models with per-timestamp models, and adding user pattern features. We concluded with suggestions on developing message-level reading estimation techniques based on available data.","PeriodicalId":263409,"journal":{"name":"Proceedings of the 2023 Symposium on Eye Tracking Research and Applications","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132496700","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Modelling Attention Levels with Ocular Responses in a Speech-in-Noise Recall Task","authors":"Mateusz Dubiel, M. Nakayama, Xin Wang","doi":"10.1145/3588015.3589665","DOIUrl":"https://doi.org/10.1145/3588015.3589665","url":null,"abstract":"We applied state-space modelling technique to estimate the cognitive workload of a speech-in-noise (SIN) recall task, based on participants’ oculo-motor responses to speech signals. We estimated common latent attention levels in 15 time bins and observed temporal changes between pupillary dilations and saccade frequencies, given that the both conditions were independent. We also compared two speech type factors (natural vs. synthetic) and three levels of signal-to-noise (-1dB, -3dB, and -5dB) using the estimated parameter distribution. The comparison of experimental factors provided us with insights into differences in participants’ processing of spoken information during a SIN recall task.","PeriodicalId":263409,"journal":{"name":"Proceedings of the 2023 Symposium on Eye Tracking Research and Applications","volume":"40 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123749764","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The influence of pupil ellipse noise on the convergence time of a glint-free 3D eye tracking algorithm","authors":"Michael Mm Muehlbauer, Johannes Meyer","doi":"10.1145/3588015.3590111","DOIUrl":"https://doi.org/10.1145/3588015.3590111","url":null,"abstract":"Eye-tracking is a key sensing technology for upcoming retinal projection augmented reality (AR) glasses. State-of-the-art eye-tracking sensor technologies rely on video oculography (VOG) and 3D model based gaze estimation algorithms, which infer gaze from observations of the projected pupil over time. The convergence time of these algorithms relies heavily on the pupil ellipse fitting accuracy. In this work, we investigate the effects of pupil ellipse contour noise and pupil center noise on the convergence time of a state-of-the-art eye-tracking approach and show that the convergence time relies heavily on a sub-pixel accurate pupil ellipse fitting and can reach tens of seconds for inaccurately fitted ellipses.","PeriodicalId":263409,"journal":{"name":"Proceedings of the 2023 Symposium on Eye Tracking Research and Applications","volume":"67 2","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114114060","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Collaboration Assistance Through Object Based User Intent Detection Using Gaze Data","authors":"Li-Chen Fu, Robin Fischer","doi":"10.1145/3588015.3590130","DOIUrl":"https://doi.org/10.1145/3588015.3590130","url":null,"abstract":"As eye-tracking technology becomes increasingly prevalent in augmented reality (AR), new opportunities arise for collaborative applications. In this paper, we propose a novel approach to improve collaborative interaction through object-based user intent detection using gaze data. Our system uses reinforcement learning (RL) to dynamically adapt the user interface based on the context of the collaborative task. The system visualizes the user’s intent on a shared environment, allowing for improved collaborative awareness between users. We evaluate our approach in a user study scenario focused on visual search tasks. The results demonstrate that our system significantly improves task completion times and reduces cognitive load for users. Additionally, subjective feedback suggests that users are more aware of each other’s activity, further highlighting the benefits of our approach. We encourage conducting future user studies to assess the suitability of our approach for additional collaborative tasks.","PeriodicalId":263409,"journal":{"name":"Proceedings of the 2023 Symposium on Eye Tracking Research and Applications","volume":"64 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117336850","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"ZING: An Eye-Tracking Experiment Software for Organization and Presentation of Omnidirectional Stimuli in Virtual Reality","authors":"Benedikt W. Hosp, S. Wahl","doi":"10.1145/3588015.3589201","DOIUrl":"https://doi.org/10.1145/3588015.3589201","url":null,"abstract":"The growing field of eye-tracking enables many researchers to investigate human (subconscious) behavior unobtrusively, naturally, and non-invasive. For that, a highly natural, immersive, and controllable environment is essential to investigators. Currently, next to mobile eye-tracking in the wild, virtual reality is becoming state-of-the-art for such experiments, combining several eye-tracking modalities’ strengths. Next to simulations, omnidirectional video footage is massively used. 360°cameras capture these videos with resolutions of up to 16k. Afterward, they can be replayed on virtual reality glasses to learn about human behavior in a realistic, highly controlled environment. However, the pipeline from stitched video to eye-tracking experiment results depends on costly proprietary or self-developed software that lacks standardization, leading to recurrent reimplementation. This paper describes an open-source stimuli organization and presentation software implementation that enables researchers to easily organize their stimuli in a standardized way and conduct eye-tracking studies in virtual reality with a few clicks without knowledge about coding or technical details. The code is available at https://bitbucket.org/benediktwhosp/zing","PeriodicalId":263409,"journal":{"name":"Proceedings of the 2023 Symposium on Eye Tracking Research and Applications","volume":"62 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114999955","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Representing (Dis)Similarities Between Prediction and Fixation Maps Using Intersection-over-Union Features","authors":"Jaime Maldonado, C. Zetzsche","doi":"10.1145/3588015.3589843","DOIUrl":"https://doi.org/10.1145/3588015.3589843","url":null,"abstract":"A classic evaluation of the quality of gaze prediction models consists in comparing a set of ground truth fixation maps against a set of predictions. The quality of the prediction depends on the spatial similarity between the predicted and the observed fixated and non-fixated areas. Typically, (dis)similarity is evaluated by computing distribution-based metrics. However, the shortcoming of the metric scores is that they provide no information about the different types of (dis)similarities present in the prediction, for example, to determine whether the prediction fails wholly or partially to account for all the fixations. In this paper, we propose a set of features for representing the spatial (dis)similarities using intersection-over-union features, which provide helpful information that cannot be retrieved with traditional metrics for analyzing and evaluating prediction maps. We exemplify the usage of the features by analyzing the performance of different prediction models on a saliency benchmark dataset.","PeriodicalId":263409,"journal":{"name":"Proceedings of the 2023 Symposium on Eye Tracking Research and Applications","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129837207","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}