{"title":"The analysis of frequency domain characteristics of emotional images in eye-tracking experiment","authors":"Boqiang Fan, Huimin Ma, Xiang Wang","doi":"10.1117/12.2196909","DOIUrl":null,"url":null,"abstract":"Although recently eye-tracking method has been introduced into behavioral experiments based on dot-probe paradigm, some characteristics in eye-tracking data do not draw as much attention as traditional characteristics like reaction time. It is also necessary to associate eye-tracking data to characteristics of images shown in experiments. In this research, new variables, such as fixation length, times of fixation and times of eye movement, in eye-tracking data were extracted from a behavioral experiment based on dot probe paradigm. They were analyzed and compared to traditional reaction time. After the analysis of positive and negative scenery images, parameters such as hue frequency spectrum PAR (Peak to Average Ratio) were extracted and showed difference between negative and positive images. These parameters of emotional images could discriminate scenery images according to their emotions in an SVM classifier well. Besides, it was found that images’ hue frequency spectrum PAR is obviously relevant to eye-tracking statistics. When the dot was on the negative side, negative images’ hue frequency spectrum PAR and horizontal eye-jumps confirmed to hyperbolic distribution, while that of positive images was linear with horizontal eye-jumps. The result could help to explain the mechanism of human’s attention and boost the study in computer vision.","PeriodicalId":273984,"journal":{"name":"CiiT international journal of digital image processing","volume":"2 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2015-07-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"CiiT international journal of digital image processing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/12.2196909","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Although recently eye-tracking method has been introduced into behavioral experiments based on dot-probe paradigm, some characteristics in eye-tracking data do not draw as much attention as traditional characteristics like reaction time. It is also necessary to associate eye-tracking data to characteristics of images shown in experiments. In this research, new variables, such as fixation length, times of fixation and times of eye movement, in eye-tracking data were extracted from a behavioral experiment based on dot probe paradigm. They were analyzed and compared to traditional reaction time. After the analysis of positive and negative scenery images, parameters such as hue frequency spectrum PAR (Peak to Average Ratio) were extracted and showed difference between negative and positive images. These parameters of emotional images could discriminate scenery images according to their emotions in an SVM classifier well. Besides, it was found that images’ hue frequency spectrum PAR is obviously relevant to eye-tracking statistics. When the dot was on the negative side, negative images’ hue frequency spectrum PAR and horizontal eye-jumps confirmed to hyperbolic distribution, while that of positive images was linear with horizontal eye-jumps. The result could help to explain the mechanism of human’s attention and boost the study in computer vision.
虽然最近眼动追踪方法被引入到基于点探针范式的行为实验中,但眼动追踪数据中的一些特征并不像反应时间等传统特征那样受到重视。还需要将眼动追踪数据与实验中显示的图像特征联系起来。本研究从基于点探针范式的行为实验中提取了眼动数据中的注视时长、注视次数和眼动次数等新变量。对它们进行分析,并与传统的反应时间进行比较。通过对正负景物图像的分析,提取色相频谱PAR (Peak to Average Ratio)等参数,显示正负景物图像之间的差异。这些情感图像的参数可以在SVM分类器中很好地根据景物图像的情感来区分景物图像。此外,我们还发现图像的色相频谱PAR与眼动统计有明显的相关性。当点在负侧时,负像的色相频谱PAR与水平眼跳呈双曲线分布,而正像的色相频谱PAR与水平眼跳呈线性分布。这一结果有助于解释人类注意力的机制,促进计算机视觉的研究。