{"title":"Classification framework to identify similar visual scan paths using multiple similarity metrics","authors":"Ricardo Palma Fraga, Ziho Kang, Jerry Crutchfield","doi":"10.16910/jemr.17.3.4","DOIUrl":null,"url":null,"abstract":"Analyzing visual scan paths, the time-ordered sequence of eye fixations and saccades, can help us understand how operators visually search the environment before making a decision. To analyze and compare visual scan paths, prior studies have used metrics such as string edit similarity, which considers the order used to inspect areas of interest (AOIs), as well as metrics that consider the AOIs shared between visual scan paths. However, to identify similar visual scan paths, particularly in tasks and environments in which operators may apply variations of a common underlying visual scanning behavior, using solely one similarity metric might not be sufficient. In this study, we introduce a classification framework using a combination of the string edit algorithm and the Jaccard coefficient similarity. We applied our framework to the visual scan paths of nine tower controllers in a high-fidelity simulator when a “clear-to-take-off” clearance was issued. The classification framework was able to provide richer and more meaningful classifications of the visual scan paths compared to the results when using either the string edit algorithm or Jaccard coefficient similarity.","PeriodicalId":1,"journal":{"name":"Accounts of Chemical Research","volume":"42 8","pages":""},"PeriodicalIF":16.4000,"publicationDate":"2024-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Accounts of Chemical Research","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.16910/jemr.17.3.4","RegionNum":1,"RegionCategory":"化学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CHEMISTRY, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
Abstract
Analyzing visual scan paths, the time-ordered sequence of eye fixations and saccades, can help us understand how operators visually search the environment before making a decision. To analyze and compare visual scan paths, prior studies have used metrics such as string edit similarity, which considers the order used to inspect areas of interest (AOIs), as well as metrics that consider the AOIs shared between visual scan paths. However, to identify similar visual scan paths, particularly in tasks and environments in which operators may apply variations of a common underlying visual scanning behavior, using solely one similarity metric might not be sufficient. In this study, we introduce a classification framework using a combination of the string edit algorithm and the Jaccard coefficient similarity. We applied our framework to the visual scan paths of nine tower controllers in a high-fidelity simulator when a “clear-to-take-off” clearance was issued. The classification framework was able to provide richer and more meaningful classifications of the visual scan paths compared to the results when using either the string edit algorithm or Jaccard coefficient similarity.
期刊介绍:
Accounts of Chemical Research presents short, concise and critical articles offering easy-to-read overviews of basic research and applications in all areas of chemistry and biochemistry. These short reviews focus on research from the author’s own laboratory and are designed to teach the reader about a research project. In addition, Accounts of Chemical Research publishes commentaries that give an informed opinion on a current research problem. Special Issues online are devoted to a single topic of unusual activity and significance.
Accounts of Chemical Research replaces the traditional article abstract with an article "Conspectus." These entries synopsize the research affording the reader a closer look at the content and significance of an article. Through this provision of a more detailed description of the article contents, the Conspectus enhances the article's discoverability by search engines and the exposure for the research.