Proposed for presentation at the Binary Analysis Research (BAR) workshop, associated with Network and Distributed System Security Symposium (NDSS) held February 21-25, 2021.最新文献
{"title":"Effects of Precise and Imprecise Value-Set Analysis (VSA) Information on Manual Code Analysis.","authors":"L. Matzen, Michelle Leger, Geoffrey Reedy","doi":"10.2172/1847488","DOIUrl":"https://doi.org/10.2172/1847488","url":null,"abstract":"Binary reverse engineers rely on a combination of automated and manual techniques to answer questions about software. However, when evaluating automated analysis results, they rarely have additional information to help them contextualize these results in the binary. We expect that humans could more readily understand the binary program and these analysis results if they had access to information usually kept internal to the analysis, like value-set analysis (VSA) information. However, these automated analyses often give up precision for scalability, and imprecise information has the potential to hinder human decision making. To assess how precision of VSA information affects human analysts, we designed a human study in which reverse engineers answered short information flow problems, determining whether code snippets would print sensitive information. We hypothesized that precise VSA information would help our participants analyze code faster and more accurately, and that imprecise VSA information would lead to slower, less accurate performance than having no VSA information at all. Our hand-crafted code snippets were presented paired with precise, imprecise, or no VSA information in a blocked design. We recorded participants’ eye movements, response times, and accuracy while they answered the problems. Our experiment showed that precise VSA information changed participants’ problem-solving strategies and supported faster, more accurate analyses. However, contrary to our predictions, having imprecise VSA information also led to increased accuracy relative to having no VSA information; this seemed to be because participants spent more time working through the code.","PeriodicalId":435440,"journal":{"name":"Proposed for presentation at the Binary Analysis Research (BAR) workshop, associated with Network and Distributed System Security Symposium (NDSS) held February 21-25, 2021.","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132319719","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}