Jacob Davis, A. Atchley, Hannah Smitherman, Hailey Simon, N. Tenhundfeld
{"title":"Measuring Automation Bias and Complacency in an X-Ray Screening Task","authors":"Jacob Davis, A. Atchley, Hannah Smitherman, Hailey Simon, N. Tenhundfeld","doi":"10.1109/SIEDS49339.2020.9106670","DOIUrl":"https://doi.org/10.1109/SIEDS49339.2020.9106670","url":null,"abstract":"Automation is becoming ever more prevalent in industrial system designs, and the aviation security industry is no exception. Automated decision aids are regularly used in airport security procedures (as with the TSA) to assist operators scanning baggage for hazardous items. However, there exists serious concerns regarding the human-machine interactions. In order to safely design systems that rely on human oversight, it is imperative that we understand the consequences of design on overall task performance and system usability. To do this, we combined an x-ray screening research paradigm with a ‘wizard-of-oz’ automation verification feature to create a novel research paradigm for exploring monitoring behavior (complacency) and performance in a simulated x-ray screening task. The automation in the x-ray task provided participants with a reliable recommendation to search (hazardous items detected) or clear (no hazardous weapons detected) the baggage 80% of the time. Users’ level of complacency was measured by registering the frequency with which they chose to verify the automation by clicking a “Request Info” button. Monitoring behavior, or the percent of trials in which the user requested additional information from the automation, was low overall. However, it was significantly higher when the automation provided an inaccurate recommendation. These results indicate that users experienced automation bias, the tendency to agree with an automated decision aid. Users also exhibited complacency during the task such that they were no longer actively monitoring the system. Users may have noticed the system was unreliable, given an increase in monitoring behavior in unreliable recommendation trials, but still chose to agree with the automation rather than visually search the baggage for evidence. This demonstrates a unique threat to safety in these domains, wherein users may rely on imperfect automation, rather than their own abilities, even when they believe something is amiss.","PeriodicalId":331495,"journal":{"name":"2020 Systems and Information Engineering Design Symposium (SIEDS)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2020-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"113946475","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Bradley Katcher, Elizabeth Driskill, Jiaxing Qiu, W. Novicoff
{"title":"Analyzing the Composition of Diabetes Patients and Impact of Seasonal and Climate Trends on Emergency Room Utilization in Central Virginia","authors":"Bradley Katcher, Elizabeth Driskill, Jiaxing Qiu, W. Novicoff","doi":"10.1109/SIEDS49339.2020.9106652","DOIUrl":"https://doi.org/10.1109/SIEDS49339.2020.9106652","url":null,"abstract":"Diabetes is an epidemic both nationally and in the Commonwealth of Virginia, and there are gaps in understanding of what demographic groups are most impacted by diabetes and how these patients utilize the emergency room. It is also known that diabetes patients are more likely to experience dehydration at high temperatures, which could potentially lead to heat exhaustion or heat stroke. However, there is limited research on the effect of climate on the number or proportion of diabetes patients presenting to the emergency room. The main objective of this project will be to examine trends in emergency room utilization for patients with diabetes in Virginia, specifically targeting seasonal and climate trends, giving emphasis to exploring trends during heat and cold waves.","PeriodicalId":331495,"journal":{"name":"2020 Systems and Information Engineering Design Symposium (SIEDS)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2020-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134458328","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Rebecca Hetrick, Nicholas Amerson, Boyoung Kim, Eric Rosen, E. D. Visser, Elizabeth Phillips
{"title":"Comparing Virtual Reality Interfaces for the Teleoperation of Robots","authors":"Rebecca Hetrick, Nicholas Amerson, Boyoung Kim, Eric Rosen, E. D. Visser, Elizabeth Phillips","doi":"10.1109/SIEDS49339.2020.9106630","DOIUrl":"https://doi.org/10.1109/SIEDS49339.2020.9106630","url":null,"abstract":"Whether exploring a defunct nuclear reactor, defusing a bomb, delivering medicine to quarantined patients, repairing the International Space Station from the outside, or providing dexterous manipulation for those with motor impairments, robots have the ability to be in places where humans cannot go, can augment the capabilities of humans, and improve quality of life and work. Since even the most advanced robots have difficulty completing tasks that require grasping and manipulation, human teleoperation is often a practical alternative for these types of tasks. By importing the dexterity, expertise, and wealth of background knowledge of a human operator, robots can leverage the skills of their human teammates without requiring humans to be physically present. However, existing robot teleoperation interfaces often rely on 2D methods to view and interact with the 3D world, which is cumbersome for human operators. Virtual reality interfaces may be suitable for resolving problems with traditional teleoperation interfaces (e.g., perspective adjustment, action specification). The goal of this research was to investigate the efficacy of using two different Virtual Reality interfaces—positional control, similar to waypoint navigation, and trajectory control, similar to click and drag—for remotely controlling a Baxter robot to complete a variety of dexterous manipulation tasks. The results of this study will help us to develop control interfaces that allow for more intuitive robot manipulation and ultimately, better distal collaborations between humans and robots.","PeriodicalId":331495,"journal":{"name":"2020 Systems and Information Engineering Design Symposium (SIEDS)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2020-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131382280","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}