Assessing Control Devices for the Supervisory Control of Autonomous Wingmen

The present study aims to enhance the design of future cockpits by supporting pilots in their monitoring and control of autonomous wingmen. In our scenario, autonomous wingmen are F-16 aircraft that can fly autonomously; a real capability currently under development by industry partners. These autonomous fighter aircraft exist to enhance mission effectiveness by reducing the risk of harm to humans, increasing sensor coverage, providing access to more environments, and decreasing cost. However, the method and systems used for interaction between pilots and the autonomous systems are still under development and an active area of research. In collaboration with industry partners, we are assessing different control input devices for supervisory control of autonomous fighter aircraft in a flight simulator. In this simulator, 60 participants will fly various mission types with autonomous wingmen using one of three different types of controllers: Microsoft Sidewinder, F-35 Hands on Throttle and Stick (HOTAS), and a wrist-mounted computer gaming keypad. Pilots will interact with their autonomous wingmen for brief periods of time through calling “plays” that initiate the unmanned aircraft to conduct a task in combat scenarios. Physiological data will be collected via electroencephalogram (EEG), electrocardiogram (ECG), and galvanic skin response (GSR). Eye movements and behavioral measures of reliance on the autonomous wingmen and usage of each of the aforementioned controllers will also be collected. These data, in addition to survey responses, will inform design recommendations for optimal interaction with autonomous wingmen.