Qiyue Feng;Tao Tang;Zhidong Wu;Yunpu Zhang;Ding Wang
{"title":"A Deep Reinforcement Learning-Based Shortwave Multistation Autonomous Cooperative Direction Finding and Localization Method","authors":"Qiyue Feng;Tao Tang;Zhidong Wu;Yunpu Zhang;Ding Wang","doi":"10.1109/JSEN.2024.3483192","DOIUrl":null,"url":null,"abstract":"Multistation direction finding and passive localization have a wide range of applications in the fields of information countermeasures and navigation. However, signal detection and recognition based on deep learning require a lot of manual annotation, and the localization algorithm requires a large amount of computation, resulting in poor shortwave signal direction finding and localization in real time. To solve the time-consuming and labor-intensive problem, we propose a shortwave direction finding and localization method based on deep reinforcement learning (DRL). The direction of arrival (DOA) of the source signal can be used to locate the shortwave source, but the result of direction finding is not ideal in the case of the same frequency interference. In the proposed method, a space-time high-resolution processing method is designed to improve the accuracy of obtaining directional results under the complex shortwave background. The Cramér-Rao lower bound (CRLB)-based reward function is also designed, and a Markov decision process (MDP) is established. The autonomous direction finding and localization environment is trained by deep Q-network (DQN) and double-DQN (DDQN), and the comparison shows that the DDQN performs better compared with DQN. Finally, we save the online model and compare its positioning performance with other classical algorithms. The simulation experiment results and performance tests verify the feasibility of the proposed method.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"24 23","pages":"40123-40136"},"PeriodicalIF":4.3000,"publicationDate":"2024-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Sensors Journal","FirstCategoryId":"103","ListUrlMain":"https://ieeexplore.ieee.org/document/10735085/","RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
Multistation direction finding and passive localization have a wide range of applications in the fields of information countermeasures and navigation. However, signal detection and recognition based on deep learning require a lot of manual annotation, and the localization algorithm requires a large amount of computation, resulting in poor shortwave signal direction finding and localization in real time. To solve the time-consuming and labor-intensive problem, we propose a shortwave direction finding and localization method based on deep reinforcement learning (DRL). The direction of arrival (DOA) of the source signal can be used to locate the shortwave source, but the result of direction finding is not ideal in the case of the same frequency interference. In the proposed method, a space-time high-resolution processing method is designed to improve the accuracy of obtaining directional results under the complex shortwave background. The Cramér-Rao lower bound (CRLB)-based reward function is also designed, and a Markov decision process (MDP) is established. The autonomous direction finding and localization environment is trained by deep Q-network (DQN) and double-DQN (DDQN), and the comparison shows that the DDQN performs better compared with DQN. Finally, we save the online model and compare its positioning performance with other classical algorithms. The simulation experiment results and performance tests verify the feasibility of the proposed method.
期刊介绍:
The fields of interest of the IEEE Sensors Journal are the theory, design , fabrication, manufacturing and applications of devices for sensing and transducing physical, chemical and biological phenomena, with emphasis on the electronics and physics aspect of sensors and integrated sensors-actuators. IEEE Sensors Journal deals with the following:
-Sensor Phenomenology, Modelling, and Evaluation
-Sensor Materials, Processing, and Fabrication
-Chemical and Gas Sensors
-Microfluidics and Biosensors
-Optical Sensors
-Physical Sensors: Temperature, Mechanical, Magnetic, and others
-Acoustic and Ultrasonic Sensors
-Sensor Packaging
-Sensor Networks
-Sensor Applications
-Sensor Systems: Signals, Processing, and Interfaces
-Actuators and Sensor Power Systems
-Sensor Signal Processing for high precision and stability (amplification, filtering, linearization, modulation/demodulation) and under harsh conditions (EMC, radiation, humidity, temperature); energy consumption/harvesting
-Sensor Data Processing (soft computing with sensor data, e.g., pattern recognition, machine learning, evolutionary computation; sensor data fusion, processing of wave e.g., electromagnetic and acoustic; and non-wave, e.g., chemical, gravity, particle, thermal, radiative and non-radiative sensor data, detection, estimation and classification based on sensor data)
-Sensors in Industrial Practice