Airborne Radar Quality Control with Machine Learning

Alexander J. DesRosiers, Michael M. Bell
{"title":"Airborne Radar Quality Control with Machine Learning","authors":"Alexander J. DesRosiers, Michael M. Bell","doi":"10.1175/aies-d-23-0064.1","DOIUrl":null,"url":null,"abstract":"\nAirborne Doppler radar provides detailed and targeted observations of winds and precipitation in weather systems over remote or difficult-to-access regions that can help to improve scientific understanding and weather forecasts. Quality control (QC) is necessary to remove nonweather echoes from raw radar data for subsequent analysis. The complex decision-making ability of the machine learning random-forest technique is employed to create a generalized QC method for airborne radar data in convective weather systems. A manually QCed dataset was used to train the model containing data from the Electra Doppler Radar (ELDORA) in mature and developing tropical cyclones, a tornadic supercell, and a bow echo. Successful classification of ∼96% and ∼93% of weather and nonweather radar gates, respectively, in withheld testing data indicate the generalizability of the method. Dual-Doppler analysis from the genesis phase of Hurricane Ophelia (2005) using data not previously seen by the model produced a comparable wind field to that from manual QC. The framework demonstrates a proof of concept that can be applied to newer airborne Doppler radars.\n\n\nAirborne Doppler radar is an invaluable tool for making detailed measurements of wind and precipitation in weather systems over remote or difficult to access regions, such as hurricanes over the ocean. Using the collected radar data depends strongly on quality control (QC) procedures to classify weather and nonweather radar echoes and to then remove the latter before subsequent analysis or assimilation into numerical weather prediction models. Prior QC techniques require interactive editing and subjective classification by trained researchers and can demand considerable time for even small amounts of data. We present a new machine learning algorithm that is trained on past QC efforts from radar experts, resulting in an accurate, fast technique with far less user input required that can greatly reduce the time required for QC. The new technique is based on the random forest, which is a machine learning model composed of decision trees, to classify weather and nonweather radar echoes. Continued efforts to build on this technique could benefit future weather forecasts by quickly and accurately quality-controlling data from other airborne radars for research or operational meteorology.","PeriodicalId":94369,"journal":{"name":"Artificial intelligence for the earth systems","volume":"7 2-3","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Artificial intelligence for the earth systems","FirstCategoryId":"0","ListUrlMain":"https://doi.org/10.1175/aies-d-23-0064.1","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Airborne Doppler radar provides detailed and targeted observations of winds and precipitation in weather systems over remote or difficult-to-access regions that can help to improve scientific understanding and weather forecasts. Quality control (QC) is necessary to remove nonweather echoes from raw radar data for subsequent analysis. The complex decision-making ability of the machine learning random-forest technique is employed to create a generalized QC method for airborne radar data in convective weather systems. A manually QCed dataset was used to train the model containing data from the Electra Doppler Radar (ELDORA) in mature and developing tropical cyclones, a tornadic supercell, and a bow echo. Successful classification of ∼96% and ∼93% of weather and nonweather radar gates, respectively, in withheld testing data indicate the generalizability of the method. Dual-Doppler analysis from the genesis phase of Hurricane Ophelia (2005) using data not previously seen by the model produced a comparable wind field to that from manual QC. The framework demonstrates a proof of concept that can be applied to newer airborne Doppler radars. Airborne Doppler radar is an invaluable tool for making detailed measurements of wind and precipitation in weather systems over remote or difficult to access regions, such as hurricanes over the ocean. Using the collected radar data depends strongly on quality control (QC) procedures to classify weather and nonweather radar echoes and to then remove the latter before subsequent analysis or assimilation into numerical weather prediction models. Prior QC techniques require interactive editing and subjective classification by trained researchers and can demand considerable time for even small amounts of data. We present a new machine learning algorithm that is trained on past QC efforts from radar experts, resulting in an accurate, fast technique with far less user input required that can greatly reduce the time required for QC. The new technique is based on the random forest, which is a machine learning model composed of decision trees, to classify weather and nonweather radar echoes. Continued efforts to build on this technique could benefit future weather forecasts by quickly and accurately quality-controlling data from other airborne radars for research or operational meteorology.
利用机器学习进行机载雷达质量控制
机载多普勒雷达可对偏远或难以进入地区的天气系统中的风和降水进行详细和有针对性的观测,有助于提高科学认识和天气预报水平。质量控制(QC)是去除原始雷达数据中的非天气回波以进行后续分析所必需的。本文利用机器学习随机森林技术的复杂决策能力,为对流天气系统中的机载雷达数据创建了一种通用的质量控制方法。人工质控数据集被用来训练模型,其中包含成熟和发展中热带气旋、龙卷风超级暴风圈和弓形回波中的伊莱克拉多普勒雷达(ELDORA)数据。在扣留的测试数据中,天气和非天气雷达门的分类成功率分别为 96% 和 93%,这表明该方法具有通用性。对飓风 Ophelia(2005 年)起源阶段的双多普勒分析使用了模型以前未见过的数据,产生了与人工质量控制相当的风场。机载多普勒雷达是对偏远或难以进入地区(如海洋上空的飓风)天气系统的风和降水进行详细测量的宝贵工具。使用收集到的雷达数据在很大程度上取决于质量控制(QC)程序,以对天气和非天气雷达回波进行分类,然后在后续分析或同化到数值天气预报模型之前去除后者。之前的质量控制技术需要训练有素的研究人员进行交互式编辑和主观分类,即使是少量数据也需要大量时间。我们提出了一种新的机器学习算法,该算法是根据雷达专家过去的质量控制工作训练出来的,从而产生了一种准确、快速的技术,所需的用户输入量大大减少,可大大缩短质量控制所需的时间。新技术基于随机森林,这是一种由决策树组成的机器学习模型,用于对天气和非天气雷达回波进行分类。在这一技术的基础上继续努力,可以快速、准确地对其他机载雷达的数据进行质量控制,从而为未来的天气预报带来益处,用于研究或气象业务。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信