Effects of Neural Network Architecture on Topography Estimation From Satellite Imagery for Multi-Terrain Autonomous Vehicle Path Planning and Control

Ryan Lynch, Sumedh Beknalkar, Jack Lynch, A. Mazzoleni, M. Bryant
{"title":"Effects of Neural Network Architecture on Topography Estimation From Satellite Imagery for Multi-Terrain Autonomous Vehicle Path Planning and Control","authors":"Ryan Lynch, Sumedh Beknalkar, Jack Lynch, A. Mazzoleni, M. Bryant","doi":"10.1109/MOST57249.2023.00021","DOIUrl":null,"url":null,"abstract":"Global warming is one of the world’s most pressing issues. The study of its effects on the polar ice caps and other arctic environments, however, can be hindered by the often dangerous and difficult to navigate terrain found there. Multi-terrain autonomous vehicles can assist researchers by providing a mobile platform on which to collect data in these harsh environments while avoiding any risk to human life and speeding up the research process. The mechanical design and ultimate efficacy of these autonomous robotic vehicles depends largely on the specific missions they are deployed for, but terrain conditions can vary wildly geographically as well as seasonally, making mission planning for these unmanned vehicles more difficult. This paper proposes the use of various UNet-based neural network architectures to generate digital elevation maps from satellite images, and explores and compares their efficacy on a single set of training and validation datasets generated from satellite imagery. These digital elevation maps generated by the model could be used by researchers not only to track the change in arctic topography over time, but to quickly provide autonomous exploratory research rovers with the topographical information necessary to decide on optimal paths during the mission. This paper analyzes different model architectures and training schemes: a traditional UNet, a traditional UNet with data augmentation, a UNet with a single active skip-layer vision transformer (ViT), and a UNet with multiple active skip-layer ViT. Each model was trained on a dataset of satellite images and corresponding digital elevation maps of Ellesmere Island, Canada. Utilizing ViTs did not demonstrate a significant improvement in UNet performance, though this could change with longer training. This paper proposes opportunities to improve performance for these neural networks, as well as next steps for further research, including improving the diversity of images in the dataset, generating a testing dataset from a completely different geographic location, and allowing the models more time to train.","PeriodicalId":338621,"journal":{"name":"2023 IEEE International Conference on Mobility, Operations, Services and Technologies (MOST)","volume":"39 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 IEEE International Conference on Mobility, Operations, Services and Technologies (MOST)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/MOST57249.2023.00021","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Global warming is one of the world’s most pressing issues. The study of its effects on the polar ice caps and other arctic environments, however, can be hindered by the often dangerous and difficult to navigate terrain found there. Multi-terrain autonomous vehicles can assist researchers by providing a mobile platform on which to collect data in these harsh environments while avoiding any risk to human life and speeding up the research process. The mechanical design and ultimate efficacy of these autonomous robotic vehicles depends largely on the specific missions they are deployed for, but terrain conditions can vary wildly geographically as well as seasonally, making mission planning for these unmanned vehicles more difficult. This paper proposes the use of various UNet-based neural network architectures to generate digital elevation maps from satellite images, and explores and compares their efficacy on a single set of training and validation datasets generated from satellite imagery. These digital elevation maps generated by the model could be used by researchers not only to track the change in arctic topography over time, but to quickly provide autonomous exploratory research rovers with the topographical information necessary to decide on optimal paths during the mission. This paper analyzes different model architectures and training schemes: a traditional UNet, a traditional UNet with data augmentation, a UNet with a single active skip-layer vision transformer (ViT), and a UNet with multiple active skip-layer ViT. Each model was trained on a dataset of satellite images and corresponding digital elevation maps of Ellesmere Island, Canada. Utilizing ViTs did not demonstrate a significant improvement in UNet performance, though this could change with longer training. This paper proposes opportunities to improve performance for these neural networks, as well as next steps for further research, including improving the diversity of images in the dataset, generating a testing dataset from a completely different geographic location, and allowing the models more time to train.
神经网络结构对多地形自动驾驶车辆路径规划与控制中卫星影像地形估计的影响
全球变暖是世界上最紧迫的问题之一。然而,它对极地冰盖和其他北极环境的影响的研究可能会受到那里经常危险和难以导航的地形的阻碍。多地形自动驾驶汽车可以为研究人员提供一个移动平台,在这些恶劣的环境中收集数据,同时避免对人类生命造成任何风险,并加快研究进程。这些自主机器人车辆的机械设计和最终效能在很大程度上取决于它们部署的具体任务,但地形条件在地理上和季节上可能会有很大变化,这使得这些无人驾驶车辆的任务规划更加困难。本文提出了使用各种基于unet的神经网络架构从卫星图像生成数字高程图,并探索和比较了它们在卫星图像生成的一组训练和验证数据集上的有效性。研究人员不仅可以使用该模型生成的这些数字高程图来跟踪北极地形随时间的变化,还可以快速为自主探索研究漫游者提供必要的地形信息,以确定任务期间的最佳路径。本文分析了不同的模型结构和训练方案:传统UNet、带数据增强的传统UNet、带有单个有源跨层视觉变压器(ViT)的UNet和带有多个有源跨层视觉变压器的UNet。每个模型都是在加拿大埃尔斯米尔岛的卫星图像数据集和相应的数字高程图上进行训练的。使用vit并没有显示出UNet性能的显著改善,尽管这种情况可能随着训练时间的延长而改变。本文提出了提高这些神经网络性能的机会,以及下一步的进一步研究,包括提高数据集中图像的多样性,从完全不同的地理位置生成测试数据集,并允许模型有更多的时间进行训练。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信