基于视觉的3D映射-从传统到基于NeRF的方法

Bipasha Parui, Yagnesh Devada, K. Surender
{"title":"基于视觉的3D映射-从传统到基于NeRF的方法","authors":"Bipasha Parui, Yagnesh Devada, K. Surender","doi":"10.1109/PCEMS58491.2023.10136080","DOIUrl":null,"url":null,"abstract":"3D reconstruction or 3D mapping of an environment is one of the most crucial stages of Simultaneous Localisation and Mapping (SLAM). Numerous work have been done to optimize the tracking and mapping process of SLAM systems over the years in both classical computer vision and deep learning fields. Although there have been many surveys that extensively study SLAM-based work, most of them do not discuss 3D mapping and its developments in much detail. In this paper, we discuss the history of SLAM from a general perspective as well as focus on 3D reconstruction/mapping. To our knowledge, our paper is the first to dedicatedly explore Neural Radiance Field (NeRF) research that is used for SLAM, pose estimation and 3D reconstruction. Thus we track the history of mapping techniques in classical feature-based, direct-based, deep learning-based and most importantly NeRF based literature. Finally, we make a comparative study of all the existing methods and discuss the challenges faced by these concluding the survey.","PeriodicalId":330870,"journal":{"name":"2023 2nd International Conference on Paradigm Shifts in Communications Embedded Systems, Machine Learning and Signal Processing (PCEMS)","volume":"256 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-04-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Vision based 3D mapping-From Traditional to NeRF based approaches\",\"authors\":\"Bipasha Parui, Yagnesh Devada, K. Surender\",\"doi\":\"10.1109/PCEMS58491.2023.10136080\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"3D reconstruction or 3D mapping of an environment is one of the most crucial stages of Simultaneous Localisation and Mapping (SLAM). Numerous work have been done to optimize the tracking and mapping process of SLAM systems over the years in both classical computer vision and deep learning fields. Although there have been many surveys that extensively study SLAM-based work, most of them do not discuss 3D mapping and its developments in much detail. In this paper, we discuss the history of SLAM from a general perspective as well as focus on 3D reconstruction/mapping. To our knowledge, our paper is the first to dedicatedly explore Neural Radiance Field (NeRF) research that is used for SLAM, pose estimation and 3D reconstruction. Thus we track the history of mapping techniques in classical feature-based, direct-based, deep learning-based and most importantly NeRF based literature. Finally, we make a comparative study of all the existing methods and discuss the challenges faced by these concluding the survey.\",\"PeriodicalId\":330870,\"journal\":{\"name\":\"2023 2nd International Conference on Paradigm Shifts in Communications Embedded Systems, Machine Learning and Signal Processing (PCEMS)\",\"volume\":\"256 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-04-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 2nd International Conference on Paradigm Shifts in Communications Embedded Systems, Machine Learning and Signal Processing (PCEMS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/PCEMS58491.2023.10136080\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 2nd International Conference on Paradigm Shifts in Communications Embedded Systems, Machine Learning and Signal Processing (PCEMS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/PCEMS58491.2023.10136080","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

环境的三维重建或三维映射是同步定位和映射(SLAM)最关键的阶段之一。多年来,在经典计算机视觉和深度学习领域,已经做了大量的工作来优化SLAM系统的跟踪和映射过程。尽管已经有许多调查广泛地研究了基于slam的工作,但其中大多数都没有详细讨论3D映射及其发展。在本文中,我们从一般的角度讨论了SLAM的历史,并重点讨论了3D重建/制图。据我们所知,我们的论文是第一篇致力于探索神经辐射场(NeRF)研究的论文,该研究用于SLAM、姿态估计和3D重建。因此,我们在经典的基于特征的、基于直接的、基于深度学习的和最重要的基于NeRF的文献中追踪映射技术的历史。最后,我们对现有的各种方法进行了比较研究,并讨论了这些方法所面临的挑战。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Vision based 3D mapping-From Traditional to NeRF based approaches
3D reconstruction or 3D mapping of an environment is one of the most crucial stages of Simultaneous Localisation and Mapping (SLAM). Numerous work have been done to optimize the tracking and mapping process of SLAM systems over the years in both classical computer vision and deep learning fields. Although there have been many surveys that extensively study SLAM-based work, most of them do not discuss 3D mapping and its developments in much detail. In this paper, we discuss the history of SLAM from a general perspective as well as focus on 3D reconstruction/mapping. To our knowledge, our paper is the first to dedicatedly explore Neural Radiance Field (NeRF) research that is used for SLAM, pose estimation and 3D reconstruction. Thus we track the history of mapping techniques in classical feature-based, direct-based, deep learning-based and most importantly NeRF based literature. Finally, we make a comparative study of all the existing methods and discuss the challenges faced by these concluding the survey.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信