Design of 3D Environment Combining Digital Image Processing Technology and Convolutional Neural Network

Xiaofei Lu, Shouwang Li
{"title":"Design of 3D Environment Combining Digital Image Processing Technology and Convolutional Neural Network","authors":"Xiaofei Lu, Shouwang Li","doi":"10.1155/2024/5528497","DOIUrl":null,"url":null,"abstract":"As virtual reality technology advances, 3D environment design and modeling have garnered increasing attention. Applications in networked virtual environments span urban planning, industrial design, and manufacturing, among other fields. However, existing 3D modeling methods exhibit high reconstruction error precision, limiting their practicality in many domains, particularly environmental design. To enhance 3D reconstruction accuracy, this study proposes a digital image processing technology that combines binocular camera calibration, stereo correction, and a convolutional neural network (CNN) algorithm for optimization and improvement. By employing the refined stereo-matching algorithm, a 3D reconstruction model was developed to augment 3D environment design and reconstruction accuracy while optimizing the 3D reconstruction effect. An experiment using the ShapeNet dataset demonstrated that the evaluation indices—Chamfer distance (CD), Earth mover’s distance (EMD), and intersection over union—of the model constructed in this study outperformed those of alternative methods. After incorporating the CNN module in the ablation experiment, CD and EMD increased by an average of 0.1 and 0.06, respectively. This validates that the proposed CNN module effectively enhances point cloud reconstruction accuracy. Upon adding the CNN module, the CD index and EMD index in the dataset increased by an average of 0.34 and 0.54, respectively. These results indicate that the proposed CNN module exhibits strong predictive capabilities for point cloud coordinates. Furthermore, the model demonstrates good generalization performance.","PeriodicalId":503869,"journal":{"name":"Advances in Multimedia","volume":"56 40","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-01-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advances in Multimedia","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1155/2024/5528497","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

As virtual reality technology advances, 3D environment design and modeling have garnered increasing attention. Applications in networked virtual environments span urban planning, industrial design, and manufacturing, among other fields. However, existing 3D modeling methods exhibit high reconstruction error precision, limiting their practicality in many domains, particularly environmental design. To enhance 3D reconstruction accuracy, this study proposes a digital image processing technology that combines binocular camera calibration, stereo correction, and a convolutional neural network (CNN) algorithm for optimization and improvement. By employing the refined stereo-matching algorithm, a 3D reconstruction model was developed to augment 3D environment design and reconstruction accuracy while optimizing the 3D reconstruction effect. An experiment using the ShapeNet dataset demonstrated that the evaluation indices—Chamfer distance (CD), Earth mover’s distance (EMD), and intersection over union—of the model constructed in this study outperformed those of alternative methods. After incorporating the CNN module in the ablation experiment, CD and EMD increased by an average of 0.1 and 0.06, respectively. This validates that the proposed CNN module effectively enhances point cloud reconstruction accuracy. Upon adding the CNN module, the CD index and EMD index in the dataset increased by an average of 0.34 and 0.54, respectively. These results indicate that the proposed CNN module exhibits strong predictive capabilities for point cloud coordinates. Furthermore, the model demonstrates good generalization performance.
结合数字图像处理技术和卷积神经网络的 3D 环境设计
随着虚拟现实技术的发展,三维环境设计和建模受到越来越多的关注。网络虚拟环境的应用涉及城市规划、工业设计和制造等多个领域。然而,现有的三维建模方法显示出较高的重建误差精度,限制了其在许多领域的实用性,尤其是环境设计领域。为了提高三维重建精度,本研究提出了一种数字图像处理技术,该技术结合了双目相机校准、立体校正和卷积神经网络(CNN)算法,以进行优化和改进。通过采用改进的立体匹配算法,建立了一个三维重构模型,以提高三维环境设计和重构精度,同时优化三维重建效果。使用 ShapeNet 数据集进行的实验表明,本研究中构建的模型的评价指标--康佛距离(CD)、地球移动者距离(EMD)和交集大于联合,均优于其他方法。在消融实验中加入 CNN 模块后,CD 和 EMD 平均分别增加了 0.1 和 0.06。这验证了所提出的 CNN 模块能有效提高点云重建精度。添加 CNN 模块后,数据集中的 CD 指数和 EMD 指数分别平均增加了 0.34 和 0.54。这些结果表明,所提出的 CNN 模块对点云坐标具有很强的预测能力。此外,该模型还具有良好的泛化性能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信