评估基于深度学习的图像分割中人工智能生成式构建脚手架的可行性

Natthapol Saovana, Chavanont Khosakitchalert
{"title":"评估基于深度学习的图像分割中人工智能生成式构建脚手架的可行性","authors":"Natthapol Saovana, Chavanont Khosakitchalert","doi":"10.1109/RESTCON60981.2024.10463583","DOIUrl":null,"url":null,"abstract":"Construction scaffolding serves as a pivotal temporary structure essential for construction activities, exerting a direct influence on site safety conditions. Unfortunately, the lack of documentation often leads to a shortage of training data necessary for employing image segmentation through deep learning for inspection purposes. In an effort to overcome this bottleneck, Generative AI, adept at creating images from pretrained data, emerges as a potential solution. However, the inherent black box nature of deep learning introduces the possibility of generating unrealistic images, thereb necessitating a rigorous evaluation, which constitutes the primary focus of our research. Our findings reveal that scaffolding images generated by Generative AI exhibit distinct features that our deep learning model successfully learned, resulting in an impressive mean average precision (mAP) of 82. Nonetheless, discernible patterns in image generation may be lacking, as evidenced by our deep learning system's ability to grasp scaffolding features proficiently, achieving a mAP of 69 even from the initial epoch. This observation suggests potential challenges in generating diverse scaffolding images through the Generative AI approach, emphasizing the need for further investigation before implementing it with real scenario images","PeriodicalId":518254,"journal":{"name":"2024 1st International Conference on Robotics, Engineering, Science, and Technology (RESTCON)","volume":"56 8","pages":"38-43"},"PeriodicalIF":0.0000,"publicationDate":"2024-02-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Assessing the Viability of Generative AI-Created Construction Scaffolding for Deep Learning-Based Image Segmentation\",\"authors\":\"Natthapol Saovana, Chavanont Khosakitchalert\",\"doi\":\"10.1109/RESTCON60981.2024.10463583\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Construction scaffolding serves as a pivotal temporary structure essential for construction activities, exerting a direct influence on site safety conditions. Unfortunately, the lack of documentation often leads to a shortage of training data necessary for employing image segmentation through deep learning for inspection purposes. In an effort to overcome this bottleneck, Generative AI, adept at creating images from pretrained data, emerges as a potential solution. However, the inherent black box nature of deep learning introduces the possibility of generating unrealistic images, thereb necessitating a rigorous evaluation, which constitutes the primary focus of our research. Our findings reveal that scaffolding images generated by Generative AI exhibit distinct features that our deep learning model successfully learned, resulting in an impressive mean average precision (mAP) of 82. Nonetheless, discernible patterns in image generation may be lacking, as evidenced by our deep learning system's ability to grasp scaffolding features proficiently, achieving a mAP of 69 even from the initial epoch. This observation suggests potential challenges in generating diverse scaffolding images through the Generative AI approach, emphasizing the need for further investigation before implementing it with real scenario images\",\"PeriodicalId\":518254,\"journal\":{\"name\":\"2024 1st International Conference on Robotics, Engineering, Science, and Technology (RESTCON)\",\"volume\":\"56 8\",\"pages\":\"38-43\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-02-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2024 1st International Conference on Robotics, Engineering, Science, and Technology (RESTCON)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/RESTCON60981.2024.10463583\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2024 1st International Conference on Robotics, Engineering, Science, and Technology (RESTCON)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/RESTCON60981.2024.10463583","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

建筑脚手架是建筑活动中必不可少的关键性临时结构,对工地的安全状况有直接影响。遗憾的是,由于缺乏文件记录,往往导致缺乏必要的训练数据,无法通过深度学习进行图像分割,从而达到检测目的。为了克服这一瓶颈,善于通过预训练数据创建图像的生成式人工智能成为一种潜在的解决方案。然而,深度学习固有的黑盒特性可能会生成不切实际的图像,因此有必要进行严格的评估,而这正是我们研究的主要重点。我们的研究结果表明,生成式人工智能生成的脚手架图像具有明显的特征,我们的深度学习模型成功地学习到了这些特征,平均精确度(mAP)达到了令人印象深刻的 82。然而,图像生成中可能缺乏可辨别的模式,这一点从我们的深度学习系统熟练掌握脚手架特征的能力中可见一斑,即使从最初的epoch开始,其mAP也达到了69。这一观察结果表明,通过生成式人工智能方法生成多样化的脚手架图像可能面临挑战,因此在将其应用于真实场景图像之前,有必要进行进一步研究
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Assessing the Viability of Generative AI-Created Construction Scaffolding for Deep Learning-Based Image Segmentation
Construction scaffolding serves as a pivotal temporary structure essential for construction activities, exerting a direct influence on site safety conditions. Unfortunately, the lack of documentation often leads to a shortage of training data necessary for employing image segmentation through deep learning for inspection purposes. In an effort to overcome this bottleneck, Generative AI, adept at creating images from pretrained data, emerges as a potential solution. However, the inherent black box nature of deep learning introduces the possibility of generating unrealistic images, thereb necessitating a rigorous evaluation, which constitutes the primary focus of our research. Our findings reveal that scaffolding images generated by Generative AI exhibit distinct features that our deep learning model successfully learned, resulting in an impressive mean average precision (mAP) of 82. Nonetheless, discernible patterns in image generation may be lacking, as evidenced by our deep learning system's ability to grasp scaffolding features proficiently, achieving a mAP of 69 even from the initial epoch. This observation suggests potential challenges in generating diverse scaffolding images through the Generative AI approach, emphasizing the need for further investigation before implementing it with real scenario images
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信