利用监督和强化学习方法在再制造视觉检测中进行视图规划

IF 4.6 2区 工程技术 Q2 ENGINEERING, MANUFACTURING
Jan-Philipp Kaiser , Dominik Koch , Jonas Gäbele , Marvin Carl May , Gisela Lanza
{"title":"利用监督和强化学习方法在再制造视觉检测中进行视图规划","authors":"Jan-Philipp Kaiser ,&nbsp;Dominik Koch ,&nbsp;Jonas Gäbele ,&nbsp;Marvin Carl May ,&nbsp;Gisela Lanza","doi":"10.1016/j.cirpj.2024.07.006","DOIUrl":null,"url":null,"abstract":"<div><p>Visual inspection in remanufacturing, despite technological progress, is still mainly performed by humans. A rough assessment of the product’s general condition and the dedicated inspection of individual product features or defects is necessary to identify the typically unknown product variant and assess the reusability of a used product and its components. Therefore, a system for automated visual inspection must be flexible and runtime-adaptive, as defects to be inspected in detail may occur anywhere on the product. In the present work, this problem is framed as a view planning problem solved by means of supervised learning and reinforcement learning using a specially developed simulation environment. Three variants of neural networks (PointNet, PointNet++, and Point Completion Network) are compared in the supervised learning case, whereas a deep learning SAC algorithm using the Point Completion Network as network structure is evaluated in the reinforcement learning case. Considering the specific boundary conditions prevailing in remanufacturing, the results are obtained from the use case of electric starter motor remanufacturing. The results show that supervised learning and reinforcement learning are suitable for determining the poses of an acquisition system at system runtime to react to an initially unknown inspection task. Our proposed framework is available open source under the following: <span><span>https://github.com/Jarrypho/View-Planning-Simulation</span><svg><path></path></svg></span>.</p></div>","PeriodicalId":56011,"journal":{"name":"CIRP Journal of Manufacturing Science and Technology","volume":"53 ","pages":"Pages 128-138"},"PeriodicalIF":4.6000,"publicationDate":"2024-07-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1755581724001159/pdfft?md5=148540d1b66984095ee9873d38d8afae&pid=1-s2.0-S1755581724001159-main.pdf","citationCount":"0","resultStr":"{\"title\":\"View planning in the visual inspection for remanufacturing using supervised- and reinforcement learning approaches\",\"authors\":\"Jan-Philipp Kaiser ,&nbsp;Dominik Koch ,&nbsp;Jonas Gäbele ,&nbsp;Marvin Carl May ,&nbsp;Gisela Lanza\",\"doi\":\"10.1016/j.cirpj.2024.07.006\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Visual inspection in remanufacturing, despite technological progress, is still mainly performed by humans. A rough assessment of the product’s general condition and the dedicated inspection of individual product features or defects is necessary to identify the typically unknown product variant and assess the reusability of a used product and its components. Therefore, a system for automated visual inspection must be flexible and runtime-adaptive, as defects to be inspected in detail may occur anywhere on the product. In the present work, this problem is framed as a view planning problem solved by means of supervised learning and reinforcement learning using a specially developed simulation environment. Three variants of neural networks (PointNet, PointNet++, and Point Completion Network) are compared in the supervised learning case, whereas a deep learning SAC algorithm using the Point Completion Network as network structure is evaluated in the reinforcement learning case. Considering the specific boundary conditions prevailing in remanufacturing, the results are obtained from the use case of electric starter motor remanufacturing. The results show that supervised learning and reinforcement learning are suitable for determining the poses of an acquisition system at system runtime to react to an initially unknown inspection task. Our proposed framework is available open source under the following: <span><span>https://github.com/Jarrypho/View-Planning-Simulation</span><svg><path></path></svg></span>.</p></div>\",\"PeriodicalId\":56011,\"journal\":{\"name\":\"CIRP Journal of Manufacturing Science and Technology\",\"volume\":\"53 \",\"pages\":\"Pages 128-138\"},\"PeriodicalIF\":4.6000,\"publicationDate\":\"2024-07-31\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S1755581724001159/pdfft?md5=148540d1b66984095ee9873d38d8afae&pid=1-s2.0-S1755581724001159-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"CIRP Journal of Manufacturing Science and Technology\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1755581724001159\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, MANUFACTURING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"CIRP Journal of Manufacturing Science and Technology","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1755581724001159","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, MANUFACTURING","Score":null,"Total":0}
引用次数: 0

摘要

尽管技术不断进步,但再制造中的目视检测仍主要由人工完成。对产品的总体状况进行粗略评估,并对个别产品特征或缺陷进行专门检查,这对于识别通常未知的产品变体和评估废旧产品及其部件的可再利用性是非常必要的。因此,自动视觉检测系统必须具有灵活性和运行时间适应性,因为需要详细检测的缺陷可能出现在产品的任何位置。在本研究中,这一问题被视为一个视图规划问题,通过使用专门开发的模拟环境进行监督学习和强化学习来解决。在监督学习案例中,对神经网络的三种变体(PointNet、PointNet++ 和 Point Completion Network)进行了比较,而在强化学习案例中,对使用 Point Completion Network 作为网络结构的深度学习 SAC 算法进行了评估。考虑到再制造过程中普遍存在的特定边界条件,研究结果来自起动机再制造的使用案例。结果表明,监督学习和强化学习适用于在系统运行时确定采集系统的姿势,以便对最初未知的检测任务做出反应。我们提出的框架开源如下:https://github.com/Jarrypho/View-Planning-Simulation.
本文章由计算机程序翻译,如有差异,请以英文原文为准。
View planning in the visual inspection for remanufacturing using supervised- and reinforcement learning approaches

Visual inspection in remanufacturing, despite technological progress, is still mainly performed by humans. A rough assessment of the product’s general condition and the dedicated inspection of individual product features or defects is necessary to identify the typically unknown product variant and assess the reusability of a used product and its components. Therefore, a system for automated visual inspection must be flexible and runtime-adaptive, as defects to be inspected in detail may occur anywhere on the product. In the present work, this problem is framed as a view planning problem solved by means of supervised learning and reinforcement learning using a specially developed simulation environment. Three variants of neural networks (PointNet, PointNet++, and Point Completion Network) are compared in the supervised learning case, whereas a deep learning SAC algorithm using the Point Completion Network as network structure is evaluated in the reinforcement learning case. Considering the specific boundary conditions prevailing in remanufacturing, the results are obtained from the use case of electric starter motor remanufacturing. The results show that supervised learning and reinforcement learning are suitable for determining the poses of an acquisition system at system runtime to react to an initially unknown inspection task. Our proposed framework is available open source under the following: https://github.com/Jarrypho/View-Planning-Simulation.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CIRP Journal of Manufacturing Science and Technology
CIRP Journal of Manufacturing Science and Technology Engineering-Industrial and Manufacturing Engineering
CiteScore
9.10
自引率
6.20%
发文量
166
审稿时长
63 days
期刊介绍: The CIRP Journal of Manufacturing Science and Technology (CIRP-JMST) publishes fundamental papers on manufacturing processes, production equipment and automation, product design, manufacturing systems and production organisations up to the level of the production networks, including all the related technical, human and economic factors. Preference is given to contributions describing research results whose feasibility has been demonstrated either in a laboratory or in the industrial praxis. Case studies and review papers on specific issues in manufacturing science and technology are equally encouraged.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信