{"title":"Co-manipulation of soft-materials estimating deformation from depth images","authors":"G. Nicola, E. Villagrossi, N. Pedrocchi","doi":"10.2139/ssrn.4355722","DOIUrl":"https://doi.org/10.2139/ssrn.4355722","url":null,"abstract":"Human-robot co-manipulation of soft materials, such as fabrics, composites, and sheets of paper/cardboard, is a challenging operation that presents several relevant industrial applications. Estimating the deformation state of the co-manipulated material is one of the main challenges. Viable methods provide the indirect measure by calculating the human-robot relative distance. In this paper, we develop a data-driven model to estimate the deformation state of the material from a depth image through a Convolutional Neural Network (CNN). First, we define the deformation state of the material as the relative roto-translation from the current robot pose and a human grasping position. The model estimates the current deformation state through a Convolutional Neural Network, specifically a DenseNet-121 pretrained on ImageNet.The delta between the current and the desired deformation state is fed to the robot controller that outputs twist commands. The paper describes the developed approach to acquire, preprocess the dataset and train the model. The model is compared with the current state-of-the-art method based on a skeletal tracker from cameras. Results show that our approach achieves better performances and avoids the various drawbacks caused by using a skeletal tracker.Finally, we also studied the model performance according to different architectures and dataset dimensions to minimize the time required for dataset acquisition","PeriodicalId":328366,"journal":{"name":"Robotics Comput. Integr. Manuf.","volume":"45 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-01-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121770772","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Collaborative optimization for logistics and processing services in cloud manufacturing","authors":"Longfei Zhou, Lin Zhang, B. Horn","doi":"10.1016/j.rcim.2020.102094","DOIUrl":"https://doi.org/10.1016/j.rcim.2020.102094","url":null,"abstract":"","PeriodicalId":328366,"journal":{"name":"Robotics Comput. Integr. Manuf.","volume":"54 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"118235228","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Transforming Hong Kong's warehousing industry with a novel business model: A game-theory analysis","authors":"Chen Yang, Shulin Lan, Tingyu Lin, Lihui Wang, Zilong Zhuang, G. Huang","doi":"10.1016/j.rcim.2020.102073","DOIUrl":"https://doi.org/10.1016/j.rcim.2020.102073","url":null,"abstract":"","PeriodicalId":328366,"journal":{"name":"Robotics Comput. Integr. Manuf.","volume":"75 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"118453283","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yingguang Li, W. Mou, Jingjing Li, Changqing Liu, James Gao
{"title":"An automatic and accurate method for tool wear inspection using grayscale image probability algorithm based on bayesian inference","authors":"Yingguang Li, W. Mou, Jingjing Li, Changqing Liu, James Gao","doi":"10.1016/j.rcim.2020.102079","DOIUrl":"https://doi.org/10.1016/j.rcim.2020.102079","url":null,"abstract":"","PeriodicalId":328366,"journal":{"name":"Robotics Comput. Integr. Manuf.","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127661744","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Semantic part segmentation method based 3D object pose estimation with RGB-D images for bin-picking","authors":"Chungang Zhuang, Zhe Wang, Heng Zhao, H. Ding","doi":"10.1016/j.rcim.2020.102086","DOIUrl":"https://doi.org/10.1016/j.rcim.2020.102086","url":null,"abstract":"","PeriodicalId":328366,"journal":{"name":"Robotics Comput. Integr. Manuf.","volume":"199 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124381446","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Cloud-based approach for automatic CNC workpiece origin localization based on image analysis","authors":"Paulo Ricardo Marques de Araujo, R. Lins","doi":"10.1016/j.rcim.2020.102090","DOIUrl":"https://doi.org/10.1016/j.rcim.2020.102090","url":null,"abstract":"","PeriodicalId":328366,"journal":{"name":"Robotics Comput. Integr. Manuf.","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"120299039","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ke Wang, Daxin Liu, Zhen-yu Liu, Qide Wang, Jianrong Tan
{"title":"An assembly precision analysis method based on a general part digital twin model","authors":"Ke Wang, Daxin Liu, Zhen-yu Liu, Qide Wang, Jianrong Tan","doi":"10.1016/j.rcim.2020.102089","DOIUrl":"https://doi.org/10.1016/j.rcim.2020.102089","url":null,"abstract":"","PeriodicalId":328366,"journal":{"name":"Robotics Comput. Integr. Manuf.","volume":"114 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114201488","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Real-Time Kinematics of Continuum Robots: Modelling and Validation","authors":"J. Díez, Xin Dong, D. Axinte, J. Kell","doi":"10.1016/j.rcim.2020.102019","DOIUrl":"https://doi.org/10.1016/j.rcim.2020.102019","url":null,"abstract":"","PeriodicalId":328366,"journal":{"name":"Robotics Comput. Integr. Manuf.","volume":"76 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"118419816","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}