人-机器人协作应用中自动任务建模和任务分配的生成式人工智能

IF 3.2 3区工程技术 Q2 ENGINEERING, INDUSTRIAL

Cirp Annals-Manufacturing Technology Pub Date : 2025-01-01 DOI:10.1016/j.cirp.2025.04.081

Nikos Dimitropoulos, Michalis Kaipis, Stavros Giartzas, George Michalos (2)

{"title":"人-机器人协作应用中自动任务建模和任务分配的生成式人工智能","authors":"Nikos Dimitropoulos, Michalis Kaipis, Stavros Giartzas, George Michalos (2)","doi":"10.1016/j.cirp.2025.04.081","DOIUrl":null,"url":null,"abstract":"<div><div>Task modelling and assignments generation is a complex and time-consuming activity despite the availability of modern CAx and planning tools. This paper proposes an AI based framework using Large Multi-Modal Models and a Digital Twin to automatically create task models, sequences and assignment plans through the processing of video streams involving visual and audio cues on the recorded resources, tools, and tasks. The same LMMs perform the task-to-resource allocation considering metrics such as human factors and resource workload. A case study on the assembly of white goods showcases reduction in manual planning, enhanced resources utilization and improved human-robot collaborative applications.</div></div>","PeriodicalId":55256,"journal":{"name":"Cirp Annals-Manufacturing Technology","volume":"74 1","pages":"Pages 7-11"},"PeriodicalIF":3.2000,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Generative AI for automated task modelling and task allocation in human robot collaborative applications\",\"authors\":\"Nikos Dimitropoulos, Michalis Kaipis, Stavros Giartzas, George Michalos (2)\",\"doi\":\"10.1016/j.cirp.2025.04.081\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Task modelling and assignments generation is a complex and time-consuming activity despite the availability of modern CAx and planning tools. This paper proposes an AI based framework using Large Multi-Modal Models and a Digital Twin to automatically create task models, sequences and assignment plans through the processing of video streams involving visual and audio cues on the recorded resources, tools, and tasks. The same LMMs perform the task-to-resource allocation considering metrics such as human factors and resource workload. A case study on the assembly of white goods showcases reduction in manual planning, enhanced resources utilization and improved human-robot collaborative applications.</div></div>\",\"PeriodicalId\":55256,\"journal\":{\"name\":\"Cirp Annals-Manufacturing Technology\",\"volume\":\"74 1\",\"pages\":\"Pages 7-11\"},\"PeriodicalIF\":3.2000,\"publicationDate\":\"2025-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Cirp Annals-Manufacturing Technology\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0007850625001271\",\"RegionNum\":3,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, INDUSTRIAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Cirp Annals-Manufacturing Technology","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0007850625001271","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, INDUSTRIAL","Score":null,"Total":0}

引用次数: 0

摘要

尽管有现代CAx和规划工具，任务建模和任务生成仍然是一项复杂且耗时的活动。本文提出了一个基于人工智能的框架，使用大型多模态模型和数字孪生，通过处理涉及录制资源、工具和任务的视觉和音频线索的视频流，自动创建任务模型、序列和分配计划。相同的lmm执行任务到资源的分配，考虑诸如人为因素和资源工作负载之类的指标。一个关于白色家电组装的案例研究展示了人工规划的减少、资源利用率的提高和人机协作应用的改进。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

Generative AI for automated task modelling and task allocation in human robot collaborative applications

Task modelling and assignments generation is a complex and time-consuming activity despite the availability of modern CAx and planning tools. This paper proposes an AI based framework using Large Multi-Modal Models and a Digital Twin to automatically create task models, sequences and assignment plans through the processing of video streams involving visual and audio cues on the recorded resources, tools, and tasks. The same LMMs perform the task-to-resource allocation considering metrics such as human factors and resource workload. A case study on the assembly of white goods showcases reduction in manual planning, enhanced resources utilization and improved human-robot collaborative applications.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

Cirp Annals-Manufacturing Technology 工程技术-工程：工业

CiteScore

7.50

自引率

9.80%

发文量

137

审稿时长

13.5 months

期刊介绍： CIRP, The International Academy for Production Engineering, was founded in 1951 to promote, by scientific research, the development of all aspects of manufacturing technology covering the optimization, control and management of processes, machines and systems. This biannual ISI cited journal contains approximately 140 refereed technical and keynote papers. Subject areas covered include: Assembly, Cutting, Design, Electro-Physical and Chemical Processes, Forming, Abrasive processes, Surfaces, Machines, Production Systems and Organizations, Precision Engineering and Metrology, Life-Cycle Engineering, Microsystems Technology (MST), Nanotechnology.