Integration of dynamic knowledge and LLM for adaptive human-robot collaborative assembly solution generation

IF 9.9 1区 工程技术 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Yiwei Hua , Kerun Li , Ru Wang , Yingjie Li , Guoxin Wang , Yan Yan
{"title":"Integration of dynamic knowledge and LLM for adaptive human-robot collaborative assembly solution generation","authors":"Yiwei Hua ,&nbsp;Kerun Li ,&nbsp;Ru Wang ,&nbsp;Yingjie Li ,&nbsp;Guoxin Wang ,&nbsp;Yan Yan","doi":"10.1016/j.aei.2025.103613","DOIUrl":null,"url":null,"abstract":"<div><div>The active adaptability of robots has always been a central challenge and focus in human-robot collaboration research. In complex product assembly scenarios, humans often struggle to provide robots with clear or sufficient natural language instructions. To enhance a robot’s adaptive capability, it is essential to incorporate dynamic collaborative context information, such as assembly requirement changes, object positional adjustments, and product status evolution. Traditional approaches that establish static knowledge bases are more suitable for simple and localized context tasks but overlook the fact that in collaborative assembly tasks, historical contextual knowledge accumulates rapidly. This accumulation makes it increasingly challenging to extract effective knowledge from large volumes of historical data and reduces interference from irrelevant contextual prompts. To address this issue, this paper proposes an adaptive method for intelligent generation of Human-Robot Collaborative Assembly (HRCA) programs by fusing dynamic knowledge and Large Language Models (LLMs). The method generates collaborative assembly solutions based on the logic of knowledge modeling, knowledge evolution, and knowledge enhancement. Specifically, a dynamic knowledge evolution mechanism for HRCA is designed, which establishes a memory iteration loop for dynamic contextual requirements and historical scene states. This loop provides LLMs with comprehensive prompt texts that balance current contextual demands with scene states, reducing the interference of irrelevant information and improving the accuracy and consistency of the generated solutions. The proposed method is applied to a complex product’s HRCA, and its performance is compared with various baseline methods. The results show that the proposed method significantly enhances the accuracy of multi-step reasoning in HRCA, with accuracy and consistency in the generated solutions for different collaboration modes approaching 90%, thereby validating the effectiveness of the proposed method.</div></div>","PeriodicalId":50941,"journal":{"name":"Advanced Engineering Informatics","volume":"68 ","pages":"Article 103613"},"PeriodicalIF":9.9000,"publicationDate":"2025-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advanced Engineering Informatics","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1474034625005063","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

The active adaptability of robots has always been a central challenge and focus in human-robot collaboration research. In complex product assembly scenarios, humans often struggle to provide robots with clear or sufficient natural language instructions. To enhance a robot’s adaptive capability, it is essential to incorporate dynamic collaborative context information, such as assembly requirement changes, object positional adjustments, and product status evolution. Traditional approaches that establish static knowledge bases are more suitable for simple and localized context tasks but overlook the fact that in collaborative assembly tasks, historical contextual knowledge accumulates rapidly. This accumulation makes it increasingly challenging to extract effective knowledge from large volumes of historical data and reduces interference from irrelevant contextual prompts. To address this issue, this paper proposes an adaptive method for intelligent generation of Human-Robot Collaborative Assembly (HRCA) programs by fusing dynamic knowledge and Large Language Models (LLMs). The method generates collaborative assembly solutions based on the logic of knowledge modeling, knowledge evolution, and knowledge enhancement. Specifically, a dynamic knowledge evolution mechanism for HRCA is designed, which establishes a memory iteration loop for dynamic contextual requirements and historical scene states. This loop provides LLMs with comprehensive prompt texts that balance current contextual demands with scene states, reducing the interference of irrelevant information and improving the accuracy and consistency of the generated solutions. The proposed method is applied to a complex product’s HRCA, and its performance is compared with various baseline methods. The results show that the proposed method significantly enhances the accuracy of multi-step reasoning in HRCA, with accuracy and consistency in the generated solutions for different collaboration modes approaching 90%, thereby validating the effectiveness of the proposed method.
基于动态知识和法学模型的自适应人机协同装配解决方案生成
机器人的主动适应性问题一直是人机协作研究的核心问题和热点。在复杂的产品装配场景中,人类往往难以向机器人提供清晰或充分的自然语言指令。为了提高机器人的自适应能力,必须将装配需求变化、物体位置调整和产品状态演变等动态协作环境信息纳入机器人的自适应能力中。传统的建立静态知识库的方法更适合于简单和局部的上下文任务,但忽略了在协同装配任务中历史上下文知识的快速积累。这种积累使得从大量历史数据中提取有效知识并减少不相关上下文提示的干扰变得越来越具有挑战性。为了解决这一问题,本文提出了一种融合动态知识和大语言模型的人机协同装配(HRCA)程序智能生成的自适应方法。该方法基于知识建模、知识演化和知识增强的逻辑生成协同装配解决方案。具体而言,设计了一种动态知识演化机制,建立了动态上下文需求和历史场景状态的记忆迭代循环。这个循环为llm提供了全面的提示文本,平衡了当前上下文需求和场景状态,减少了不相关信息的干扰,提高了生成解决方案的准确性和一致性。将该方法应用于复杂产品的HRCA,并与各种基准方法进行了性能比较。结果表明,所提方法显著提高了HRCA多步推理的准确率,不同协作模式下生成的解的准确率和一致性接近90%,验证了所提方法的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Advanced Engineering Informatics
Advanced Engineering Informatics 工程技术-工程:综合
CiteScore
12.40
自引率
18.20%
发文量
292
审稿时长
45 days
期刊介绍: Advanced Engineering Informatics is an international Journal that solicits research papers with an emphasis on 'knowledge' and 'engineering applications'. The Journal seeks original papers that report progress in applying methods of engineering informatics. These papers should have engineering relevance and help provide a scientific base for more reliable, spontaneous, and creative engineering decision-making. Additionally, papers should demonstrate the science of supporting knowledge-intensive engineering tasks and validate the generality, power, and scalability of new methods through rigorous evaluation, preferably both qualitatively and quantitatively. Abstracting and indexing for Advanced Engineering Informatics include Science Citation Index Expanded, Scopus and INSPEC.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信