Automated legal consulting in construction procurement using metaheuristically optimized large language models

IF 9.6 1区工程技术 Q1 CONSTRUCTION & BUILDING TECHNOLOGY

Automation in Construction Pub Date : 2024-12-04 DOI:10.1016/j.autcon.2024.105891

Chi-Yun Liu, Jui-Sheng Chou

{"title":"Automated legal consulting in construction procurement using metaheuristically optimized large language models","authors":"Chi-Yun Liu, Jui-Sheng Chou","doi":"10.1016/j.autcon.2024.105891","DOIUrl":null,"url":null,"abstract":"This paper introduces a hybrid optimization algorithm, Pilgrimage Walk Optimization - Differential Evolution (PWO-DE), inspired by Taiwan's cultural traditions, to fine-tune large language models (LLMs) for government procurement legal consulting. Addressing the unique requirements of Traditional Chinese, this research develops two tailored LLMs, Llama3-TAIDE and Taiwan-LLM, which significantly enhance automated legal advisory systems. Through rigorous comparative evaluations, the PWO-DE algorithm demonstrates superior performance against various well-established single and hybrid metaheuristic algorithms, ensuring effective decision-making and risk management in government procurement. A user-friendly chat interface has also been created, facilitating the practical application of LLMs, increasing their accessibility and impact on legal consulting within the construction and legal fields. This study showcases the integration of cultural insights into algorithmic design, establishing a new benchmark for future advancements in the automation of complex legal consulting tasks.","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"18 1","pages":""},"PeriodicalIF":9.6000,"publicationDate":"2024-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Automation in Construction","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1016/j.autcon.2024.105891","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CONSTRUCTION & BUILDING TECHNOLOGY","Score":null,"Total":0}

引用次数: 0

Abstract

This paper introduces a hybrid optimization algorithm, Pilgrimage Walk Optimization - Differential Evolution (PWO-DE), inspired by Taiwan's cultural traditions, to fine-tune large language models (LLMs) for government procurement legal consulting. Addressing the unique requirements of Traditional Chinese, this research develops two tailored LLMs, Llama3-TAIDE and Taiwan-LLM, which significantly enhance automated legal advisory systems. Through rigorous comparative evaluations, the PWO-DE algorithm demonstrates superior performance against various well-established single and hybrid metaheuristic algorithms, ensuring effective decision-making and risk management in government procurement. A user-friendly chat interface has also been created, facilitating the practical application of LLMs, increasing their accessibility and impact on legal consulting within the construction and legal fields. This study showcases the integration of cultural insights into algorithmic design, establishing a new benchmark for future advancements in the automation of complex legal consulting tasks.

查看原文本刊更多论文

基于元启发式优化大型语言模型的建筑采购自动化法律咨询

本文引入一种受台湾文化传统启发的混合优化算法——朝圣行走优化-差分进化（PWO-DE），对政府采购法律咨询的大语言模型进行微调。针对繁体中文的独特需求，本研究开发了两种量身定制的llm， Llama3-TAIDE和Taiwan-LLM，显著增强了自动化法律咨询系统。通过严格的对比评估，PWO-DE算法在各种成熟的单一和混合元启发式算法中表现出优越的性能，为政府采购的有效决策和风险管理提供了保障。此外，还创建了一个用户友好的聊天界面，方便了法学硕士的实际应用，增加了法学硕士在建筑和法律领域的可访问性和对法律咨询的影响。这项研究展示了将文化见解融入算法设计，为复杂法律咨询任务自动化的未来发展建立了新的基准。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Automation in Construction 工程技术-工程：土木

CiteScore

19.20

自引率

16.50%

发文量

563

审稿时长

8.5 months

期刊介绍： Automation in Construction is an international journal that focuses on publishing original research papers related to the use of Information Technologies in various aspects of the construction industry. The journal covers topics such as design, engineering, construction technologies, and the maintenance and management of constructed facilities. The scope of Automation in Construction is extensive and covers all stages of the construction life cycle. This includes initial planning and design, construction of the facility, operation and maintenance, as well as the eventual dismantling and recycling of buildings and engineering structures.