The role of large language models (AI chatbots) in fire engineering: An examination of technical questions against domain knowledge

Haley Hostetter , M.Z. Naser , Xinyan Huang , John Gales
{"title":"The role of large language models (AI chatbots) in fire engineering: An examination of technical questions against domain knowledge","authors":"Haley Hostetter ,&nbsp;M.Z. Naser ,&nbsp;Xinyan Huang ,&nbsp;John Gales","doi":"10.1016/j.nhres.2024.06.003","DOIUrl":null,"url":null,"abstract":"<div><div>This communication presents a short review of chatbot technology and preliminary findings from comparing two recent chatbots, OpenAI’s <em>ChatGPT</em> and Google’s <em>Bard,</em> in the context of fire engineering by evaluating their responses in handling fire safety-related queries. A diverse range of fire engineering questions and scenarios were created and examined, including structural fire design, fire prevention strategies, evacuation, building code compliance, and fire suppression systems. The results reveal some key differences in the performance of the chatbots, with <em>ChatGPT</em> demonstrating a relatively superior performance of 88% (vs. 80% for <em>Bard</em>). Then, this communication highlights the potential for chatbot technology to revolutionize fire engineering practices by providing instant access to critical information while outlining areas for further improvement and research. Evidently, and when it matures, this technology will likely be elemental to our engineers’ practice and education.</div></div>","PeriodicalId":100943,"journal":{"name":"Natural Hazards Research","volume":"4 4","pages":"Pages 669-688"},"PeriodicalIF":0.0000,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Natural Hazards Research","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2666592124000520","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

This communication presents a short review of chatbot technology and preliminary findings from comparing two recent chatbots, OpenAI’s ChatGPT and Google’s Bard, in the context of fire engineering by evaluating their responses in handling fire safety-related queries. A diverse range of fire engineering questions and scenarios were created and examined, including structural fire design, fire prevention strategies, evacuation, building code compliance, and fire suppression systems. The results reveal some key differences in the performance of the chatbots, with ChatGPT demonstrating a relatively superior performance of 88% (vs. 80% for Bard). Then, this communication highlights the potential for chatbot technology to revolutionize fire engineering practices by providing instant access to critical information while outlining areas for further improvement and research. Evidently, and when it matures, this technology will likely be elemental to our engineers’ practice and education.
大型语言模型(人工智能聊天机器人)在消防工程中的作用:对领域知识的技术问题的检查
本文简要介绍了聊天机器人技术,并通过比较两种最近的聊天机器人(OpenAI的ChatGPT和b谷歌的Bard)在消防工程背景下的初步发现,评估了它们在处理消防安全相关查询方面的反应。各种各样的消防工程问题和场景被创建和检查,包括结构防火设计、防火策略、疏散、建筑规范合规和灭火系统。结果揭示了聊天机器人性能上的一些关键差异,ChatGPT表现出相对优越的88%的性能(而Bard为80%)。然后,这次交流强调了聊天机器人技术通过提供对关键信息的即时访问来彻底改变消防工程实践的潜力,同时概述了进一步改进和研究的领域。显然,当它成熟时,这项技术很可能会成为我们工程师实践和教育的基本要素。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
4.10
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信