如果 ChatGPT 生成定量研究数据会怎样?旅游业案例研究

IF 5.3 3区 管理学 Q1 HOSPITALITY, LEISURE, SPORT & TOURISM
Serhat Adem Sop, Doğa Kurçer
{"title":"如果 ChatGPT 生成定量研究数据会怎样?旅游业案例研究","authors":"Serhat Adem Sop, Doğa Kurçer","doi":"10.1108/jhtt-08-2023-0237","DOIUrl":null,"url":null,"abstract":"\nPurpose\nThis study aims to explore whether Chat Generative Pre-training Transformer (ChatGPT) can produce quantitative data sets for researchers who could behave unethically through data fabrication.\n\n\nDesign/methodology/approach\nA two-stage case study related to the field of tourism was conducted, and ChatGPT (v.3.5.) was asked to respond to the first questionnaire on behalf of 400 participants and the second on behalf of 800 participants. The artificial intelligence (AI)-generated data sets’ quality was statistically tested via descriptive statistics, correlation analysis, exploratory factor analysis, confirmatory factor analysis and Harman's single-factor test.\n\n\nFindings\nThe results revealed that ChatGPT could respond to the questionnaires as the number of participants at the desired sample size level and could present the generated data sets in a table format ready for analysis. It was also observed that ChatGPT's responses were systematical, and it created a statistically ideal data set. However, it was noted that the data produced high correlations among the observed variables, the measurement model did not achieve sufficient goodness of fit and the issue of common method bias emerged. The conclusion reached is that ChatGPT does not or cannot yet generate data of suitable quality for advanced-level statistical analyses.\n\n\nOriginality/value\nThis study shows that ChatGPT can provide quantitative data to researchers attempting to fabricate data sets unethically. Therefore, it offers a new and significant argument to the ongoing debates about the unethical use of ChatGPT. Besides, a quantitative data set generated by AI was statistically examined for the first time in this study. The results proved that the data produced by ChatGPT is problematic in certain aspects, shedding light on several points that journal editors should consider during the editorial processes.\n","PeriodicalId":51611,"journal":{"name":"Journal of Hospitality and Tourism Technology","volume":null,"pages":null},"PeriodicalIF":5.3000,"publicationDate":"2024-02-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"What if ChatGPT generates quantitative research data? A case study in tourism\",\"authors\":\"Serhat Adem Sop, Doğa Kurçer\",\"doi\":\"10.1108/jhtt-08-2023-0237\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"\\nPurpose\\nThis study aims to explore whether Chat Generative Pre-training Transformer (ChatGPT) can produce quantitative data sets for researchers who could behave unethically through data fabrication.\\n\\n\\nDesign/methodology/approach\\nA two-stage case study related to the field of tourism was conducted, and ChatGPT (v.3.5.) was asked to respond to the first questionnaire on behalf of 400 participants and the second on behalf of 800 participants. The artificial intelligence (AI)-generated data sets’ quality was statistically tested via descriptive statistics, correlation analysis, exploratory factor analysis, confirmatory factor analysis and Harman's single-factor test.\\n\\n\\nFindings\\nThe results revealed that ChatGPT could respond to the questionnaires as the number of participants at the desired sample size level and could present the generated data sets in a table format ready for analysis. It was also observed that ChatGPT's responses were systematical, and it created a statistically ideal data set. However, it was noted that the data produced high correlations among the observed variables, the measurement model did not achieve sufficient goodness of fit and the issue of common method bias emerged. The conclusion reached is that ChatGPT does not or cannot yet generate data of suitable quality for advanced-level statistical analyses.\\n\\n\\nOriginality/value\\nThis study shows that ChatGPT can provide quantitative data to researchers attempting to fabricate data sets unethically. Therefore, it offers a new and significant argument to the ongoing debates about the unethical use of ChatGPT. Besides, a quantitative data set generated by AI was statistically examined for the first time in this study. The results proved that the data produced by ChatGPT is problematic in certain aspects, shedding light on several points that journal editors should consider during the editorial processes.\\n\",\"PeriodicalId\":51611,\"journal\":{\"name\":\"Journal of Hospitality and Tourism Technology\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":5.3000,\"publicationDate\":\"2024-02-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Hospitality and Tourism Technology\",\"FirstCategoryId\":\"91\",\"ListUrlMain\":\"https://doi.org/10.1108/jhtt-08-2023-0237\",\"RegionNum\":3,\"RegionCategory\":\"管理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"HOSPITALITY, LEISURE, SPORT & TOURISM\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Hospitality and Tourism Technology","FirstCategoryId":"91","ListUrlMain":"https://doi.org/10.1108/jhtt-08-2023-0237","RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"HOSPITALITY, LEISURE, SPORT & TOURISM","Score":null,"Total":0}
引用次数: 0

摘要

目的 本研究旨在探讨聊天生成式预训练转换器(ChatGPT)能否为研究人员生成定量数据集,而这些研究人员可能会通过编造数据而做出不道德的行为。设计/方法/途径 开展了一项与旅游领域相关的两阶段案例研究,要求聊天生成式预训练转换器(ChatGPT,v.3.5.)代表 400 名参与者回答第一份问卷,代表 800 名参与者回答第二份问卷。通过描述性统计、相关性分析、探索性因素分析、确认性因素分析和哈曼单因素测试,对人工智能(AI)生成的数据集的质量进行了统计检测。此外,还发现 ChatGPT 的回答是系统性的,并创建了统计上理想的数据集。不过,我们也注意到,这些数据在观测变量之间产生了很高的相关性,测量模型没有达到足够的拟合度,而且出现了普通方法偏差的问题。得出的结论是,ChatGPT 没有或尚不能生成适合高级统计分析的高质量数据。原创性/价值这项研究表明,ChatGPT 可以为试图不道德地编造数据集的研究人员提供定量数据。因此,它为目前关于不道德使用 ChatGPT 的争论提供了一个新的重要论据。此外,本研究首次对人工智能生成的定量数据集进行了统计检验。结果证明,ChatGPT 生成的数据在某些方面存在问题,并揭示了期刊编辑在编辑过程中应考虑的几个要点。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
What if ChatGPT generates quantitative research data? A case study in tourism
Purpose This study aims to explore whether Chat Generative Pre-training Transformer (ChatGPT) can produce quantitative data sets for researchers who could behave unethically through data fabrication. Design/methodology/approach A two-stage case study related to the field of tourism was conducted, and ChatGPT (v.3.5.) was asked to respond to the first questionnaire on behalf of 400 participants and the second on behalf of 800 participants. The artificial intelligence (AI)-generated data sets’ quality was statistically tested via descriptive statistics, correlation analysis, exploratory factor analysis, confirmatory factor analysis and Harman's single-factor test. Findings The results revealed that ChatGPT could respond to the questionnaires as the number of participants at the desired sample size level and could present the generated data sets in a table format ready for analysis. It was also observed that ChatGPT's responses were systematical, and it created a statistically ideal data set. However, it was noted that the data produced high correlations among the observed variables, the measurement model did not achieve sufficient goodness of fit and the issue of common method bias emerged. The conclusion reached is that ChatGPT does not or cannot yet generate data of suitable quality for advanced-level statistical analyses. Originality/value This study shows that ChatGPT can provide quantitative data to researchers attempting to fabricate data sets unethically. Therefore, it offers a new and significant argument to the ongoing debates about the unethical use of ChatGPT. Besides, a quantitative data set generated by AI was statistically examined for the first time in this study. The results proved that the data produced by ChatGPT is problematic in certain aspects, shedding light on several points that journal editors should consider during the editorial processes.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of Hospitality and Tourism Technology
Journal of Hospitality and Tourism Technology HOSPITALITY, LEISURE, SPORT & TOURISM-
CiteScore
8.40
自引率
12.80%
发文量
41
期刊介绍: The Journal of Hospitality and Tourism Technology is the only journal dedicated solely for research in technology and e-business in tourism and hospitality. It is a bridge between academia and industry through the intellectual exchange of ideas, trends and paradigmatic changes in the fields of hospitality, IT and e-business. It covers: -E-Marketplaces, electronic distribution channels, or e-Intermediaries -Internet or e-commerce business models -Self service technologies -E-Procurement -Social dynamics of e-communication -Relationship Development and Retention -E-governance -Security of transactions -Mobile/Wireless technologies in commerce -IT control and preparation for disaster -Virtual reality applications -Word of Mouth. -Cross-Cultural differences in IT use -GPS and Location-based services -Biometric applications -Business intelligence visualization -Radio Frequency Identification applications -Service-Oriented Architecture of business systems -Technology in New Product Development
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信