{"title":"What if ChatGPT generates quantitative research data? A case study in tourism","authors":"Serhat Adem Sop, Doğa Kurçer","doi":"10.1108/jhtt-08-2023-0237","DOIUrl":null,"url":null,"abstract":"\nPurpose\nThis study aims to explore whether Chat Generative Pre-training Transformer (ChatGPT) can produce quantitative data sets for researchers who could behave unethically through data fabrication.\n\n\nDesign/methodology/approach\nA two-stage case study related to the field of tourism was conducted, and ChatGPT (v.3.5.) was asked to respond to the first questionnaire on behalf of 400 participants and the second on behalf of 800 participants. The artificial intelligence (AI)-generated data sets’ quality was statistically tested via descriptive statistics, correlation analysis, exploratory factor analysis, confirmatory factor analysis and Harman's single-factor test.\n\n\nFindings\nThe results revealed that ChatGPT could respond to the questionnaires as the number of participants at the desired sample size level and could present the generated data sets in a table format ready for analysis. It was also observed that ChatGPT's responses were systematical, and it created a statistically ideal data set. However, it was noted that the data produced high correlations among the observed variables, the measurement model did not achieve sufficient goodness of fit and the issue of common method bias emerged. The conclusion reached is that ChatGPT does not or cannot yet generate data of suitable quality for advanced-level statistical analyses.\n\n\nOriginality/value\nThis study shows that ChatGPT can provide quantitative data to researchers attempting to fabricate data sets unethically. Therefore, it offers a new and significant argument to the ongoing debates about the unethical use of ChatGPT. Besides, a quantitative data set generated by AI was statistically examined for the first time in this study. The results proved that the data produced by ChatGPT is problematic in certain aspects, shedding light on several points that journal editors should consider during the editorial processes.\n","PeriodicalId":51611,"journal":{"name":"Journal of Hospitality and Tourism Technology","volume":null,"pages":null},"PeriodicalIF":5.3000,"publicationDate":"2024-02-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Hospitality and Tourism Technology","FirstCategoryId":"91","ListUrlMain":"https://doi.org/10.1108/jhtt-08-2023-0237","RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"HOSPITALITY, LEISURE, SPORT & TOURISM","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose
This study aims to explore whether Chat Generative Pre-training Transformer (ChatGPT) can produce quantitative data sets for researchers who could behave unethically through data fabrication.
Design/methodology/approach
A two-stage case study related to the field of tourism was conducted, and ChatGPT (v.3.5.) was asked to respond to the first questionnaire on behalf of 400 participants and the second on behalf of 800 participants. The artificial intelligence (AI)-generated data sets’ quality was statistically tested via descriptive statistics, correlation analysis, exploratory factor analysis, confirmatory factor analysis and Harman's single-factor test.
Findings
The results revealed that ChatGPT could respond to the questionnaires as the number of participants at the desired sample size level and could present the generated data sets in a table format ready for analysis. It was also observed that ChatGPT's responses were systematical, and it created a statistically ideal data set. However, it was noted that the data produced high correlations among the observed variables, the measurement model did not achieve sufficient goodness of fit and the issue of common method bias emerged. The conclusion reached is that ChatGPT does not or cannot yet generate data of suitable quality for advanced-level statistical analyses.
Originality/value
This study shows that ChatGPT can provide quantitative data to researchers attempting to fabricate data sets unethically. Therefore, it offers a new and significant argument to the ongoing debates about the unethical use of ChatGPT. Besides, a quantitative data set generated by AI was statistically examined for the first time in this study. The results proved that the data produced by ChatGPT is problematic in certain aspects, shedding light on several points that journal editors should consider during the editorial processes.
期刊介绍:
The Journal of Hospitality and Tourism Technology is the only journal dedicated solely for research in technology and e-business in tourism and hospitality. It is a bridge between academia and industry through the intellectual exchange of ideas, trends and paradigmatic changes in the fields of hospitality, IT and e-business. It covers: -E-Marketplaces, electronic distribution channels, or e-Intermediaries -Internet or e-commerce business models -Self service technologies -E-Procurement -Social dynamics of e-communication -Relationship Development and Retention -E-governance -Security of transactions -Mobile/Wireless technologies in commerce -IT control and preparation for disaster -Virtual reality applications -Word of Mouth. -Cross-Cultural differences in IT use -GPS and Location-based services -Biometric applications -Business intelligence visualization -Radio Frequency Identification applications -Service-Oriented Architecture of business systems -Technology in New Product Development