ChatGPTest: Opportunities and Cautionary Tales of Utilizing AI for Questionnaire Pretesting

IF 1.1 3区社会学 Q2 ANTHROPOLOGY

Field Methods Pub Date : 2024-09-14 DOI:10.1177/1525822x241280574

Francisco Olivos, Minhui Liu

引用次数: 0

Abstract

The rapid advancements in generative artificial intelligence have opened new avenues for enhancing various aspects of research, including the design and evaluation of survey questionnaires. However, the recent pioneering applications have not considered questionnaire pretesting. This article explores the use of GPT models as a useful tool for pretesting survey questionnaires, particularly in the early stages of survey design. Illustrated with two applications, the article suggests incorporating GPT feedback as an additional stage before human pretesting, potentially reducing successive iterations. The article also emphasizes the indispensable role of researchers’ judgment in interpreting and implementing AI-generated feedback.

查看原文本刊更多论文

ChatGPTest：利用人工智能进行问卷预测的机遇与警示

生成式人工智能的飞速发展为加强研究的各个方面开辟了新的途径，其中包括调查问卷的设计和评估。然而，最近的开创性应用并未考虑问卷预测。本文探讨了如何使用 GPT 模型作为调查问卷预测的有用工具，特别是在调查问卷设计的早期阶段。文章以两个应用为例进行说明，建议在人工预试之前将 GPT 反馈作为附加阶段，从而减少连续迭代。文章还强调了研究人员的判断力在解释和实施人工智能生成的反馈中不可或缺的作用。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Field Methods Multiple-

CiteScore

2.70

自引率

5.90%

发文量

期刊介绍： Field Methods (formerly Cultural Anthropology Methods) is devoted to articles about the methods used by field wzorkers in the social and behavioral sciences and humanities for the collection, management, and analysis data about human thought and/or human behavior in the natural world. Articles should focus on innovations and issues in the methods used, rather than on the reporting of research or theoretical/epistemological questions about research. High-quality articles using qualitative and quantitative methods-- from scientific or interpretative traditions-- dealing with data collection and analysis in applied and scholarly research from writers in the social sciences, humanities, and related professions are all welcome in the pages of the journal.