{"title":"Artificial intelligence and qualitative research: The promise and perils of large language model (LLM) ‘assistance’","authors":"John Roberts, Max Baker, Jane Andrew","doi":"10.1016/j.cpa.2024.102722","DOIUrl":null,"url":null,"abstract":"<div><p>New large language models (LLMs) like ChatGPT have the potential to change qualitative research by contributing to every stage of the research process from generating interview questions to structuring research publications. However, it is far from clear whether such ‘assistance’ will enable or deskill and eventually displace the qualitative researcher. This paper sets out to explore the implications for qualitative research of the recently emerged capabilities of LLMs; how they have acquired their seemingly ‘human-like’ capabilities to ‘converse’ with us humans, and in what ways these capabilities are deceptive or misleading. Building on a comparison of the different ‘trainings’ of humans and LLMs, the paper first traces the seemingly human-like qualities of the LLM to the human proclivity to project communicative intent into or onto LLMs’ purely imitative capacity to predict the structure of human communication. It then goes on to detail the ways in which such human-like communication is deceptive and misleading in relation to the absolute ‘certainty’ with which LLMs ‘converse’, their intrinsic tendencies to ‘hallucination’ and ‘sycophancy’, the narrow conception of ‘artificial intelligence’, LLMs’ complete lack of ethical sensibility or capacity for responsibility, and finally the feared danger of an ‘emergence’ of ‘human-competitive’ or ‘superhuman’ LLM capabilities. The paper concludes by noting the potential dangers of the widespread use of LLMs as ‘mediators’ of human self-understanding and culture. A postscript offers a brief reflection on what only humans can do as qualitative researchers.</p></div>","PeriodicalId":48078,"journal":{"name":"Critical Perspectives on Accounting","volume":"99 ","pages":"Article 102722"},"PeriodicalIF":8.3000,"publicationDate":"2024-02-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1045235424000212/pdfft?md5=4996bb8fea4407c2873234cd74db3f50&pid=1-s2.0-S1045235424000212-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Critical Perspectives on Accounting","FirstCategoryId":"91","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1045235424000212","RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"BUSINESS, FINANCE","Score":null,"Total":0}
引用次数: 0
Abstract
New large language models (LLMs) like ChatGPT have the potential to change qualitative research by contributing to every stage of the research process from generating interview questions to structuring research publications. However, it is far from clear whether such ‘assistance’ will enable or deskill and eventually displace the qualitative researcher. This paper sets out to explore the implications for qualitative research of the recently emerged capabilities of LLMs; how they have acquired their seemingly ‘human-like’ capabilities to ‘converse’ with us humans, and in what ways these capabilities are deceptive or misleading. Building on a comparison of the different ‘trainings’ of humans and LLMs, the paper first traces the seemingly human-like qualities of the LLM to the human proclivity to project communicative intent into or onto LLMs’ purely imitative capacity to predict the structure of human communication. It then goes on to detail the ways in which such human-like communication is deceptive and misleading in relation to the absolute ‘certainty’ with which LLMs ‘converse’, their intrinsic tendencies to ‘hallucination’ and ‘sycophancy’, the narrow conception of ‘artificial intelligence’, LLMs’ complete lack of ethical sensibility or capacity for responsibility, and finally the feared danger of an ‘emergence’ of ‘human-competitive’ or ‘superhuman’ LLM capabilities. The paper concludes by noting the potential dangers of the widespread use of LLMs as ‘mediators’ of human self-understanding and culture. A postscript offers a brief reflection on what only humans can do as qualitative researchers.
期刊介绍:
Critical Perspectives on Accounting aims to provide a forum for the growing number of accounting researchers and practitioners who realize that conventional theory and practice is ill-suited to the challenges of the modern environment, and that accounting practices and corporate behavior are inextricably connected with many allocative, distributive, social, and ecological problems of our era. From such concerns, a new literature is emerging that seeks to reformulate corporate, social, and political activity, and the theoretical and practical means by which we apprehend and affect that activity. Research Areas Include: • Studies involving the political economy of accounting, critical accounting, radical accounting, and accounting''s implication in the exercise of power • Financial accounting''s role in the processes of international capital formation, including its impact on stock market stability and international banking activities • Management accounting''s role in organizing the labor process • The relationship between accounting and the state in various social formations • Studies of accounting''s historical role, as a means of "remembering" the subject''s social and conflictual character • The role of accounting in establishing "real" democracy at work and other domains of life • Accounting''s adjudicative function in international exchanges, such as that of the Third World debt • Antagonisms between the social and private character of accounting, such as conflicts of interest in the audit process • The identification of new constituencies for radical and critical accounting information • Accounting''s involvement in gender and class conflicts in the workplace • The interplay between accounting, social conflict, industrialization, bureaucracy, and technocracy • Reappraisals of the role of accounting as a science and technology • Critical reviews of "useful" scientific knowledge about organizations