Managing expectations towards AI tools for software development: a multiple-case study

IF 2.3 4区管理学 Q3 BUSINESS

Information Systems and e-Business Management Pub Date : 2025-05-12 DOI:10.1007/s10257-025-00704-7

Victor Vadmand Jensen, Adam Alami, Anders Rysholt Bruun, John Stouby Persson

{"title":"Managing expectations towards AI tools for software development: a multiple-case study","authors":"Victor Vadmand Jensen, Adam Alami, Anders Rysholt Bruun, John Stouby Persson","doi":"10.1007/s10257-025-00704-7","DOIUrl":null,"url":null,"abstract":"<p>Software development organizations (SDOs) are increasingly working to adopt artificial intelligence (AI) tools, like GitHub Copilot, to meet varied expectations. Nevertheless, we know little about how SDOs manage these expectations. This paper investigates how different SDOs expect AI tools to impact software development, and how these expectations change after a period of considering and evaluating AI tools. We conducted a multiple-case study involving three SDOs. To elicit initial expectations towards AI tools, we collected data using semi-structured interviews and field visits. To assess the persistence of expectations towards AI tools, we collected data from meetings, a debriefing, and retrospectives on AI tools. We found three expectations particular to one SDO; four shared between two SDOs; and six pervasive across all SDOs. Five expectations did not persist after experiential learning with AI tools, due to platform- and SDO-related factors. SDOs must carefully manage their expectations towards AI tools due to the variety and complexity of expectations. Some expectations are niche-specific based on their compatibility with the unique SDOs' people- and structure-related aspects, while others are becoming mainstream for a broader array of SDOs. Recognizing factors that affect the persistence of expectations and how they manifest in the individual SDO will enable SDOs to form their initial expectations and understand how these might change during adoption of AI tools, supporting expectation management.</p>","PeriodicalId":13660,"journal":{"name":"Information Systems and e-Business Management","volume":"79 1","pages":""},"PeriodicalIF":2.3000,"publicationDate":"2025-05-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information Systems and e-Business Management","FirstCategoryId":"91","ListUrlMain":"https://doi.org/10.1007/s10257-025-00704-7","RegionNum":4,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"BUSINESS","Score":null,"Total":0}

引用次数: 0

Abstract

Software development organizations (SDOs) are increasingly working to adopt artificial intelligence (AI) tools, like GitHub Copilot, to meet varied expectations. Nevertheless, we know little about how SDOs manage these expectations. This paper investigates how different SDOs expect AI tools to impact software development, and how these expectations change after a period of considering and evaluating AI tools. We conducted a multiple-case study involving three SDOs. To elicit initial expectations towards AI tools, we collected data using semi-structured interviews and field visits. To assess the persistence of expectations towards AI tools, we collected data from meetings, a debriefing, and retrospectives on AI tools. We found three expectations particular to one SDO; four shared between two SDOs; and six pervasive across all SDOs. Five expectations did not persist after experiential learning with AI tools, due to platform- and SDO-related factors. SDOs must carefully manage their expectations towards AI tools due to the variety and complexity of expectations. Some expectations are niche-specific based on their compatibility with the unique SDOs' people- and structure-related aspects, while others are becoming mainstream for a broader array of SDOs. Recognizing factors that affect the persistence of expectations and how they manifest in the individual SDO will enable SDOs to form their initial expectations and understand how these might change during adoption of AI tools, supporting expectation management.

查看原文本刊更多论文

管理对软件开发中的人工智能工具的期望：一个多案例研究

软件开发组织（sdo）越来越多地采用人工智能（AI）工具，如GitHub Copilot，以满足各种期望。然而，我们对sdo如何管理这些期望知之甚少。本文研究了不同的sdo期望人工智能工具如何影响软件开发，以及在考虑和评估人工智能工具一段时间后，这些期望如何变化。我们进行了一个涉及三个sdo的多案例研究。为了引起人们对人工智能工具的初步期望，我们使用半结构化访谈和实地访问收集数据。为了评估对AI工具期望的持久性，我们从会议、汇报和回顾中收集了关于AI工具的数据。我们发现一个SDO有三个特定的期望；四个在两个sdo之间共享；6个普遍存在于所有sdo中。由于与平台和sdo相关的因素，在使用人工智能工具进行体验式学习后，有五个期望没有持续下去。由于期望的多样性和复杂性，sdo必须仔细管理他们对AI工具的期望。一些期望是特定于利基的，基于它们与独特的sdo的人员和结构相关方面的兼容性，而另一些期望正在成为更广泛的sdo的主流。认识到影响期望持久性的因素，以及它们如何在单个SDO中表现出来，将使SDO能够形成它们最初的期望，并理解在采用AI工具期间这些期望可能如何变化，从而支持期望管理。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Information Systems and e-Business Management Multiple-

CiteScore

6.20

自引率

11.10%

发文量

期刊介绍： Nowadays, in the age of information technology and the internet, the creation and maintenance of business models has to consider the latest developments in information technology to ensure competitiveness and long-term success of the enterprise. The aim of Information Systems Management (ISM) is to integrate information technology into business models and business processes to explore its potential to meet the business goals. Many international journals in the field of information systems (IS) or information management (IM) focus primarily on the quantitative analysis of information systems phenomena, especially through the use of empirical studies. However, research on qualitative analysis, development, and deployment of information systems is not covered sufficiently by the existing international IS journals. Therefore, the journal Information Systems and e-Business Management (ISeB) focuses on the core tasks of Information Systems Management, the conceptual analysis, design, and deployment of information systems, as well as on all e-business related topics. 1. Editorial objective The central aim of the journal ISeB is to publish original, well-written, self-contained contributions that elucidate novel research and innovation in information systems management and e-business which advance the field fundamentally and significantly. Published quarterly, the journal will: - Provide a vibrant forum for both academicians and industry specialists to explore the information systems and e-business management field - Bring innovative research on all aspects of information systems management from analytical, behavioral and technological perspectives - Enable rapid dissemination of latest research and innovation, supported with a double-blind peer review process. 2. Nature of topics The function of information systems management is the use of information technology (IT) to meet the information requirements of a company. Core tasks of ISM are the generation of project ideas (e.g. identification of business opportunities enabled by new information technologies), conceptual analysis, design, and integration of information systems. Submissions to ISeB should have a clear business focus and use appropriate information systems methodologies. They should either be founded on theory or should have proven their value based on prototypes and their beneficial application in the field. The general applicability of the concepts presented is strictly required. Case studies are welcome, if the insights presented allow general applicability. Moreover, empirical studies are welcome if clear research questions with relevance to the field of information systems and e-business management are given and the studies are carried out correctly. ISeB topics focus on (but are not restricted to) the following areas: - Information Modeling: The central task of information systems modeling is the conceptual specification of information systems from the business point of view. Information modeling includes the development or the application of high-level modeling techniques used for conceptual modeling, e.g. event-driven process chain (EPC) for process modeling, entity-relationship model (ERM) for data modeling, and object-oriented methods like the unified modeling language (UML). - Domain-Specific Information Systems: Different industry domains (e.g. manufacturing, retailing, or finance) are characterized by different requirements to information systems that are reflected in different IS architectures for specific domains. The development and maintenance of information systems in an industry domain can be supported by these architectures. Either the development of generalizable domain-specific architectures or the employment of such architectures in practice can be discussed. - E-Business Management (intra-organization al and inter-organizational information systems): Possible sub-topics include the development and deployment of IS for electronic commerce and supply chain management, market places, new business scenarios enabled through new technologies. Based on a business strategy, submissions have to clearly state how the strategy can be operationalized using IS. - Information Systems Development: The development and deployment of large-scale IS (e.g. enterprise resource planning software) requires the use of appropriate software engineering methodologies, procedure models, and project management. Possible research areas are the development of software engineering methodologies, procedure models, and the design of project management methods. Empirical studies on IS development may focus on the application of well-founded methods in practice. - Information Technology Management: The function of information technology management is the provision and operation of the technical infrastructure and the planning of the technical orientation of information systems in an enterprise. An important aspect is the impact of changing information systems on organizational structures and processes – and vice versa. In this context, the use of information technology to realize a business strategy efficiently can be analyzed. - Latest Information Technology Developments: Latest developments in information technology have to be evaluated to explore potentials to generate new business strategies. Current topics and trends to be evaluated for business use are e.g. business intelligence systems, agent technology, and workflow management systems. Officially cited as: Inf Syst E-Bus Manage