IEEE Transactions on Software Engineering最新文献_第7页

Recovering Traceability Links Between Code and Documentation: a Retrospective

IF 7.4 1区计算机科学

IEEE Transactions on Software Engineering Pub Date : 2025-01-27 DOI: 10.1109/tse.2025.3534027

Giuliano Antoniol, Gerardo Canfora, Gerardo Casazza, Andrea De Lucia, Ettore Merlo

引用次数: 0

On the Workflows and Smells of Leaderboard Operations (LBOps): An Exploratory Study of Foundation Model Leaderboards

IF 6.5 1区计算机科学

IEEE Transactions on Software Engineering Pub Date : 2025-01-27 DOI: 10.1109/TSE.2025.3533972

Zhimin Zhao;Abdul Ali Bangash;Filipe Roseiro Côgo;Bram Adams;Ahmed E. Hassan

{"title":"On the Workflows and Smells of Leaderboard Operations (LBOps): An Exploratory Study of Foundation Model Leaderboards","authors":"Zhimin Zhao;Abdul Ali Bangash;Filipe Roseiro Côgo;Bram Adams;Ahmed E. Hassan","doi":"10.1109/TSE.2025.3533972","DOIUrl":"10.1109/TSE.2025.3533972","url":null,"abstract":"Foundation models (FM), such as large language models (LLMs), which are large-scale machine learning (ML) models, have demonstrated remarkable adaptability in various downstream software engineering (SE) tasks, such as code completion, code understanding, and software development. As a result, FM leaderboards have become essential tools for SE teams to compare and select the best third-party FMs for their specific products and purposes. However, the lack of standardized guidelines for FM evaluation and comparison threatens the transparency of FM leaderboards and limits stakeholders’ ability to perform effective FM selection. As a first step towards addressing this challenge, our research focuses on understanding how these FM leaderboards operate in real-world scenarios (“leaderboard operations”) and identifying potential pitfalls and areas for improvement (“leaderboard smells”). In this regard, we collect up to <inline-formula><tex-math>$1,045$</tex-math></inline-formula> FM leaderboards from five different sources: GitHub, Hugging Face Spaces, Papers With Code, spreadsheet and independent platform, to examine their documentation and engage in direct communication with leaderboard operators to understand their workflows. Through card sorting and negotiated agreement, we identify five distinct workflow patterns and develop a domain model that captures the key components and their interactions within these workflows. We then identify eight unique types of leaderboard smells in LBOps. By mitigating these smells, SE teams can improve transparency, accountability, and collaboration in current LBOps practices, fostering a more robust and responsible ecosystem for FM comparison and selection.","PeriodicalId":13324,"journal":{"name":"IEEE Transactions on Software Engineering","volume":"51 4","pages":"929-946"},"PeriodicalIF":6.5,"publicationDate":"2025-01-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143050002","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

From Executable Specifications to Hard-to-Specify Requirements: Challenges in Describing Reactive System Behavior

IF 7.4 1区计算机科学

IEEE Transactions on Software Engineering Pub Date : 2025-01-27 DOI: 10.1109/tse.2025.3534572

David Harel, Assaf Marron

引用次数: 0

Obstacle Analysis in Requirements Engineering: Retrospective and Emerging Challenges

IF 7.4 1区计算机科学

IEEE Transactions on Software Engineering Pub Date : 2025-01-27 DOI: 10.1109/tse.2025.3534318

Emmanuel Letier, Axel van Lamsweerde

引用次数: 0

Revisiting Abstractions for Software Architecture and Tools to Support Them

IF 6.5 1区计算机科学

IEEE Transactions on Software Engineering Pub Date : 2025-01-27 DOI: 10.1109/TSE.2025.3533549

Mary Shaw;Daniel V. Klein;Theodore L. Ross

{"title":"Revisiting Abstractions for Software Architecture and Tools to Support Them","authors":"Mary Shaw;Daniel V. Klein;Theodore L. Ross","doi":"10.1109/TSE.2025.3533549","DOIUrl":"10.1109/TSE.2025.3533549","url":null,"abstract":"The mid-1990s saw the design of programming languages for software architectures, which define the high-level aspects of software systems including how code components were composed to form full systems. Our paper <italic>Abstractions for Software Architecture and Tools to Support Them</i> presented a conceptual view of software architecture based on abstractions used in practice to organize software systems, a language that supported these abstractions, and a prototype implementation of this language (Shaw et al., 1995). By invitation, we reflect on the paper’s principal ideas about system-level abstractions, place the work in a historical context of steadily increasing abstraction power in software development languages and infrastructure, and reflect on how progress since the paper’s 1995 publication has been influenced, directly or indirectly, by this work. We describe current manifestations of architectural ideas and current challenges. We suggest how the strategy we used to identify and reify architectural abstractions may apply to current opportunities.","PeriodicalId":13324,"journal":{"name":"IEEE Transactions on Software Engineering","volume":"51 3","pages":"768-773"},"PeriodicalIF":6.5,"publicationDate":"2025-01-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10854557","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143049826","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

A Retrospective on How Developers Seek, Relate, and Collect Information About Code

IF 7.4 1区计算机科学

IEEE Transactions on Software Engineering Pub Date : 2025-01-27 DOI: 10.1109/tse.2025.3534071

Amy J. Ko, Brad A. Myers, Michael Coblenz, Htet Htet Aung

引用次数: 0

An Automated Approach to Discovering Software Refactorings by Comparing Successive Versions

IF 7.4 1区计算机科学

IEEE Transactions on Software Engineering Pub Date : 2025-01-27 DOI: 10.1109/tse.2025.3534239

Bo Liu, Hui Liu, Nan Niu, Yuxia Zhang, Guangjie Li, He Jiang, Yanjie Jiang

引用次数: 0

“Estimating software project effort using analogies”: Reflections after 28 years

IF 7.4 1区计算机科学

IEEE Transactions on Software Engineering Pub Date : 2025-01-27 DOI: 10.1109/tse.2025.3534032

Martin Shepperd

引用次数: 0

SmartOracle: Generating Smart Contract Oracle via Fine-Grained Invariant Detection

IF 6.5 1区计算机科学

IEEE Transactions on Software Engineering Pub Date : 2025-01-27 DOI: 10.1109/TSE.2025.3534567

Jianzhong Su;Jiachi Chen;Zhiyuan Fang;Xingwei Lin;Yutian Tang;Zibin Zheng

{"title":"SmartOracle: Generating Smart Contract Oracle via Fine-Grained Invariant Detection","authors":"Jianzhong Su;Jiachi Chen;Zhiyuan Fang;Xingwei Lin;Yutian Tang;Zibin Zheng","doi":"10.1109/TSE.2025.3534567","DOIUrl":"10.1109/TSE.2025.3534567","url":null,"abstract":"As decentralized applications (DApps) proliferate, the increased complexity and usage of smart contracts have heightened their susceptibility to security incidents and financial losses. Although various vulnerability detection tools have been developed to mitigate these issues, they often suffer poor performance in detecting vulnerabilities, as they either rely on simplistic and general-purpose oracles that may be inadequate for vulnerability detection, or require user-specified oracles, which are labor-intensive to create. In this paper, we introduce SmartOracle, a dynamic invariant detector that automatically generates fine-grained invariants as application-specific oracles for vulnerability detection. From historical transactions, SmartOracle uses pattern-based detection and advanced inference to construct comprehensive properties, and mines multi-layer <italic>likely</i> invariants to accommodate the complicated contract functionalities. After that, SmartOracle identifies smart contract vulnerabilities by hunting the violated invariants in new transactions. In the field of invariant detection, SmartOracle detects 50% more ERC20 invariants than existing dynamic invariant detection and achieves 96% precision rate. Furthermore, we build a dataset that contains vulnerable contracts from real-world security incidents. SmartOracle successfully detects 466 abnormal transactions with an acceptable precision rate 96%, involving 31 vulnerable contracts. The experimental results demonstrate its effectiveness in detecting smart contract vulnerabilities, especially those related to complicated contract functionalities.","PeriodicalId":13324,"journal":{"name":"IEEE Transactions on Software Engineering","volume":"51 4","pages":"947-959"},"PeriodicalIF":6.5,"publicationDate":"2025-01-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143049685","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Software Architecture Description Revisited

IF 7.4 1区计算机科学

IEEE Transactions on Software Engineering Pub Date : 2025-01-24 DOI: 10.1109/tse.2025.3533387

Nenad Medvidović, Richard N. Taylor, Eric M. Dashofy

引用次数: 0