Experimental Evaluation of the Reliability of AI-Generated Text Identification in Scientific Literature

IF 0.5 4区物理与天体物理 Q4 PHYSICS, PARTICLES & FIELDS

Physics of Particles and Nuclei Pub Date : 2026-07-20 DOI:10.1134/S1063779626700085

I. L. Savelev, A. L. Ivannikov, S. V. Solodov, L. A. Maryushin, A. A. Valova, T. V. Korenkova

引用次数: 0

Abstract

This is an English-language abstract. The article is devoted to evaluating the effectiveness of existing systems for identifying AI-generated text in scientific papers. The study analyzed six systems for their ability to detect AI-generated text in academic works. The probability scores for AI generation varied from 5 to 67% for the same text, depending on the system, method, and conditions of the check. The key factors leading to false results were the stylistic features of academic writing. The research calls into question the objectivity of current tools and emphasizes the need to develop specialized methods adapted to the scientific style of writing.

Abstract Image

查看原文本刊更多论文

科学文献中人工智能生成文本识别可靠性的实验评估

这是一份英文摘要。本文致力于评估现有系统在科学论文中识别人工智能生成文本的有效性。该研究分析了六个系统检测学术作品中人工智能生成文本的能力。对于同一文本，人工智能生成的概率得分从5%到67%不等，这取决于检查的系统、方法和条件。导致虚假结果的关键因素是学术写作的文体特征。该研究对当前工具的客观性提出了质疑，并强调需要开发适合科学写作风格的专门方法。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Physics of Particles and Nuclei 物理-物理：粒子与场物理

CiteScore

1.00

自引率

0.00%

发文量

116

审稿时长

6-12 weeks

期刊介绍： The journal Fizika Elementarnykh Chastits i Atomnogo Yadr of the Joint Institute for Nuclear Research (JINR, Dubna) was founded by Academician N.N. Bogolyubov in August 1969. The Editors-in-chief of the journal were Academician N.N. Bogolyubov (1970–1992) and Academician A.M. Baldin (1992–2001). Its English translation, Physics of Particles and Nuclei, appears simultaneously with the original Russian-language edition. Published by leading physicists from the JINR member states, as well as by scientists from other countries, review articles in this journal examine problems of elementary particle physics, nuclear physics, condensed matter physics, experimental data processing, accelerators and related instrumentation ecology and radiology.