Calculated inefficiency: sustaining human supervisory competence as an ethical design objective for hybrid human-AI systems

Mohamed El Louadi, Maher Kallel
{"title":"Calculated inefficiency: sustaining human supervisory competence as an ethical design objective for hybrid human-AI systems","authors":"Mohamed El Louadi,&nbsp;Maher Kallel","doi":"10.1007/s43681-026-01341-7","DOIUrl":null,"url":null,"abstract":"<div><p>The ethics of human oversight over artificial intelligence systems has been articulated at length as a normative requirement, most notably in Article 14 of the EU AI Act and in the philosophical literature on meaningful human control. Far less attention has been paid to the organisational question that determines whether such oversight is substantive or nominal: how the human competence on which oversight depends is sustained over time, in environments where the practice opportunities that historically reproduced it have been absorbed by the machine. This paper develops the construct of calculated inefficiency, defined as the structural property of a hybrid information system in which human interventions in automatable processes are maintained at levels above what pure efficiency optimisation would select, regardless of whether that maintenance was deliberately architected or emerged from other organisational sources. Whether such arrangements actually sustain or improve supervisory competence is treated as a separate empirical question. We distinguish three types of calculated inefficiency (architected, institutional, residual), formalise a four-dimensional hybrid-resilience framework (verifiability, distributed competence, decision traceability, systemic robustness) as a threshold weakest-link specification for hybrid resilience, and develop eight theoretical propositions, organised under seven proposition labels (P1, P2, P3a, P3b, P4, P5, P6, P7), that operationalise the construct at empirically testable scope. We engage three counter-positions, including the simulation-based competence reserve and the specialised recovery unit, and we specify the political-economy mechanisms (regulatory pre-commitment, insurance linkage, audit-trail requirements) through which the construct can be protected from short-term efficiency pressures. The contribution is to translate the ethical imperative of meaningful human control into an architectural and institutional design object that organisations can adopt, regulators can audit, and researchers can measure.</p></div>","PeriodicalId":72137,"journal":{"name":"AI and ethics","volume":"6 5","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2026-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"AI and ethics","FirstCategoryId":"1085","ListUrlMain":"https://link.springer.com/article/10.1007/s43681-026-01341-7","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

The ethics of human oversight over artificial intelligence systems has been articulated at length as a normative requirement, most notably in Article 14 of the EU AI Act and in the philosophical literature on meaningful human control. Far less attention has been paid to the organisational question that determines whether such oversight is substantive or nominal: how the human competence on which oversight depends is sustained over time, in environments where the practice opportunities that historically reproduced it have been absorbed by the machine. This paper develops the construct of calculated inefficiency, defined as the structural property of a hybrid information system in which human interventions in automatable processes are maintained at levels above what pure efficiency optimisation would select, regardless of whether that maintenance was deliberately architected or emerged from other organisational sources. Whether such arrangements actually sustain or improve supervisory competence is treated as a separate empirical question. We distinguish three types of calculated inefficiency (architected, institutional, residual), formalise a four-dimensional hybrid-resilience framework (verifiability, distributed competence, decision traceability, systemic robustness) as a threshold weakest-link specification for hybrid resilience, and develop eight theoretical propositions, organised under seven proposition labels (P1, P2, P3a, P3b, P4, P5, P6, P7), that operationalise the construct at empirically testable scope. We engage three counter-positions, including the simulation-based competence reserve and the specialised recovery unit, and we specify the political-economy mechanisms (regulatory pre-commitment, insurance linkage, audit-trail requirements) through which the construct can be protected from short-term efficiency pressures. The contribution is to translate the ethical imperative of meaningful human control into an architectural and institutional design object that organisations can adopt, regulators can audit, and researchers can measure.

计算的低效率:维持人类监督能力作为混合人类-人工智能系统的道德设计目标
人类监督人工智能系统的伦理已经作为一项规范要求得到了详细的阐述,尤其是在《欧盟人工智能法案》(EU AI Act)第14条和关于有意义的人类控制的哲学文献中。很少有人关注决定这种监督是实质性的还是名义上的组织问题:在历史上再现监督的实践机会已被机器吸收的环境中,监督所依赖的人的能力如何随着时间的推移而持续下去。本文发展了计算低效率的结构,定义为混合信息系统的结构属性,在该系统中,可自动化过程中的人为干预维持在高于纯效率优化选择的水平,而不管这种维护是故意构建的还是来自其他组织来源。这种安排是否能真正维持或提高监管能力,则被视为一个单独的实证问题。我们区分了三种类型的计算效率低下(架构、制度、剩余),形式化了一个四维混合弹性框架(可验证性、分布式能力、决策可追溯性、系统鲁棒性),作为混合弹性的阈值最薄弱环节规范,并发展了八个理论命题,组织在七个命题标签下(P1、P2、P3a、P3b、P4、P5、P6、P7),在经验可测试的范围内操作该结构。我们采用了三种相反的立场,包括基于模拟的能力储备和专门的恢复单位,我们指定了政治经济机制(监管预承诺、保险联系、审计跟踪要求),通过这些机制,该结构可以免受短期效率压力的影响。它的贡献在于将有意义的人类控制的道德必要性转化为组织可以采用、监管机构可以审计、研究人员可以衡量的架构和制度设计对象。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书