Determinants of firms' decisions to block AI crawlers: Strategic insights from the BEDC framework

IF 13.3 1区管理学 Q1 BUSINESS

Technological Forecasting and Social Change Pub Date : 2025-07-10 DOI:10.1016/j.techfore.2025.124275

Chiang-Yu Cheng

引用次数: 0

Abstract

The rise of AI crawlers has intensified firms' concerns over digital asset protection and competitive visibility. This study develops the BEDC Framework—encompassing Business Competition, Engineering Constraints, Domain Authority, and Commerce & Monetization—to conceptualize strategic determinants of AI crawler governance. An empirical analysis of 100 top-ranking global websites reveals significant variation in crawler restriction practices, highlighting the interplay between strategic imperatives and governance behaviors. The findings advance understanding of firm-centric technology governance in the context of automated data extraction, offering insights into how organizations strategically balance protection, accessibility, and monetization.

查看原文本刊更多论文

公司决定阻止人工智能爬虫的决定因素：来自BEDC框架的战略见解

人工智能爬虫的兴起加剧了企业对数字资产保护和竞争知名度的担忧。本研究发展了包括商业竞争、工程约束、领域权威和商业在内的BEDC框架。货币化——概念化AI爬虫治理的战略决定因素。对100个全球排名靠前的网站的实证分析揭示了爬虫限制实践的显著差异，突出了战略要求和治理行为之间的相互作用。这些发现促进了对自动化数据提取背景下以公司为中心的技术治理的理解，为组织如何在战略上平衡保护、可访问性和货币化提供了见解。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Technological Forecasting and Social Change Multiple-

CiteScore

21.30

自引率

10.80%

发文量

813

期刊介绍： Technological Forecasting and Social Change is a prominent platform for individuals engaged in the methodology and application of technological forecasting and future studies as planning tools, exploring the interconnectedness of social, environmental, and technological factors. In addition to serving as a key forum for these discussions, we offer numerous benefits for authors, including complimentary PDFs, a generous copyright policy, exclusive discounts on Elsevier publications, and more.