{"title":"设计健康和有弹性的信息环境:用于探索风险和对策的多代理沙箱","authors":"Jurriaan van Diggelen, Maaike Homan","doi":"10.1002/aaai.70098","DOIUrl":null,"url":null,"abstract":"<p>Artificial intelligence is transforming online information environments, amplifying both societal benefits and risks. This article argues that online platforms can be understood as multi-agent systems (MAS) composed of humans, simulated users, adversarial agents, and defensive agents operating under platform-level rules. In this MAS-based framework, persuasion, trust, coordination, and governance interact to shape system-level outcomes. To study these dynamics safely, we introduce a sandbox environment in which human participants, red bots, green bots, and blue bots can be observed under controlled conditions. Early experiences with the sandbox show that persuasive agents can be built with little effort, that current large language model (LLM) agents lack psychological realism, and that humans may struggle to distinguish malicious red bots from benign participants. The sandbox enables stakeholders to experience and evaluate trade-offs in moderation, amplification, and intervention strategies. We outline a research agenda for improving agent validity, modelling advanced threats, and designing human–machine teams that support healthier, more resilient information environments.</p>","PeriodicalId":7854,"journal":{"name":"Ai Magazine","volume":"47 4","pages":""},"PeriodicalIF":3.5000,"publicationDate":"2026-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/aaai.70098","citationCount":"0","resultStr":"{\"title\":\"Designing healthy and resilient information environments: A multi-agent sandbox for exploring risks and countermeasures\",\"authors\":\"Jurriaan van Diggelen, Maaike Homan\",\"doi\":\"10.1002/aaai.70098\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Artificial intelligence is transforming online information environments, amplifying both societal benefits and risks. This article argues that online platforms can be understood as multi-agent systems (MAS) composed of humans, simulated users, adversarial agents, and defensive agents operating under platform-level rules. In this MAS-based framework, persuasion, trust, coordination, and governance interact to shape system-level outcomes. To study these dynamics safely, we introduce a sandbox environment in which human participants, red bots, green bots, and blue bots can be observed under controlled conditions. Early experiences with the sandbox show that persuasive agents can be built with little effort, that current large language model (LLM) agents lack psychological realism, and that humans may struggle to distinguish malicious red bots from benign participants. The sandbox enables stakeholders to experience and evaluate trade-offs in moderation, amplification, and intervention strategies. We outline a research agenda for improving agent validity, modelling advanced threats, and designing human–machine teams that support healthier, more resilient information environments.</p>\",\"PeriodicalId\":7854,\"journal\":{\"name\":\"Ai Magazine\",\"volume\":\"47 4\",\"pages\":\"\"},\"PeriodicalIF\":3.5000,\"publicationDate\":\"2026-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://onlinelibrary.wiley.com/doi/epdf/10.1002/aaai.70098\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Ai Magazine\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1002/aaai.70098\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ai Magazine","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/aaai.70098","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Designing healthy and resilient information environments: A multi-agent sandbox for exploring risks and countermeasures
Artificial intelligence is transforming online information environments, amplifying both societal benefits and risks. This article argues that online platforms can be understood as multi-agent systems (MAS) composed of humans, simulated users, adversarial agents, and defensive agents operating under platform-level rules. In this MAS-based framework, persuasion, trust, coordination, and governance interact to shape system-level outcomes. To study these dynamics safely, we introduce a sandbox environment in which human participants, red bots, green bots, and blue bots can be observed under controlled conditions. Early experiences with the sandbox show that persuasive agents can be built with little effort, that current large language model (LLM) agents lack psychological realism, and that humans may struggle to distinguish malicious red bots from benign participants. The sandbox enables stakeholders to experience and evaluate trade-offs in moderation, amplification, and intervention strategies. We outline a research agenda for improving agent validity, modelling advanced threats, and designing human–machine teams that support healthier, more resilient information environments.
期刊介绍:
AI Magazine publishes original articles that are reasonably self-contained and aimed at a broad spectrum of the AI community. Technical content should be kept to a minimum. In general, the magazine does not publish articles that have been published elsewhere in whole or in part. The magazine welcomes the contribution of articles on the theory and practice of AI as well as general survey articles, tutorial articles on timely topics, conference or symposia or workshop reports, and timely columns on topics of interest to AI scientists.