Semantic Information in a model of Resource Gathering Agents

Damian R Sowinski, Jonathan Carroll-Nellenback, Robert N Markwick, Jordi Piñero, Marcelo Gleiser, Artemy Kolchinsky, Gourab Ghoshal, Adam Frank
{"title":"Semantic Information in a model of Resource Gathering Agents","authors":"Damian R Sowinski, Jonathan Carroll-Nellenback, Robert N Markwick, Jordi Piñero, Marcelo Gleiser, Artemy Kolchinsky, Gourab Ghoshal, Adam Frank","doi":"arxiv-2304.03286","DOIUrl":null,"url":null,"abstract":"We explore the application of a new theory of Semantic Information to the\nwell-motivated problem of a resource foraging agent. Semantic information is\ndefined as the subset of correlations, measured via the transfer entropy,\nbetween agent $A$ and environment $E$ that is necessary for the agent to\nmaintain its viability $V$. Viability, in turn, is endogenously defined as\nopposed to the use of exogenous quantities like utility functions. In our\nmodel, the forager's movements are determined by its ability to measure, via a\nsensor, the presence of an individual unit of resource, while the viability\nfunction is its expected lifetime. Through counterfactual interventions --\nscrambling the correlations between agent and environment via noising the\nsensor -- we demonstrate the presence of a critical value of the noise\nparameter, $\\eta_c$, above which the forager's expected lifetime is\ndramatically reduced. On the other hand, for $\\eta < \\eta_c$ there is\nlittle-to-no effect on its ability to survive. We refer to this boundary as the\nsemantic threshold, quantifying the subset of agent-environment correlations\nthat the agent actually needs to maintain its desired state of staying alive.\nEach bit of information affects the agent's ability to persist both above and\nbelow the semantic threshold. Modeling the viability curve and its semantic\nthreshold via forager/environment parameters, we show how the correlations are\ninstantiated. Our work provides a useful model for studies of established\nagents in terms of semantic information. It also shows that such semantic\nthresholds may prove useful for understanding the role information plays in\nallowing systems to become autonomous agents.","PeriodicalId":501231,"journal":{"name":"arXiv - PHYS - Cellular Automata and Lattice Gases","volume":"61 45","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2023-04-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - PHYS - Cellular Automata and Lattice Gases","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2304.03286","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

We explore the application of a new theory of Semantic Information to the well-motivated problem of a resource foraging agent. Semantic information is defined as the subset of correlations, measured via the transfer entropy, between agent $A$ and environment $E$ that is necessary for the agent to maintain its viability $V$. Viability, in turn, is endogenously defined as opposed to the use of exogenous quantities like utility functions. In our model, the forager's movements are determined by its ability to measure, via a sensor, the presence of an individual unit of resource, while the viability function is its expected lifetime. Through counterfactual interventions -- scrambling the correlations between agent and environment via noising the sensor -- we demonstrate the presence of a critical value of the noise parameter, $\eta_c$, above which the forager's expected lifetime is dramatically reduced. On the other hand, for $\eta < \eta_c$ there is little-to-no effect on its ability to survive. We refer to this boundary as the semantic threshold, quantifying the subset of agent-environment correlations that the agent actually needs to maintain its desired state of staying alive. Each bit of information affects the agent's ability to persist both above and below the semantic threshold. Modeling the viability curve and its semantic threshold via forager/environment parameters, we show how the correlations are instantiated. Our work provides a useful model for studies of established agents in terms of semantic information. It also shows that such semantic thresholds may prove useful for understanding the role information plays in allowing systems to become autonomous agents.
资源收集代理模型中的语义信息
我们探索了一种新的语义信息理论在资源觅食智能体的良好动机问题中的应用。语义信息被定义为关联的子集,通过传递熵来衡量,在agent $A$和环境$E$之间,这是agent维持其生存能力$V$所必需的。反过来,与使用外生数量(如效用函数)相反,生存能力是内生定义的。在我们的模型中,觅食者的运动是由它通过传感器测量单个资源单位的存在的能力决定的,而生存能力函数是它的预期寿命。通过反事实干预——通过对传感器施加噪声来扰乱agent和环境之间的相关性——我们证明了噪声参数存在一个临界值,$\eta_c$,超过这个临界值,觅食者的预期寿命就会大大缩短。另一方面,对于$\eta < \eta_c$,它的生存能力几乎没有影响。我们将此边界称为语义阈值,量化代理实际需要的代理-环境相关性子集,以维持其期望的生存状态。每一点信息都会影响代理在高于或低于语义阈值的情况下保持的能力。通过觅食者/环境参数对生存能力曲线及其语义阈值进行建模,我们展示了如何实例化相关性。我们的工作为在语义信息方面研究已建立的代理提供了一个有用的模型。它还表明,这种语义阈值可能有助于理解信息在允许系统成为自主代理方面所起的作用。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信