AmesNet: A Task-Conditioned Deep Learning Model with Enhanced Sensitivity and Generalization in Ames Mutagenicity Prediction

IF 4.1 3区 医学 Q2 CHEMISTRY, MEDICINAL
Chemical Research in Toxicology Pub Date : 2026-10-19 Epub Date: 2026-06-29 DOI:10.1021/acs.chemrestox.6c00082
Tyler J. Umansky, Virgil A. Woods, Sean M. Russell, Daniel J. Haders
{"title":"AmesNet: A Task-Conditioned Deep Learning Model with Enhanced Sensitivity and Generalization in Ames Mutagenicity Prediction","authors":"Tyler J. Umansky,&nbsp;Virgil A. Woods,&nbsp;Sean M. Russell,&nbsp;Daniel J. Haders","doi":"10.1021/acs.chemrestox.6c00082","DOIUrl":null,"url":null,"abstract":"<p>Regulatory agencies require comprehensive genotoxicity\r\nassessments\r\nfor novel small-molecule therapeutics prior to human trials. Developers\r\noften delay these studies until a candidate is nearing regulatory\r\nsubmission because they are expensive and secondary to bioactivity.\r\nThis timing creates a bottleneck where late-stage failures can jeopardize\r\n&gt;\\$10 million in capital and multiple years of developmental progress\r\nper candidate. The Ames assay detects a molecule’s mutagenic\r\npotential. Regulators now explicitly support the use of in silico\r\nAmes mutagenicity models through enabling legislation, dedicated FDA\r\nAI toxicology programs, internationally harmonized guidelines, and\r\nbenchmark challenges. However, current Ames models suffer from a sensitivity\r\ndrop-off when they evaluate molecules outside their training domain.\r\nThe out-of-domain (OOD) test set from the Second Ames/QSAR International\r\nChallenge Project yielded a participant average sensitivity of 0.46.\r\nSensitivity is the most important metric in Ames prediction because\r\nfalse negatives allow mutagenic compounds to advance undetected and\r\ntrigger the most costly late-stage failures. Attempts to fix this\r\nsensitivity drop-off often reduce overall model performance, which\r\ncan be represented by balanced accuracy (BA). For example, DeepAmes\r\nreports high levels of sensitivity (0.87) by sacrificing its BA (0.52).\r\nWe introduce AmesNet, a task-conditioned Ames model that achieves\r\nclass-leading performance in novel chemical spaces. AmesNet utilizes\r\na dual branch architecture containing a molecular encoder and a dedicated\r\nchannel to condition Ames assay context such as metabolic activation\r\nand bacterial strain type. In comparative benchmarks, AmesNet reached\r\na sensitivity of 0.72 (95% CI: 0.68–0.76) and a simultaneous\r\nBA of 0.81 (95% CI: 0.78–0.83) on the OOD test data. This performance\r\nimproves discrimination without the sensitivity trade-off limiting\r\nexisting approaches. Structural analysis demonstrates that AmesNet\r\nrecovers difficult-to-detect mutagenic compounds missed by existing\r\nmodels. This framework provides a high-confidence filtering mechanism\r\nthat enables drug developers to turn a costly late-stage safety bottleneck\r\ninto an earlier-stage mutagenicity triage.</p>","PeriodicalId":31,"journal":{"name":"Chemical Research in Toxicology","volume":"39 10","pages":"1946–1956"},"PeriodicalIF":4.1000,"publicationDate":"2026-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Chemical Research in Toxicology","FirstCategoryId":"3","ListUrlMain":"https://pubs.acs.org/doi/10.1021/acs.chemrestox.6c00082","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/6/29 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"CHEMISTRY, MEDICINAL","Score":null,"Total":0}
引用次数: 0

Abstract

Regulatory agencies require comprehensive genotoxicity assessments for novel small-molecule therapeutics prior to human trials. Developers often delay these studies until a candidate is nearing regulatory submission because they are expensive and secondary to bioactivity. This timing creates a bottleneck where late-stage failures can jeopardize >\$10 million in capital and multiple years of developmental progress per candidate. The Ames assay detects a molecule’s mutagenic potential. Regulators now explicitly support the use of in silico Ames mutagenicity models through enabling legislation, dedicated FDA AI toxicology programs, internationally harmonized guidelines, and benchmark challenges. However, current Ames models suffer from a sensitivity drop-off when they evaluate molecules outside their training domain. The out-of-domain (OOD) test set from the Second Ames/QSAR International Challenge Project yielded a participant average sensitivity of 0.46. Sensitivity is the most important metric in Ames prediction because false negatives allow mutagenic compounds to advance undetected and trigger the most costly late-stage failures. Attempts to fix this sensitivity drop-off often reduce overall model performance, which can be represented by balanced accuracy (BA). For example, DeepAmes reports high levels of sensitivity (0.87) by sacrificing its BA (0.52). We introduce AmesNet, a task-conditioned Ames model that achieves class-leading performance in novel chemical spaces. AmesNet utilizes a dual branch architecture containing a molecular encoder and a dedicated channel to condition Ames assay context such as metabolic activation and bacterial strain type. In comparative benchmarks, AmesNet reached a sensitivity of 0.72 (95% CI: 0.68–0.76) and a simultaneous BA of 0.81 (95% CI: 0.78–0.83) on the OOD test data. This performance improves discrimination without the sensitivity trade-off limiting existing approaches. Structural analysis demonstrates that AmesNet recovers difficult-to-detect mutagenic compounds missed by existing models. This framework provides a high-confidence filtering mechanism that enables drug developers to turn a costly late-stage safety bottleneck into an earlier-stage mutagenicity triage.

AmesNet:一种具有增强敏感性和泛化的任务条件深度学习模型在Ames致突变性预测中的应用。
监管机构要求在进行人体试验之前对新型小分子疗法进行全面的遗传毒性评估。开发人员通常会将这些研究推迟到候选药物接近监管提交时,因为它们价格昂贵且次于生物活性。这个时间点造成了一个瓶颈,后期的失败可能会危及1000万美元的资本和每个候选人多年的发展进展。艾姆斯试验检测分子的致突变潜能。监管机构现在通过立法、专门的FDA人工智能毒理学项目、国际统一的指导方针和基准挑战,明确支持使用计算机Ames诱变模型。然而,当前的Ames模型在评估训练域之外的分子时,会出现灵敏度下降的问题。来自第二Ames/QSAR国际挑战项目的域外(OOD)测试集的参与者平均灵敏度为0.46。灵敏度是Ames预测中最重要的指标,因为假阴性会使致突变化合物在未被发现的情况下发展,并引发最昂贵的后期失败。修复这种灵敏度下降的尝试通常会降低模型的整体性能,这可以用平衡精度(BA)来表示。例如,DeepAmes通过牺牲其BA(0.52)来报告高水平的灵敏度(0.87)。我们介绍了AmesNet,这是一种任务条件下的Ames模型,在新的化学空间中实现了一流的性能。AmesNet采用双分支架构,包含一个分子编码器和一个专用通道,以调节Ames试验环境,如代谢激活和细菌菌株类型。在比较基准中,AmesNet在OOD测试数据上的灵敏度为0.72 (95% CI: 0.68-0.76),同时BA为0.81 (95% CI: 0.78-0.83)。这种性能在不限制现有方法的敏感性权衡的情况下提高了辨别能力。结构分析表明,AmesNet恢复了现有模型遗漏的难以检测的致突变化合物。该框架提供了一种高可信度的过滤机制,使药物开发人员能够将代价高昂的后期安全瓶颈转化为早期突变性分诊。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
7.90
自引率
7.30%
发文量
215
审稿时长
3.5 months
期刊介绍: Chemical Research in Toxicology publishes Articles, Rapid Reports, Chemical Profiles, Reviews, Perspectives, Letters to the Editor, and ToxWatch on a wide range of topics in Toxicology that inform a chemical and molecular understanding and capacity to predict biological outcomes on the basis of structures and processes. The overarching goal of activities reported in the Journal are to provide knowledge and innovative approaches needed to promote intelligent solutions for human safety and ecosystem preservation. The journal emphasizes insight concerning mechanisms of toxicity over phenomenological observations. It upholds rigorous chemical, physical and mathematical standards for characterization and application of modern techniques.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书