Tyler J. Umansky, Virgil A. Woods, Sean M. Russell, Daniel J. Haders
{"title":"AmesNet:一种具有增强敏感性和泛化的任务条件深度学习模型在Ames致突变性预测中的应用。","authors":"Tyler J. Umansky, Virgil A. Woods, Sean M. Russell, Daniel J. Haders","doi":"10.1021/acs.chemrestox.6c00082","DOIUrl":null,"url":null,"abstract":"<p>Regulatory agencies require comprehensive genotoxicity\r\nassessments\r\nfor novel small-molecule therapeutics prior to human trials. Developers\r\noften delay these studies until a candidate is nearing regulatory\r\nsubmission because they are expensive and secondary to bioactivity.\r\nThis timing creates a bottleneck where late-stage failures can jeopardize\r\n>\\$10 million in capital and multiple years of developmental progress\r\nper candidate. The Ames assay detects a molecule’s mutagenic\r\npotential. Regulators now explicitly support the use of in silico\r\nAmes mutagenicity models through enabling legislation, dedicated FDA\r\nAI toxicology programs, internationally harmonized guidelines, and\r\nbenchmark challenges. However, current Ames models suffer from a sensitivity\r\ndrop-off when they evaluate molecules outside their training domain.\r\nThe out-of-domain (OOD) test set from the Second Ames/QSAR International\r\nChallenge Project yielded a participant average sensitivity of 0.46.\r\nSensitivity is the most important metric in Ames prediction because\r\nfalse negatives allow mutagenic compounds to advance undetected and\r\ntrigger the most costly late-stage failures. Attempts to fix this\r\nsensitivity drop-off often reduce overall model performance, which\r\ncan be represented by balanced accuracy (BA). For example, DeepAmes\r\nreports high levels of sensitivity (0.87) by sacrificing its BA (0.52).\r\nWe introduce AmesNet, a task-conditioned Ames model that achieves\r\nclass-leading performance in novel chemical spaces. AmesNet utilizes\r\na dual branch architecture containing a molecular encoder and a dedicated\r\nchannel to condition Ames assay context such as metabolic activation\r\nand bacterial strain type. In comparative benchmarks, AmesNet reached\r\na sensitivity of 0.72 (95% CI: 0.68–0.76) and a simultaneous\r\nBA of 0.81 (95% CI: 0.78–0.83) on the OOD test data. This performance\r\nimproves discrimination without the sensitivity trade-off limiting\r\nexisting approaches. Structural analysis demonstrates that AmesNet\r\nrecovers difficult-to-detect mutagenic compounds missed by existing\r\nmodels. This framework provides a high-confidence filtering mechanism\r\nthat enables drug developers to turn a costly late-stage safety bottleneck\r\ninto an earlier-stage mutagenicity triage.</p>","PeriodicalId":31,"journal":{"name":"Chemical Research in Toxicology","volume":"39 10","pages":"1946–1956"},"PeriodicalIF":4.1000,"publicationDate":"2026-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"AmesNet: A Task-Conditioned Deep Learning Model with Enhanced Sensitivity and Generalization in Ames Mutagenicity Prediction\",\"authors\":\"Tyler J. Umansky, Virgil A. Woods, Sean M. Russell, Daniel J. Haders\",\"doi\":\"10.1021/acs.chemrestox.6c00082\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Regulatory agencies require comprehensive genotoxicity\\r\\nassessments\\r\\nfor novel small-molecule therapeutics prior to human trials. Developers\\r\\noften delay these studies until a candidate is nearing regulatory\\r\\nsubmission because they are expensive and secondary to bioactivity.\\r\\nThis timing creates a bottleneck where late-stage failures can jeopardize\\r\\n>\\\\$10 million in capital and multiple years of developmental progress\\r\\nper candidate. The Ames assay detects a molecule’s mutagenic\\r\\npotential. Regulators now explicitly support the use of in silico\\r\\nAmes mutagenicity models through enabling legislation, dedicated FDA\\r\\nAI toxicology programs, internationally harmonized guidelines, and\\r\\nbenchmark challenges. However, current Ames models suffer from a sensitivity\\r\\ndrop-off when they evaluate molecules outside their training domain.\\r\\nThe out-of-domain (OOD) test set from the Second Ames/QSAR International\\r\\nChallenge Project yielded a participant average sensitivity of 0.46.\\r\\nSensitivity is the most important metric in Ames prediction because\\r\\nfalse negatives allow mutagenic compounds to advance undetected and\\r\\ntrigger the most costly late-stage failures. Attempts to fix this\\r\\nsensitivity drop-off often reduce overall model performance, which\\r\\ncan be represented by balanced accuracy (BA). For example, DeepAmes\\r\\nreports high levels of sensitivity (0.87) by sacrificing its BA (0.52).\\r\\nWe introduce AmesNet, a task-conditioned Ames model that achieves\\r\\nclass-leading performance in novel chemical spaces. AmesNet utilizes\\r\\na dual branch architecture containing a molecular encoder and a dedicated\\r\\nchannel to condition Ames assay context such as metabolic activation\\r\\nand bacterial strain type. In comparative benchmarks, AmesNet reached\\r\\na sensitivity of 0.72 (95% CI: 0.68–0.76) and a simultaneous\\r\\nBA of 0.81 (95% CI: 0.78–0.83) on the OOD test data. This performance\\r\\nimproves discrimination without the sensitivity trade-off limiting\\r\\nexisting approaches. Structural analysis demonstrates that AmesNet\\r\\nrecovers difficult-to-detect mutagenic compounds missed by existing\\r\\nmodels. This framework provides a high-confidence filtering mechanism\\r\\nthat enables drug developers to turn a costly late-stage safety bottleneck\\r\\ninto an earlier-stage mutagenicity triage.</p>\",\"PeriodicalId\":31,\"journal\":{\"name\":\"Chemical Research in Toxicology\",\"volume\":\"39 10\",\"pages\":\"1946–1956\"},\"PeriodicalIF\":4.1000,\"publicationDate\":\"2026-10-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Chemical Research in Toxicology\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://pubs.acs.org/doi/10.1021/acs.chemrestox.6c00082\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2026/6/29 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q2\",\"JCRName\":\"CHEMISTRY, MEDICINAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Chemical Research in Toxicology","FirstCategoryId":"3","ListUrlMain":"https://pubs.acs.org/doi/10.1021/acs.chemrestox.6c00082","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/6/29 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"CHEMISTRY, MEDICINAL","Score":null,"Total":0}
AmesNet: A Task-Conditioned Deep Learning Model with Enhanced Sensitivity and Generalization in Ames Mutagenicity Prediction
Regulatory agencies require comprehensive genotoxicity
assessments
for novel small-molecule therapeutics prior to human trials. Developers
often delay these studies until a candidate is nearing regulatory
submission because they are expensive and secondary to bioactivity.
This timing creates a bottleneck where late-stage failures can jeopardize
>\$10 million in capital and multiple years of developmental progress
per candidate. The Ames assay detects a molecule’s mutagenic
potential. Regulators now explicitly support the use of in silico
Ames mutagenicity models through enabling legislation, dedicated FDA
AI toxicology programs, internationally harmonized guidelines, and
benchmark challenges. However, current Ames models suffer from a sensitivity
drop-off when they evaluate molecules outside their training domain.
The out-of-domain (OOD) test set from the Second Ames/QSAR International
Challenge Project yielded a participant average sensitivity of 0.46.
Sensitivity is the most important metric in Ames prediction because
false negatives allow mutagenic compounds to advance undetected and
trigger the most costly late-stage failures. Attempts to fix this
sensitivity drop-off often reduce overall model performance, which
can be represented by balanced accuracy (BA). For example, DeepAmes
reports high levels of sensitivity (0.87) by sacrificing its BA (0.52).
We introduce AmesNet, a task-conditioned Ames model that achieves
class-leading performance in novel chemical spaces. AmesNet utilizes
a dual branch architecture containing a molecular encoder and a dedicated
channel to condition Ames assay context such as metabolic activation
and bacterial strain type. In comparative benchmarks, AmesNet reached
a sensitivity of 0.72 (95% CI: 0.68–0.76) and a simultaneous
BA of 0.81 (95% CI: 0.78–0.83) on the OOD test data. This performance
improves discrimination without the sensitivity trade-off limiting
existing approaches. Structural analysis demonstrates that AmesNet
recovers difficult-to-detect mutagenic compounds missed by existing
models. This framework provides a high-confidence filtering mechanism
that enables drug developers to turn a costly late-stage safety bottleneck
into an earlier-stage mutagenicity triage.
期刊介绍:
Chemical Research in Toxicology publishes Articles, Rapid Reports, Chemical Profiles, Reviews, Perspectives, Letters to the Editor, and ToxWatch on a wide range of topics in Toxicology that inform a chemical and molecular understanding and capacity to predict biological outcomes on the basis of structures and processes. The overarching goal of activities reported in the Journal are to provide knowledge and innovative approaches needed to promote intelligent solutions for human safety and ecosystem preservation. The journal emphasizes insight concerning mechanisms of toxicity over phenomenological observations. It upholds rigorous chemical, physical and mathematical standards for characterization and application of modern techniques.