Systematic Profiling of Encoder Architectures and Multimodal Embeddings in Protein Foundation Models Reveals Data Set-Driven Separability Regimes in Prediction of Allosteric and Orthosteric Binding Sites

IF 6.4 2区 化学 Q1 CHEMISTRY, MEDICINAL
Alina Bazarova, Gennady M. Verkhivker
{"title":"Systematic Profiling of Encoder Architectures and Multimodal Embeddings in Protein Foundation Models Reveals Data Set-Driven Separability Regimes in Prediction of Allosteric and Orthosteric Binding Sites","authors":"Alina Bazarova,&nbsp;Gennady M. Verkhivker","doi":"10.1021/acs.jcim.6c03114","DOIUrl":null,"url":null,"abstract":"<p>Allosteric regulation represents a fundamental mechanism\r\nof protein\r\nfunction, yet distinguishing allosteric from orthosteric protein-binding\r\nsites remains a persistent computational challenge. While multimodal\r\nprotein foundation models offer the potential to integrate complementary\r\nbiological signals, including sequence, structure, functional annotations,\r\nand conformational dynamics, their performance determinants in allosteric\r\nbinding site detection remain poorly understood. We introduce a unified\r\ncomputational framework for profiling multimodal protein foundation\r\nmodels across distinct binding site separability regimes. Rather than\r\nevaluating models solely by predictive accuracy, the framework combines\r\nsystematic modality embedding ablations, encoder architecture comparisons,\r\nand variance decomposition to characterize how evolutionary, structural,\r\nfunctional, and dynamical information contributes to allosteric site\r\ndiscrimination. Using the OneProt multimodal model, we evaluate two\r\ncomplementary levels of multimodal integration: (a) encoder architectures\r\nthat differ in the modalities incorporated during pretraining and\r\n(b) downstream combinations of pocket, sequence, and text embeddings\r\nused for classification. To systematically probe the determinants\r\nof model performance, we benchmark these configurations across four\r\nassembled data sets of protein complexes representing a spectrum of\r\nbiological complexity and a range of structural, dynamic, and evolutionary\r\ncontexts for orthosteric and allosteric binding sites. Through comprehensive\r\nembedding ablations, encoder architecture comparisons, and variance\r\ndecomposition, we demonstrate that model performance is governed primarily\r\nby intrinsic data set properties rather than architectural complexity,\r\nwith data set identity accounting for 63.7% of explainable variance.\r\nAcross the data sets examined, we identify substantial differences\r\nnot only in overall separability but also in the information accessible\r\nfrom different pretrained representations. Single-modality controls\r\nshow that high predictive performance does not necessarily imply reliance\r\non the explicitly provided pocket representation: depending on data\r\nset composition, substantial discrimination can already be obtained\r\nfrom sequence- or text-based multimodal representations. Within-protein\r\ncomparisons nevertheless demonstrate that pocket-containing representations\r\nretain binding site-specific discriminatory information when protein\r\nidentity and the associated sequence and text representations are\r\nheld constant. At the encoder level, structural and molecular dynamics\r\nencoders provide the greatest benefit in intermediate and high separability\r\nsettings. Example-level analysis further shows that combining data\r\nsets can reshape which binding sites are preferentially recognized.\r\nThese findings establish that the success of multimodal foundation\r\nmodels depends critically on alignment between available modalities\r\nand the biological signatures that distinguish regulatory classes\r\nin each data set.</p>","PeriodicalId":44,"journal":{"name":"Journal of Chemical Information and Modeling ","volume":"66 21","pages":"13913–13937"},"PeriodicalIF":6.4000,"publicationDate":"2026-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Chemical Information and Modeling ","FirstCategoryId":"92","ListUrlMain":"https://pubs.acs.org/doi/10.1021/acs.jcim.6c03114","RegionNum":2,"RegionCategory":"化学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/10/26 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"CHEMISTRY, MEDICINAL","Score":null,"Total":0}
引用次数: 0

Abstract

Allosteric regulation represents a fundamental mechanism of protein function, yet distinguishing allosteric from orthosteric protein-binding sites remains a persistent computational challenge. While multimodal protein foundation models offer the potential to integrate complementary biological signals, including sequence, structure, functional annotations, and conformational dynamics, their performance determinants in allosteric binding site detection remain poorly understood. We introduce a unified computational framework for profiling multimodal protein foundation models across distinct binding site separability regimes. Rather than evaluating models solely by predictive accuracy, the framework combines systematic modality embedding ablations, encoder architecture comparisons, and variance decomposition to characterize how evolutionary, structural, functional, and dynamical information contributes to allosteric site discrimination. Using the OneProt multimodal model, we evaluate two complementary levels of multimodal integration: (a) encoder architectures that differ in the modalities incorporated during pretraining and (b) downstream combinations of pocket, sequence, and text embeddings used for classification. To systematically probe the determinants of model performance, we benchmark these configurations across four assembled data sets of protein complexes representing a spectrum of biological complexity and a range of structural, dynamic, and evolutionary contexts for orthosteric and allosteric binding sites. Through comprehensive embedding ablations, encoder architecture comparisons, and variance decomposition, we demonstrate that model performance is governed primarily by intrinsic data set properties rather than architectural complexity, with data set identity accounting for 63.7% of explainable variance. Across the data sets examined, we identify substantial differences not only in overall separability but also in the information accessible from different pretrained representations. Single-modality controls show that high predictive performance does not necessarily imply reliance on the explicitly provided pocket representation: depending on data set composition, substantial discrimination can already be obtained from sequence- or text-based multimodal representations. Within-protein comparisons nevertheless demonstrate that pocket-containing representations retain binding site-specific discriminatory information when protein identity and the associated sequence and text representations are held constant. At the encoder level, structural and molecular dynamics encoders provide the greatest benefit in intermediate and high separability settings. Example-level analysis further shows that combining data sets can reshape which binding sites are preferentially recognized. These findings establish that the success of multimodal foundation models depends critically on alignment between available modalities and the biological signatures that distinguish regulatory classes in each data set.

Abstract Image

Abstract Image

蛋白质基础模型中编码器结构和多模态嵌入的系统分析揭示了数据集驱动的可分离性机制在预测变构和正构结合位点中的作用
变构调节是蛋白质功能的基本机制,然而区分变构和正构蛋白结合位点仍然是一个持续的计算挑战。虽然多模态蛋白质基础模型提供了整合互补生物信号的潜力,包括序列、结构、功能注释和构象动力学,但它们在变构结合位点检测中的性能决定因素仍然知之甚少。我们引入了一个统一的计算框架来分析跨不同结合位点可分离性制度的多模态蛋白质基础模型。该框架结合了系统模态嵌入消蚀、编码器架构比较和方差分解,而不是仅仅通过预测准确性来评估模型,以表征进化、结构、功能和动态信息如何有助于变构位点的区分。使用OneProt多模态模型,我们评估了多模态集成的两个互补级别:(a)在预训练期间合并的模式不同的编码器架构;(b)用于分类的口袋、序列和文本嵌入的下游组合。为了系统地探索模型性能的决定因素,我们在四个组装的蛋白质复合物数据集上对这些配置进行基准测试,这些数据集代表了生物复杂性的光谱,以及正构和变构结合位点的一系列结构、动态和进化背景。通过全面的嵌入消蚀、编码器架构比较和方差分解,我们证明模型性能主要由数据集的内在属性而不是架构复杂性控制,数据集同一性占可解释方差的63.7%。在检查的数据集中,我们不仅在总体可分离性方面,而且在从不同的预训练表示中可访问的信息方面发现了实质性的差异。单模态控制表明,高预测性能并不一定意味着依赖于明确提供的口袋表示:根据数据集组成,已经可以从基于序列或文本的多模态表示中获得实质性的区分。然而,蛋白质内部比较表明,当蛋白质身份和相关的序列和文本表示保持不变时,含有口袋的表示保留了结合位点特异性的歧视性信息。在编码器水平上,结构和分子动力学编码器在中间和高分离设置中提供了最大的好处。实例分析进一步表明,结合数据集可以重塑优先识别的结合位点。这些发现表明,多模式基础模型的成功关键取决于可用模式和生物特征之间的一致性,这些特征区分了每个数据集中的调控类别。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
9.80
自引率
10.70%
发文量
529
审稿时长
1.4 months
期刊介绍: The Journal of Chemical Information and Modeling publishes papers reporting new methodology and/or important applications in the fields of chemical informatics and molecular modeling. Specific topics include the representation and computer-based searching of chemical databases, molecular modeling, computer-aided molecular design of new materials, catalysts, or ligands, development of new computational methods or efficient algorithms for chemical software, and biopharmaceutical chemistry including analyses of biological activity and other issues related to drug discovery. Astute chemists, computer scientists, and information specialists look to this monthly’s insightful research studies, programming innovations, and software reviews to keep current with advances in this integral, multidisciplinary field. As a subscriber you’ll stay abreast of database search systems, use of graph theory in chemical problems, substructure search systems, pattern recognition and clustering, analysis of chemical and physical data, molecular modeling, graphics and natural language interfaces, bibliometric and citation analysis, and synthesis design and reactions databases.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书