Benchmarking antibody discovery fidelity and reproducibility with an assay-locked residue fidelity index.

IF 2.6 4区 工程技术 Q3 BIOCHEMICAL RESEARCH METHODS
BioTechniques Pub Date : 2025-11-01 Epub Date: 2026-01-29 DOI:10.1080/07366205.2026.2619165
Michael P Weiner
{"title":"Benchmarking antibody discovery fidelity and reproducibility with an assay-locked residue fidelity index.","authors":"Michael P Weiner","doi":"10.1080/07366205.2026.2619165","DOIUrl":null,"url":null,"abstract":"<p><p>Reproducibility in antibody discovery is undermined by dropout, paratope degeneracy, and immunogen imprinting. Although guidelines exist, the field lacks a shared, assay-locked metric to benchmark these liabilities across discovery pipelines. We propose the Residue Fidelity Index (RFI), a discovery-stage, within-assay comparative framework that consolidates fidelity liabilities into a single score. Assay-locked means RFI is comparable only within a fully specified assay configuration, uses fixed normalization and weights, and requires co-reporting of component metrics to expose drivers of the composite. RFI is not intended as a universal or optimal standard, but as one implementable example meeting basic benchmarking requirements: defined components, fixed assay context, pre-specified weights, and primary-data disclosure. RFI is reported alongside its components (D, G, I) to visualize reproducibility in parallel with affinity, humanization, and yield. To demonstrate feasibility, we applied RFI in a simulated Epivolve testbed derived from multiple studies, embedding MILKSHAKE (context retention) and Sundae (residue discrimination) validation modules into discovery. Across three campaigns (n = 25 clones), antibodies meeting provisional thresholds (dropout ≤10%, degeneracy ≤0.10, no imprinting) yielded RFI values from 0.610 to 0.982 (mean ± SD 0.922 ± 0.103; I = 1 for clones C04 and C20). These results show how fidelity can be consolidated to prioritize candidates before application-specific cellular validation. Despite limited scope and proprietary immunogens, this work provides a proof of concept for residue-level benchmarking, with per-clone primary values and RFI reported in Supplementary Table S1 for auditability.</p>","PeriodicalId":8945,"journal":{"name":"BioTechniques","volume":"77 11-12","pages":"1-9"},"PeriodicalIF":2.6000,"publicationDate":"2025-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12994182/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"BioTechniques","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1080/07366205.2026.2619165","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/1/29 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"BIOCHEMICAL RESEARCH METHODS","Score":null,"Total":0}
引用次数: 0

Abstract

Reproducibility in antibody discovery is undermined by dropout, paratope degeneracy, and immunogen imprinting. Although guidelines exist, the field lacks a shared, assay-locked metric to benchmark these liabilities across discovery pipelines. We propose the Residue Fidelity Index (RFI), a discovery-stage, within-assay comparative framework that consolidates fidelity liabilities into a single score. Assay-locked means RFI is comparable only within a fully specified assay configuration, uses fixed normalization and weights, and requires co-reporting of component metrics to expose drivers of the composite. RFI is not intended as a universal or optimal standard, but as one implementable example meeting basic benchmarking requirements: defined components, fixed assay context, pre-specified weights, and primary-data disclosure. RFI is reported alongside its components (D, G, I) to visualize reproducibility in parallel with affinity, humanization, and yield. To demonstrate feasibility, we applied RFI in a simulated Epivolve testbed derived from multiple studies, embedding MILKSHAKE (context retention) and Sundae (residue discrimination) validation modules into discovery. Across three campaigns (n = 25 clones), antibodies meeting provisional thresholds (dropout ≤10%, degeneracy ≤0.10, no imprinting) yielded RFI values from 0.610 to 0.982 (mean ± SD 0.922 ± 0.103; I = 1 for clones C04 and C20). These results show how fidelity can be consolidated to prioritize candidates before application-specific cellular validation. Despite limited scope and proprietary immunogens, this work provides a proof of concept for residue-level benchmarking, with per-clone primary values and RFI reported in Supplementary Table S1 for auditability.

Abstract Image

Abstract Image

Abstract Image

用测定锁定的残留保真度指数对抗体发现保真度和再现性进行基准测试。
抗体发现的可重复性受到dropout、paratope退化和免疫原印记的破坏。尽管存在指导方针,但该领域缺乏一个共享的、分析锁定的指标来对发现管道中的这些责任进行基准测试。我们提出了残留保真度指数(RFI),这是一个发现阶段,在分析比较框架内将保真度负债合并为单个分数。分析锁定意味着RFI只能在完全指定的分析配置中进行比较,使用固定的归一化和权重,并且需要共同报告组件指标以暴露组合的驱动因素。RFI不是一个通用的或最佳的标准,而是一个可实现的例子,满足基本的基准要求:定义的成分,固定的分析环境,预先指定的重量,和原始数据披露。RFI与其组分(D, G, I)一起报道,以可视化再现性,亲和性,人性化和产量。为了证明可行性,我们在多个研究得出的模拟Epivolve测试平台中应用了RFI,将MILKSHAKE(上下文保留)和Sundae(残留识别)验证模块嵌入到发现中。在三个运动(n = 25个克隆)中,满足临时阈值(dropout≤10%,简并度≤0.10,无印迹)的抗体产生的RFI值从0.610到0.982(平均值±SD 0.922±0.103;克隆C04和C20的I = 1)。这些结果表明,在特定应用的蜂窝验证之前,如何巩固保真度以优先考虑候选者。尽管有限的范围和专有的免疫原,这项工作提供了残留物水平基准测试的概念证明,每个克隆的初级值和RFI报告在补充表S1中进行可审计性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
BioTechniques
BioTechniques 工程技术-生化研究方法
CiteScore
4.40
自引率
0.00%
发文量
68
审稿时长
3.3 months
期刊介绍: BioTechniques is a peer-reviewed, open-access journal dedicated to publishing original laboratory methods, related technical and software tools, and methods-oriented review articles that are of broad interest to professional life scientists, as well as to scientists from other disciplines (e.g., chemistry, physics, computer science, plant and agricultural science and climate science) interested in life science applications for their technologies. Since 1983, BioTechniques has been a leading peer-reviewed journal for methods-related research. The journal considers: Reports describing innovative new methods, platforms and software, substantive modifications to existing methods, or innovative applications of existing methods, techniques & tools to new models or scientific questions Descriptions of technical tools that facilitate the design or performance of experiments or data analysis, such as software and simple laboratory devices Surveys of technical approaches related to broad fields of research Reviews discussing advancements in techniques and methods related to broad fields of research Letters to the Editor and Expert Opinions highlighting interesting observations or cautionary tales concerning experimental design, methodology or analysis.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书