{"title":"Benchmarking antibody discovery fidelity and reproducibility with an assay-locked residue fidelity index.","authors":"Michael P Weiner","doi":"10.1080/07366205.2026.2619165","DOIUrl":null,"url":null,"abstract":"<p><p>Reproducibility in antibody discovery is undermined by dropout, paratope degeneracy, and immunogen imprinting. Although guidelines exist, the field lacks a shared, assay-locked metric to benchmark these liabilities across discovery pipelines. We propose the Residue Fidelity Index (RFI), a discovery-stage, within-assay comparative framework that consolidates fidelity liabilities into a single score. Assay-locked means RFI is comparable only within a fully specified assay configuration, uses fixed normalization and weights, and requires co-reporting of component metrics to expose drivers of the composite. RFI is not intended as a universal or optimal standard, but as one implementable example meeting basic benchmarking requirements: defined components, fixed assay context, pre-specified weights, and primary-data disclosure. RFI is reported alongside its components (D, G, I) to visualize reproducibility in parallel with affinity, humanization, and yield. To demonstrate feasibility, we applied RFI in a simulated Epivolve testbed derived from multiple studies, embedding MILKSHAKE (context retention) and Sundae (residue discrimination) validation modules into discovery. Across three campaigns (n = 25 clones), antibodies meeting provisional thresholds (dropout ≤10%, degeneracy ≤0.10, no imprinting) yielded RFI values from 0.610 to 0.982 (mean ± SD 0.922 ± 0.103; I = 1 for clones C04 and C20). These results show how fidelity can be consolidated to prioritize candidates before application-specific cellular validation. Despite limited scope and proprietary immunogens, this work provides a proof of concept for residue-level benchmarking, with per-clone primary values and RFI reported in Supplementary Table S1 for auditability.</p>","PeriodicalId":8945,"journal":{"name":"BioTechniques","volume":"77 11-12","pages":"1-9"},"PeriodicalIF":2.6000,"publicationDate":"2025-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12994182/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"BioTechniques","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1080/07366205.2026.2619165","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/1/29 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"BIOCHEMICAL RESEARCH METHODS","Score":null,"Total":0}
引用次数: 0
Abstract
Reproducibility in antibody discovery is undermined by dropout, paratope degeneracy, and immunogen imprinting. Although guidelines exist, the field lacks a shared, assay-locked metric to benchmark these liabilities across discovery pipelines. We propose the Residue Fidelity Index (RFI), a discovery-stage, within-assay comparative framework that consolidates fidelity liabilities into a single score. Assay-locked means RFI is comparable only within a fully specified assay configuration, uses fixed normalization and weights, and requires co-reporting of component metrics to expose drivers of the composite. RFI is not intended as a universal or optimal standard, but as one implementable example meeting basic benchmarking requirements: defined components, fixed assay context, pre-specified weights, and primary-data disclosure. RFI is reported alongside its components (D, G, I) to visualize reproducibility in parallel with affinity, humanization, and yield. To demonstrate feasibility, we applied RFI in a simulated Epivolve testbed derived from multiple studies, embedding MILKSHAKE (context retention) and Sundae (residue discrimination) validation modules into discovery. Across three campaigns (n = 25 clones), antibodies meeting provisional thresholds (dropout ≤10%, degeneracy ≤0.10, no imprinting) yielded RFI values from 0.610 to 0.982 (mean ± SD 0.922 ± 0.103; I = 1 for clones C04 and C20). These results show how fidelity can be consolidated to prioritize candidates before application-specific cellular validation. Despite limited scope and proprietary immunogens, this work provides a proof of concept for residue-level benchmarking, with per-clone primary values and RFI reported in Supplementary Table S1 for auditability.
期刊介绍:
BioTechniques is a peer-reviewed, open-access journal dedicated to publishing original laboratory methods, related technical and software tools, and methods-oriented review articles that are of broad interest to professional life scientists, as well as to scientists from other disciplines (e.g., chemistry, physics, computer science, plant and agricultural science and climate science) interested in life science applications for their technologies.
Since 1983, BioTechniques has been a leading peer-reviewed journal for methods-related research. The journal considers:
Reports describing innovative new methods, platforms and software, substantive modifications to existing methods, or innovative applications of existing methods, techniques & tools to new models or scientific questions
Descriptions of technical tools that facilitate the design or performance of experiments or data analysis, such as software and simple laboratory devices
Surveys of technical approaches related to broad fields of research
Reviews discussing advancements in techniques and methods related to broad fields of research
Letters to the Editor and Expert Opinions highlighting interesting observations or cautionary tales concerning experimental design, methodology or analysis.