Yi Cai,Qian Zhang,Wenchong Tan,Jing Li,Dong Chen,Xiaoyun Lu,Hongli Du
{"title":"使用预训练变压器模型和多任务学习的综合药物相似性预测。","authors":"Yi Cai,Qian Zhang,Wenchong Tan,Jing Li,Dong Chen,Xiaoyun Lu,Hongli Du","doi":"10.1021/acs.jcim.5c00455","DOIUrl":null,"url":null,"abstract":"Drug-likeness is essential in drug discovery, indicating the potential of a compound to become a successful therapeutic. However, existing rule-based and machine learning methods are limited by their reliance on hand-crafted features, poor generalizability across chemical spaces, and insufficient adaptability to the diverse contexts of drug development. To overcome these limitations, we introduce an innovative framework that integrates molecular pretrained transformer models with multitask learning. This approach enables the simultaneous capture of complex chemical features and facilitates knowledge sharing across related prediction tasks. Our framework features two models: SpecDL, tailored for specialized drug-likeness assessments, and GeneralDL, designed for comprehensive, cross-data set evaluation. SpecDL achieved an average ROC-AUC of 0.836 across four tasks, while GeneralDL reached an average ROC-AUC of 0.781 on six internal and external test sets, both surpassing the leading existing methods. Furthermore, GeneralDL demonstrated robust generalization to toxicity and biological activity predictions and provided interpretable outputs via attention weight analysis. These results establish our framework as a powerful, generalizable tool for drug-likeness prediction with significant potential to enhance early-stage drug discovery.","PeriodicalId":44,"journal":{"name":"Journal of Chemical Information and Modeling ","volume":"31 1","pages":""},"PeriodicalIF":5.3000,"publicationDate":"2025-05-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Comprehensive Drug-Likeness Prediction Using a Pretrained Transformer Model and Multitask Learning.\",\"authors\":\"Yi Cai,Qian Zhang,Wenchong Tan,Jing Li,Dong Chen,Xiaoyun Lu,Hongli Du\",\"doi\":\"10.1021/acs.jcim.5c00455\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Drug-likeness is essential in drug discovery, indicating the potential of a compound to become a successful therapeutic. However, existing rule-based and machine learning methods are limited by their reliance on hand-crafted features, poor generalizability across chemical spaces, and insufficient adaptability to the diverse contexts of drug development. To overcome these limitations, we introduce an innovative framework that integrates molecular pretrained transformer models with multitask learning. This approach enables the simultaneous capture of complex chemical features and facilitates knowledge sharing across related prediction tasks. Our framework features two models: SpecDL, tailored for specialized drug-likeness assessments, and GeneralDL, designed for comprehensive, cross-data set evaluation. SpecDL achieved an average ROC-AUC of 0.836 across four tasks, while GeneralDL reached an average ROC-AUC of 0.781 on six internal and external test sets, both surpassing the leading existing methods. Furthermore, GeneralDL demonstrated robust generalization to toxicity and biological activity predictions and provided interpretable outputs via attention weight analysis. These results establish our framework as a powerful, generalizable tool for drug-likeness prediction with significant potential to enhance early-stage drug discovery.\",\"PeriodicalId\":44,\"journal\":{\"name\":\"Journal of Chemical Information and Modeling \",\"volume\":\"31 1\",\"pages\":\"\"},\"PeriodicalIF\":5.3000,\"publicationDate\":\"2025-05-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Chemical Information and Modeling \",\"FirstCategoryId\":\"92\",\"ListUrlMain\":\"https://doi.org/10.1021/acs.jcim.5c00455\",\"RegionNum\":2,\"RegionCategory\":\"化学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"CHEMISTRY, MEDICINAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Chemical Information and Modeling ","FirstCategoryId":"92","ListUrlMain":"https://doi.org/10.1021/acs.jcim.5c00455","RegionNum":2,"RegionCategory":"化学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CHEMISTRY, MEDICINAL","Score":null,"Total":0}
Comprehensive Drug-Likeness Prediction Using a Pretrained Transformer Model and Multitask Learning.
Drug-likeness is essential in drug discovery, indicating the potential of a compound to become a successful therapeutic. However, existing rule-based and machine learning methods are limited by their reliance on hand-crafted features, poor generalizability across chemical spaces, and insufficient adaptability to the diverse contexts of drug development. To overcome these limitations, we introduce an innovative framework that integrates molecular pretrained transformer models with multitask learning. This approach enables the simultaneous capture of complex chemical features and facilitates knowledge sharing across related prediction tasks. Our framework features two models: SpecDL, tailored for specialized drug-likeness assessments, and GeneralDL, designed for comprehensive, cross-data set evaluation. SpecDL achieved an average ROC-AUC of 0.836 across four tasks, while GeneralDL reached an average ROC-AUC of 0.781 on six internal and external test sets, both surpassing the leading existing methods. Furthermore, GeneralDL demonstrated robust generalization to toxicity and biological activity predictions and provided interpretable outputs via attention weight analysis. These results establish our framework as a powerful, generalizable tool for drug-likeness prediction with significant potential to enhance early-stage drug discovery.
期刊介绍:
The Journal of Chemical Information and Modeling publishes papers reporting new methodology and/or important applications in the fields of chemical informatics and molecular modeling. Specific topics include the representation and computer-based searching of chemical databases, molecular modeling, computer-aided molecular design of new materials, catalysts, or ligands, development of new computational methods or efficient algorithms for chemical software, and biopharmaceutical chemistry including analyses of biological activity and other issues related to drug discovery.
Astute chemists, computer scientists, and information specialists look to this monthly’s insightful research studies, programming innovations, and software reviews to keep current with advances in this integral, multidisciplinary field.
As a subscriber you’ll stay abreast of database search systems, use of graph theory in chemical problems, substructure search systems, pattern recognition and clustering, analysis of chemical and physical data, molecular modeling, graphics and natural language interfaces, bibliometric and citation analysis, and synthesis design and reactions databases.