{"title":"用强化学习重新设计具有特定性质的聚合物","authors":"Haifan Zhou, Yue Fang, Linyan Li, Pingwei Liu, Hanyu Gao","doi":"10.1021/acs.macromol.5c00427","DOIUrl":null,"url":null,"abstract":"Designing polymers with specified properties is crucial for industries such as aerospace, automotive, and construction, where high yield strength is necessary for stability and performance. Traditionally, the design of polymers has relied on decades of trial-and-error experiments that are time-consuming and inefficient. While recent advancements in computational methods have emerged as promising tools for polymer design, they predominantly focus on property prediction or unbiased polymer generation and do not fully progress toward the tailored design of novel polymer structures that meet specific performance criteria. To accelerate the exploration of new high-performance polymers, we proposed Reinforcement Learning for Polymer Generation (RLPolyG), an integrated goal-oriented exploration workflow for de novo polymer design with specified properties. This framework employs a forward model for predicting polymer properties and an inverse model optimized via reinforcement learning to generate polymers with specific yield strength. Our forward model achieved an <i>R</i><sup>2</sup> of 0.84 in predicting yield strength, enabling the inverse model to generate 4991 novel polymer candidates, resulting in a significant 45.20% improvement in average yield strength. We further screened these candidates based on synthetic accessibility (SA) scores and degradability, identifying 3099 polymers with excellent feasibility for synthesis and degradation performance. Finally, we validated the nine top-performing polymers through molecular dynamics (MD) simulations, which showed an average related error of 14.64% between the predicted and MD-validated values. This work demonstrates the potential of using reinforcement learning to transform polymer design, providing a systematic and efficient pathway to explore the vast polymer space and accelerate the discovery of materials tailored to meet specific industrial needs.","PeriodicalId":51,"journal":{"name":"Macromolecules","volume":"2020 1","pages":""},"PeriodicalIF":5.1000,"publicationDate":"2025-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"De Novo Design of Polymers with Specified Properties Using Reinforcement Learning\",\"authors\":\"Haifan Zhou, Yue Fang, Linyan Li, Pingwei Liu, Hanyu Gao\",\"doi\":\"10.1021/acs.macromol.5c00427\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Designing polymers with specified properties is crucial for industries such as aerospace, automotive, and construction, where high yield strength is necessary for stability and performance. Traditionally, the design of polymers has relied on decades of trial-and-error experiments that are time-consuming and inefficient. While recent advancements in computational methods have emerged as promising tools for polymer design, they predominantly focus on property prediction or unbiased polymer generation and do not fully progress toward the tailored design of novel polymer structures that meet specific performance criteria. To accelerate the exploration of new high-performance polymers, we proposed Reinforcement Learning for Polymer Generation (RLPolyG), an integrated goal-oriented exploration workflow for de novo polymer design with specified properties. This framework employs a forward model for predicting polymer properties and an inverse model optimized via reinforcement learning to generate polymers with specific yield strength. Our forward model achieved an <i>R</i><sup>2</sup> of 0.84 in predicting yield strength, enabling the inverse model to generate 4991 novel polymer candidates, resulting in a significant 45.20% improvement in average yield strength. We further screened these candidates based on synthetic accessibility (SA) scores and degradability, identifying 3099 polymers with excellent feasibility for synthesis and degradation performance. Finally, we validated the nine top-performing polymers through molecular dynamics (MD) simulations, which showed an average related error of 14.64% between the predicted and MD-validated values. This work demonstrates the potential of using reinforcement learning to transform polymer design, providing a systematic and efficient pathway to explore the vast polymer space and accelerate the discovery of materials tailored to meet specific industrial needs.\",\"PeriodicalId\":51,\"journal\":{\"name\":\"Macromolecules\",\"volume\":\"2020 1\",\"pages\":\"\"},\"PeriodicalIF\":5.1000,\"publicationDate\":\"2025-05-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Macromolecules\",\"FirstCategoryId\":\"92\",\"ListUrlMain\":\"https://doi.org/10.1021/acs.macromol.5c00427\",\"RegionNum\":1,\"RegionCategory\":\"化学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"POLYMER SCIENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Macromolecules","FirstCategoryId":"92","ListUrlMain":"https://doi.org/10.1021/acs.macromol.5c00427","RegionNum":1,"RegionCategory":"化学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"POLYMER SCIENCE","Score":null,"Total":0}
De Novo Design of Polymers with Specified Properties Using Reinforcement Learning
Designing polymers with specified properties is crucial for industries such as aerospace, automotive, and construction, where high yield strength is necessary for stability and performance. Traditionally, the design of polymers has relied on decades of trial-and-error experiments that are time-consuming and inefficient. While recent advancements in computational methods have emerged as promising tools for polymer design, they predominantly focus on property prediction or unbiased polymer generation and do not fully progress toward the tailored design of novel polymer structures that meet specific performance criteria. To accelerate the exploration of new high-performance polymers, we proposed Reinforcement Learning for Polymer Generation (RLPolyG), an integrated goal-oriented exploration workflow for de novo polymer design with specified properties. This framework employs a forward model for predicting polymer properties and an inverse model optimized via reinforcement learning to generate polymers with specific yield strength. Our forward model achieved an R2 of 0.84 in predicting yield strength, enabling the inverse model to generate 4991 novel polymer candidates, resulting in a significant 45.20% improvement in average yield strength. We further screened these candidates based on synthetic accessibility (SA) scores and degradability, identifying 3099 polymers with excellent feasibility for synthesis and degradation performance. Finally, we validated the nine top-performing polymers through molecular dynamics (MD) simulations, which showed an average related error of 14.64% between the predicted and MD-validated values. This work demonstrates the potential of using reinforcement learning to transform polymer design, providing a systematic and efficient pathway to explore the vast polymer space and accelerate the discovery of materials tailored to meet specific industrial needs.
期刊介绍:
Macromolecules publishes original, fundamental, and impactful research on all aspects of polymer science. Topics of interest include synthesis (e.g., controlled polymerizations, polymerization catalysis, post polymerization modification, new monomer structures and polymer architectures, and polymerization mechanisms/kinetics analysis); phase behavior, thermodynamics, dynamic, and ordering/disordering phenomena (e.g., self-assembly, gelation, crystallization, solution/melt/solid-state characteristics); structure and properties (e.g., mechanical and rheological properties, surface/interfacial characteristics, electronic and transport properties); new state of the art characterization (e.g., spectroscopy, scattering, microscopy, rheology), simulation (e.g., Monte Carlo, molecular dynamics, multi-scale/coarse-grained modeling), and theoretical methods. Renewable/sustainable polymers, polymer networks, responsive polymers, electro-, magneto- and opto-active macromolecules, inorganic polymers, charge-transporting polymers (ion-containing, semiconducting, and conducting), nanostructured polymers, and polymer composites are also of interest. Typical papers published in Macromolecules showcase important and innovative concepts, experimental methods/observations, and theoretical/computational approaches that demonstrate a fundamental advance in the understanding of polymers.