{"title":"用于高效人工神经网络训练的具有学习率调度的级联双工有机垂直存储器","authors":"Qinyong Dai, Mengjiao Pei, Ziqian Hao, Xiang Li, Chao Ai, Yating Li, Kuakua Lu, Xu Chen, Qijing Wang, Changjin Wan, Yun Li","doi":"10.1002/adfm.202419179","DOIUrl":null,"url":null,"abstract":"<p>Learning rate scheduling (LRS) is a critical factor influencing the performance of neural networks by accelerating the convergence of learning algorithms and enhancing the generalization capabilities. The escalating computational demands in artificial intelligence (AI) necessitate advanced hardware solutions capable of supporting neural network training with LRS. This not only requires linear and symmetric analog programming capabilities but also the precise adjustment of channel conductance to achieve tunable slope in weight update behaviors. Here, a cascaded duplex organic vertical memory is proposed with the coupling of ferroelectric polarization effect and Schottky gate control on the same semiconducting channel, exhibiting adjustable-slope conductance update with high linearity and symmetry. Therefore, in the chest X-ray image detection, a fast-to-slow LRS is used for a bi-layer ANN training, achieving a rapid, stable convergence behavior within only 15 epochs and a high recognition accuracy. Moreover, the proposed LRS training is also suitable for the Mackey Glass prediction task using long short-term memory networks. This work integrates LRS into synaptic devices, enabling efficient hardware implementation of neural networks and thus enhancing AI performance in practical applications.</p>","PeriodicalId":112,"journal":{"name":"Advanced Functional Materials","volume":"35 20","pages":""},"PeriodicalIF":19.0000,"publicationDate":"2025-01-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Cascaded Duplex Organic Vertical Memory with Learning Rate Scheduling for Efficient Artificial Neural Network Training\",\"authors\":\"Qinyong Dai, Mengjiao Pei, Ziqian Hao, Xiang Li, Chao Ai, Yating Li, Kuakua Lu, Xu Chen, Qijing Wang, Changjin Wan, Yun Li\",\"doi\":\"10.1002/adfm.202419179\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Learning rate scheduling (LRS) is a critical factor influencing the performance of neural networks by accelerating the convergence of learning algorithms and enhancing the generalization capabilities. The escalating computational demands in artificial intelligence (AI) necessitate advanced hardware solutions capable of supporting neural network training with LRS. This not only requires linear and symmetric analog programming capabilities but also the precise adjustment of channel conductance to achieve tunable slope in weight update behaviors. Here, a cascaded duplex organic vertical memory is proposed with the coupling of ferroelectric polarization effect and Schottky gate control on the same semiconducting channel, exhibiting adjustable-slope conductance update with high linearity and symmetry. Therefore, in the chest X-ray image detection, a fast-to-slow LRS is used for a bi-layer ANN training, achieving a rapid, stable convergence behavior within only 15 epochs and a high recognition accuracy. Moreover, the proposed LRS training is also suitable for the Mackey Glass prediction task using long short-term memory networks. This work integrates LRS into synaptic devices, enabling efficient hardware implementation of neural networks and thus enhancing AI performance in practical applications.</p>\",\"PeriodicalId\":112,\"journal\":{\"name\":\"Advanced Functional Materials\",\"volume\":\"35 20\",\"pages\":\"\"},\"PeriodicalIF\":19.0000,\"publicationDate\":\"2025-01-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Advanced Functional Materials\",\"FirstCategoryId\":\"88\",\"ListUrlMain\":\"https://advanced.onlinelibrary.wiley.com/doi/10.1002/adfm.202419179\",\"RegionNum\":1,\"RegionCategory\":\"材料科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"CHEMISTRY, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advanced Functional Materials","FirstCategoryId":"88","ListUrlMain":"https://advanced.onlinelibrary.wiley.com/doi/10.1002/adfm.202419179","RegionNum":1,"RegionCategory":"材料科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CHEMISTRY, MULTIDISCIPLINARY","Score":null,"Total":0}
A Cascaded Duplex Organic Vertical Memory with Learning Rate Scheduling for Efficient Artificial Neural Network Training
Learning rate scheduling (LRS) is a critical factor influencing the performance of neural networks by accelerating the convergence of learning algorithms and enhancing the generalization capabilities. The escalating computational demands in artificial intelligence (AI) necessitate advanced hardware solutions capable of supporting neural network training with LRS. This not only requires linear and symmetric analog programming capabilities but also the precise adjustment of channel conductance to achieve tunable slope in weight update behaviors. Here, a cascaded duplex organic vertical memory is proposed with the coupling of ferroelectric polarization effect and Schottky gate control on the same semiconducting channel, exhibiting adjustable-slope conductance update with high linearity and symmetry. Therefore, in the chest X-ray image detection, a fast-to-slow LRS is used for a bi-layer ANN training, achieving a rapid, stable convergence behavior within only 15 epochs and a high recognition accuracy. Moreover, the proposed LRS training is also suitable for the Mackey Glass prediction task using long short-term memory networks. This work integrates LRS into synaptic devices, enabling efficient hardware implementation of neural networks and thus enhancing AI performance in practical applications.
期刊介绍:
Firmly established as a top-tier materials science journal, Advanced Functional Materials reports breakthrough research in all aspects of materials science, including nanotechnology, chemistry, physics, and biology every week.
Advanced Functional Materials is known for its rapid and fair peer review, quality content, and high impact, making it the first choice of the international materials science community.