{"title":"基于数字双驱动强化学习的动力换挡拖拉机换挡策略","authors":"Chang Feilong, Lu Zhixiong, Deng Xiaoting","doi":"10.1016/j.compag.2025.110513","DOIUrl":null,"url":null,"abstract":"<div><div>To address the unstable power output and low operational efficiency in high-power power-shift tractors (PST) caused by engine performance variations and traction resistance fluctuations, this study proposes a power-shift strategy based on reinforcement learning and digital twin technology. A digital twin system is developed to achieve real-time synchronization between the physical PST and its virtual model through multi-source sensor data acquisition and standardized signal processing, enabling bidirectional interaction and dynamic environment simulation. The proposed strategy integrates a twin-delayed deep deterministic policy gradient (TD3) reinforcement learning framework to mitigate Q-value overestimation and enable adaptive optimization of shifting decisions under complex operating conditions. Compared with traditional optimization methods such as dynamic programming and conventional neural networks, the TD3-based approach demonstrates superior adaptability and control stability, particularly in maintaining smooth shifting and continuous power delivery under varying load conditions. Furthermore, to address throttle fluctuation during gear transitions, a fuzzy PID throttle controller is introduced, which dynamically adjusts PID gains based on real-time throttle deviation and its rate of change. Experimental results show that the proposed method significantly reduces vehicle speed tracking errors and fuel consumption while improving gear-shift smoothness. Specifically, the mean engine torque and fuel consumption tracking errors remain below 6.11 N·m and 1.86 g·(kW·h)<sup>–1</sup>, respectively. Compared to traditional strategies, the method achieves a lower mean speed tracking error (0.0121 m·s<sup>–1</sup>), fuel consumption rate (231.21 g·(kW·h) <sup>–1</sup>), and total number of shifts (39).This study presents an effective and intelligent gear-shifting solution for PSTs and offers valuable insights for the broader application of reinforcement learning in agricultural machinery control.</div></div>","PeriodicalId":50627,"journal":{"name":"Computers and Electronics in Agriculture","volume":"236 ","pages":"Article 110513"},"PeriodicalIF":7.7000,"publicationDate":"2025-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Shifting strategy for power shift tractors based on digital Twin-Driven reinforcement learning\",\"authors\":\"Chang Feilong, Lu Zhixiong, Deng Xiaoting\",\"doi\":\"10.1016/j.compag.2025.110513\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>To address the unstable power output and low operational efficiency in high-power power-shift tractors (PST) caused by engine performance variations and traction resistance fluctuations, this study proposes a power-shift strategy based on reinforcement learning and digital twin technology. A digital twin system is developed to achieve real-time synchronization between the physical PST and its virtual model through multi-source sensor data acquisition and standardized signal processing, enabling bidirectional interaction and dynamic environment simulation. The proposed strategy integrates a twin-delayed deep deterministic policy gradient (TD3) reinforcement learning framework to mitigate Q-value overestimation and enable adaptive optimization of shifting decisions under complex operating conditions. Compared with traditional optimization methods such as dynamic programming and conventional neural networks, the TD3-based approach demonstrates superior adaptability and control stability, particularly in maintaining smooth shifting and continuous power delivery under varying load conditions. Furthermore, to address throttle fluctuation during gear transitions, a fuzzy PID throttle controller is introduced, which dynamically adjusts PID gains based on real-time throttle deviation and its rate of change. Experimental results show that the proposed method significantly reduces vehicle speed tracking errors and fuel consumption while improving gear-shift smoothness. Specifically, the mean engine torque and fuel consumption tracking errors remain below 6.11 N·m and 1.86 g·(kW·h)<sup>–1</sup>, respectively. Compared to traditional strategies, the method achieves a lower mean speed tracking error (0.0121 m·s<sup>–1</sup>), fuel consumption rate (231.21 g·(kW·h) <sup>–1</sup>), and total number of shifts (39).This study presents an effective and intelligent gear-shifting solution for PSTs and offers valuable insights for the broader application of reinforcement learning in agricultural machinery control.</div></div>\",\"PeriodicalId\":50627,\"journal\":{\"name\":\"Computers and Electronics in Agriculture\",\"volume\":\"236 \",\"pages\":\"Article 110513\"},\"PeriodicalIF\":7.7000,\"publicationDate\":\"2025-05-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computers and Electronics in Agriculture\",\"FirstCategoryId\":\"97\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0168169925006192\",\"RegionNum\":1,\"RegionCategory\":\"农林科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AGRICULTURE, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers and Electronics in Agriculture","FirstCategoryId":"97","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0168169925006192","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURE, MULTIDISCIPLINARY","Score":null,"Total":0}
Shifting strategy for power shift tractors based on digital Twin-Driven reinforcement learning
To address the unstable power output and low operational efficiency in high-power power-shift tractors (PST) caused by engine performance variations and traction resistance fluctuations, this study proposes a power-shift strategy based on reinforcement learning and digital twin technology. A digital twin system is developed to achieve real-time synchronization between the physical PST and its virtual model through multi-source sensor data acquisition and standardized signal processing, enabling bidirectional interaction and dynamic environment simulation. The proposed strategy integrates a twin-delayed deep deterministic policy gradient (TD3) reinforcement learning framework to mitigate Q-value overestimation and enable adaptive optimization of shifting decisions under complex operating conditions. Compared with traditional optimization methods such as dynamic programming and conventional neural networks, the TD3-based approach demonstrates superior adaptability and control stability, particularly in maintaining smooth shifting and continuous power delivery under varying load conditions. Furthermore, to address throttle fluctuation during gear transitions, a fuzzy PID throttle controller is introduced, which dynamically adjusts PID gains based on real-time throttle deviation and its rate of change. Experimental results show that the proposed method significantly reduces vehicle speed tracking errors and fuel consumption while improving gear-shift smoothness. Specifically, the mean engine torque and fuel consumption tracking errors remain below 6.11 N·m and 1.86 g·(kW·h)–1, respectively. Compared to traditional strategies, the method achieves a lower mean speed tracking error (0.0121 m·s–1), fuel consumption rate (231.21 g·(kW·h) –1), and total number of shifts (39).This study presents an effective and intelligent gear-shifting solution for PSTs and offers valuable insights for the broader application of reinforcement learning in agricultural machinery control.
期刊介绍:
Computers and Electronics in Agriculture provides international coverage of advancements in computer hardware, software, electronic instrumentation, and control systems applied to agricultural challenges. Encompassing agronomy, horticulture, forestry, aquaculture, and animal farming, the journal publishes original papers, reviews, and applications notes. It explores the use of computers and electronics in plant or animal agricultural production, covering topics like agricultural soils, water, pests, controlled environments, and waste. The scope extends to on-farm post-harvest operations and relevant technologies, including artificial intelligence, sensors, machine vision, robotics, networking, and simulation modeling. Its companion journal, Smart Agricultural Technology, continues the focus on smart applications in production agriculture.