Enhancing cotton irrigation with distributional actor–critic reinforcement learning

Abstract

Accurate predictions of irrigation’s impact on crop yield are crucial for effective decision-making. However, current research predominantly focuses on the relationship between irrigation events and soil moisture, often neglecting the physiological state of the crops themselves. This study introduces a novel intelligent irrigation approach based on distributional reinforcement learning, ensuring that the algorithm simultaneously considers weather, soil, and crop conditions to make optimal irrigation decisions for long-term benefits. To achieve this, we collected climate data from 1980 to 2024 and conducted a two-year cotton planting experiment in 2023 and 2024. We used soil and plant state indicators from 5 experimental groups with varying irrigation treatments to calibrate and validate the DSSAT model. Subsequently, we innovatively integrated a distributional reinforcement learning method—an effective machine learning technique for continuous control problems. Our algorithm focuses on 17 indicators, including crop leaf area, stem leaf count, and soil evapotranspiration, among others. Through a well-designed network structure and cumulative rewards, our approach effectively captures the relationships between irrigation events and these states. Additionally, we validated the robustness and generalizability of the model using three years of extreme weather data and two consecutive years of cross-site observations. This method surpasses previous irrigation strategies managed by standard reinforcement learning techniques (e.g., DQN). Empirical results indicate that our approach significantly outperforms traditional agronomic decision-making, enhancing cotton yield by 13.6% and improving water use efficiency per kilogram of crop by 6.7%. In 2024, our method was validated in actual field experiments, achieving the highest yield among all approaches, with a 12.9% increase compared to traditional practices. Our research provides a robust framework for intelligent cotton irrigation in the region and offers promising new directions for implementing smart agricultural decision systems across diverse areas.