Lightweight U-Net based on depthwise separable convolution for cloud detection onboard nanosatellite

Abstract

The typical procedure for Earth Observation Nanosatellites involves the sequential steps of image capture, onboard storage, and subsequent transmission to the ground station. This approach places significant demands on onboard resources and encounters bandwidth limitations; moreover, the captured images may be obstructed by cloud cover. Many current deep-learning methods have achieved reasonable accuracy in cloud detection. However, the constraints posed by nanosatellites specifically in terms of memory and energy present challenges for effective onboard Artificial Intelligence implementation. Hence, we propose an optimized tiny Machine learning model based on the U-Net architecture, implemented on STM32H7 microcontroller for real-time cloud coverage prediction. The optimized U-Net architecture on the embedded device introduces Depthwise Separable Convolution for efficient feature extraction, reducing computational complexity. By utilizing this method, coupled with encoder and decoder blocks, the model optimizes cloud detection for nanosatellites, showcasing a significant advancement in resource-efficient onboard processing. This approach aims to enhance the university nanosatellite mission, equipped with an RGB Gecko imager camera. The model is trained on Sentinel 2 satellite images due to the unavailability of a large dataset for the payload imager and is subsequently evaluated on gecko images, demonstrating the generalizability of our approach. The outcome of our optimization approach is a 21% reduction in network parameters compared to the original configuration and maintaining an accuracy of 89%. This reduction enables the system to allocate only 61.89 KB in flash memory effectively, resulting in improvements in memory usage and computational efficiency.