CLIM-SEG: A generalizable segmentation model for heat and flood risk mapping

With the escalating impact of climate change coupled with increased urbanization, many cities will experience extreme heat events and intense flooding. Current modeling approaches often fail to incorporate high-resolution, frequently updated data sources, such as aerial imagery from web mapping platforms, limiting their effectiveness in identifying areas at risk. To address this gap, the paper presents CLIM-SEG, a novel framework for high-resolution urban heat and flood risk assessment, addressing critical gaps in current climate risk modeling. This framework integrates semantic segmentation of aerial imagery with a weighted sum approach that integrates environmental, socioeconomic, and building data to provide comprehensive risk evaluations at the census tract level. CLIM-SEG synthesize land cover data with hazard and vulnerability factors, producing risk scores ranging from 0 to 1. This low-cost and efficient framework can enable urban planners to prioritize resources for flood mitigation and heat adaptation, addressing the limitations of current approaches and contributing to the field of urban planning and climate change adaptation. The propoosed methodology incorporates a custom-curated dataset of 545 aerial images, including 145 manually annotated segmentation maps, to fine-tune advanced semantic segmentation models. The optimized Segmenter model achieves a pixel accuracy of 97.85% and an Intersection over Union (IoU) of 0.9578 for key urban features, significantly outperforming baseline models. Boston is selected to represent an ideal representation for both heat and flood risk, as the city experiences severe urban heat islands, and is susceptible to coastal and riverine flooding, with over 11,000 structures expected to be affected by 2070 due to sea level rise and increased precipitation. Results from flood and heat risk models indicate that census tracts in South End have the highest flood risk, with a weighted score value of 0.825, while census tracts in the Fenway-Kenmore neighborhood show the highest heat risk, with a score of 0.991. Both of these results have also been verified with other heat and flood risk mapping sources for Boston. The proposed framework of CLIM-SEG not only addresses the challenges faced by Boston but also has the potential to be scaled to other urban areas dealing with the impacts of climate change, providing a valuable tool for risk assessment and decision-making in the face of a changing climate.