Smart Crosswalk: Machine Learning and Image Processing based Pedestrian and Vehicle Monitoring System

Abstract

The conventional pedestrian crossing system's shortcomings require urgent reform to enhance the safety of pedestrians and improve urban mobility. Issues such as insufficient time for pedestrians to cross, prolong waiting times, neglection of emergency vehicles, and the absence of effective 24/7 response mechanisms at traditional crosswalks present significant safety concerns in urban areas. Our primary intention is to develop a cutting-edge pedestrian crossing system that relies on deep learning and image processing technologies as its foundation. This research addresses to innovate an advanced smart crosswalk consisting of four essential components: a real-time Pedestrian Detection and Priority System customized for individuals with special needs, a responsive system for detecting road conditions, vehicle availability and speed near crosswalks, a real-time Emergency Vehicle Detection and Priority System strengthened by rigorous verification procedures, and a robust framework for identifying pedestrian accidents and violations of crosswalk rules. The entire system has been meticulously designed not only to enhance pedestrian safety by identifying potential dangers but also to optimize traffic flow. In essence, it aims to provide an improved pedestrian crossing experience characterized by increased safety and efficiency.