Sensor Fusion of Camera and 2D LiDAR for Self-Driving Automobile in Obstacle Avoidance Scenarios

Abstract

Obstacle dodging and overtaking are the pivotal tasks ensuring safety for self-driving automobiles. Multi-sensors fusion is the must-required condition to explore the entire surrounding information. This paper proposes a novel frontal dynamic car dodging strategy for automobiles with the left-hand side steering wheel by fusion of a camera and 2D LiDAR features. To begin with, we improve the LiteSeg model to extract the segmented mask, which can determine the drivable area and the avoiding direction. In addition to a camera, 2D LiDAR is used to check the scene information on the right side, which the camera's range cannot cover. As for point clouds output of 2D LiDAR, we adopt the Adaptive Breakpoint Detection (defined as ABD) algorithm to cluster the objects in a scanning plane. Subsequently, the RANSAC algorithm forms a straight line from the clustered point clouds to determine the boundary of the right-side obstacle. Besides, we compute the distance from LiDAR to the estimated straight line to maintain a safe distance when overtaking. Last but not least, the post-processing results of the two devices are fused to decide on the obstacle dodging and overtaking. The comprehensive experiments reveal that our self-driving automobile could perform well on the university campus in diverse scenarios.