Biomechanical Modeling and Pre-Operative Projection of A Human Organ using an Augmented Reality Technique During Open Hepatic Surgery

Abstract

Augmented Reality (AR) technology offers innovative ways in order to visualize and manipulate a 3D model of an object by superimposing computer-generated images onto another object interactively. The ability to interact with digital and spatial information in real-time offers new opportunities to manipulate and process medical data easily and efficiently. During surgical interventions, surgeons face various challenges dealing with digital patient data. Several methods are used to visualize the operative areas, such as fluoroscopy and ultrasound techniques. These techniques have several limitations. Thus, the augmented reality technique could serve as a better alternative to project a three-dimensional model of the target organ into the surgeon's perspective and field of view to improve the accuracy and efficiency of the medical intervention intraoperatively. In this paper, a new AR method is proposed in order to visualize and simulate the biomechanical model of the liver organ during open hepatic surgery. In this regard, the 3D model based on the patient's preoperative CT scans is first reconstructed. Then, the reconstructed model is projected using the AR headset. After that, the biomechanical model is generated and prepared for the simulation. The proposed approach is validated using acquired CT scans of the human organ.