Augmented Reality Technology Applied to Surgical Planning in Oncological Colorectal Surgery

Abstract

This paper describes the application of augmented reality technology from three-dimensional colon models as a method of preoperative planning in oncological colorectal surgery. We have developed holograms of augmented reality from threedimensional anatomical models of the colon, obtained from computed tomography images (Siemens Somatom Perspective 64) with abdominal image cuts 3 mm thick. The recovery of the images was in DICOM format. The processing to achieve the threedimensional reconstruction was performed with the program OsiriX, which made a complete segmentation of the colon surface and modified the image density. 3D models were obtained of the isolated colon and in relationship with the bony structures. The smartphone Colon 3D AR application was designed (increased hyper experience- visualizer with SLAM technology) to apply augmented reality technology. An individualized hologram of augmented reality (scale 1:1) was created from each three-dimensional model. A projection with the smartphone on the patient's abdomen was made by modifying the position in the height of the reconstruction, using the pelvic bones as an anatomic reference point to calibrate the hologram's orientation. Three-dimensional reconstruction of the tumor in the preoperative plan of oncological colorectal surgery, combined with hyperreality technology, allows developing augmented reality models to improve colon anatomy knowledge and plan the surgical technique. The application is easy to use and may have advantages in preoperative colon surgery planning.