From Multispectral-Stereo to Intraoperative Hyperspectral Imaging: a Feasibility Study

Abstract Spectral imaging allows to analyze optical tissue properties that are invisible to the naked eye. Different spectral setups have been introduced in the last years to allow intraoperative image-guidance. All systems suffer from different disadvantages, such as lack of real-time capability, limited spectral coverage or low resolution. We present a novel approach using two multispectral snapshot cameras covering different spectral ranges as a stereo-system. The proposed method allows for continuous hyperspectral imaging of the surgical scene, while also enabling 3D scene reconstruction. The study demonstrates the feasibility of this approach and its potential applications in real-time monitoring and tissue identification of surgical interventions. The paper also discusses the technical challenges and future directions for improving the imaging system.