Constance M Robbins,Kuanren Qian,Yongjie Jessica Zhang,Jana M Kainerstorfer
{"title":"Monte Carlo simulation of spatial frequency domain imaging for breast tumors during compression.","authors":"Constance M Robbins,Kuanren Qian,Yongjie Jessica Zhang,Jana M Kainerstorfer","doi":"10.1117/1.jbo.29.9.096001","DOIUrl":"https://doi.org/10.1117/1.jbo.29.9.096001","url":null,"abstract":"SignificanceNear-infrared optical imaging methods have shown promise for monitoring response to neoadjuvant chemotherapy (NAC) for breast cancer, with endogenous contrast coming from oxy- and deoxyhemoglobin. Spatial frequency domain imaging (SFDI) could be used to detect this contrast in a low-cost and portable format, but it has limited imaging depth. It is possible that local tissue compression could be used to reduce the effective tumor depth.AimTo evaluate the potential of SFDI for therapy response prediction, we aim to predict how changes to tumor size, stiffness, and hemoglobin concentration would be reflected in contrast measured by SFDI under tissue compression.ApproachFinite element analysis of compression on an inclusion-containing soft material is combined with Monte Carlo simulation to predict the measured optical contrast.ResultsWhen the effect of compression on blood volume is not considered, contrast gain from compression increases with the size and stiffness of the inclusion and decreases with the inclusion depth. With a model of reduction of blood volume from compression, compression reduces imaging contrast, an effect that is greater for larger inclusions and stiffer inclusions at shallower depths.ConclusionsThis computational modeling study represents a first step toward tracking tumor changes induced by NAC using SFDI and local compression.","PeriodicalId":15264,"journal":{"name":"Journal of Biomedical Optics","volume":"7 1","pages":"096001"},"PeriodicalIF":3.5,"publicationDate":"2024-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142258333","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Luca Giannoni, Marta Marradi, Kevin Scibilia, Ivan Ezhov, Camilla Bonaudo, Angelos Artemiou, Anam Toaha, Frédéric Lange, Charly Caredda, Bruno Montcel, Alessandro Della Puppa, Ilias Tachtsidis, Daniel Rückert, Francesco Saverio Pavone
{"title":"Transportable hyperspectral imaging setup based on fast, high-density spectral scanning for <i>in situ</i> quantitative biochemical mapping of fresh tissue biopsies.","authors":"Luca Giannoni, Marta Marradi, Kevin Scibilia, Ivan Ezhov, Camilla Bonaudo, Angelos Artemiou, Anam Toaha, Frédéric Lange, Charly Caredda, Bruno Montcel, Alessandro Della Puppa, Ilias Tachtsidis, Daniel Rückert, Francesco Saverio Pavone","doi":"10.1117/1.JBO.29.9.093508","DOIUrl":"10.1117/1.JBO.29.9.093508","url":null,"abstract":"<p><strong>Significance: </strong>Histopathological examination of surgical biopsies, such as in glioma and glioblastoma resection, is hindered in current clinical practice by the long time required for the laboratory analysis and pathological screening, typically taking several days or even weeks to be completed.</p><p><strong>Aim: </strong>We propose here a transportable, high-density, spectral scanning-based hyperspectral imaging (HSI) setup, named HyperProbe1, that can provide <i>in situ</i>, fast biochemical analysis, and mapping of fresh surgical tissue samples, right after excision, and without the need for fixing, staining nor compromising the integrity of the tissue properties.</p><p><strong>Approach: </strong>HyperProbe1 is based on spectral scanning via supercontinuum laser illumination filtered with acousto-optic tunable filters. Such methodology allows the user to select any number and type of wavelength bands in the visible and near-infrared range between 510 and 900 nm (up to a maximum of 79) and to reconstruct 3D hypercubes composed of high-resolution (4 to <math><mrow><mn>5</mn> <mtext> </mtext> <mi>μ</mi> <mi>m</mi></mrow> </math> ), widefield images ( <math><mrow><mn>0.9</mn> <mo>×</mo> <mn>0.9</mn> <mtext> </mtext> <msup><mrow><mi>mm</mi></mrow> <mrow><mn>2</mn></mrow> </msup> </mrow> </math> ) of the surgical samples, where each pixel is associated with a complete spectrum.</p><p><strong>Results: </strong>The HyperProbe1 setup is here presented and characterized. The system is applied to 11 fresh surgical biopsies of glioma from routine patients, including different grades of tumor classification. Quantitative analysis of the composition of the tissue is performed via fast spectral unmixing to reconstruct the mapping of major biomarkers, such as oxy-( <math> <mrow> <msub><mrow><mi>HbO</mi></mrow> <mrow><mn>2</mn></mrow> </msub> </mrow> </math> ) and deoxyhemoglobin (HHb), as well as cytochrome-c-oxidase (CCO). We also provided a preliminary attempt to infer tumor classification based on differences in composition in the samples, suggesting the possibility of using lipid content and differential CCO concentrations to distinguish between lower and higher-grade gliomas.</p><p><strong>Conclusions: </strong>A proof of concept of the performances of HyperProbe1 for quantitative, biochemical mapping of surgical biopsies is demonstrated, paving the way for improving current post-surgical, histopathological practice via non-destructive, <i>in situ</i> streamlined screening of fresh tissue samples in a matter of minutes after excision.</p>","PeriodicalId":15264,"journal":{"name":"Journal of Biomedical Optics","volume":"29 9","pages":"093508"},"PeriodicalIF":3.0,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11384341/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142288118","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Tadej Tomanic, Tim Bozic, Bostjan Markelc, Jost Stergar, Gregor Sersa, Matija Milanic
{"title":"Hyperspectral imaging of 4T1 mammary carcinomas grown in dorsal skinfold window chambers: spectral renormalization and fluorescence modeling.","authors":"Tadej Tomanic, Tim Bozic, Bostjan Markelc, Jost Stergar, Gregor Sersa, Matija Milanic","doi":"10.1117/1.JBO.29.9.093504","DOIUrl":"10.1117/1.JBO.29.9.093504","url":null,"abstract":"<p><strong>Significance: </strong>Hyperspectral imaging (HSI) of murine tumor models grown in dorsal skinfold window chambers (DSWCs) offers invaluable insight into the tumor microenvironment. However, light loss in a glass coverslip is often overlooked, and particular tissue characteristics are improperly modeled, leading to errors in tissue properties extracted from hyperspectral images.</p><p><strong>Aim: </strong>We highlight the significance of spectral renormalization in HSI of DSWC models and demonstrate the benefit of incorporating enhanced green fluorescent protein (EGFP) excitation and emission in the skin tissue model for tumors expressing genes to produce EGFP.</p><p><strong>Approach: </strong>We employed an HSI system for intravital imaging of mice with 4T1 mammary carcinoma in a DSWC over 14 days. We performed spectral renormalization of hyperspectral images based on the measured reflectance spectra of glass coverslips and utilized an inverse adding-doubling (IAD) algorithm with a two-layer murine skin model, to extract tissue parameters, such as total hemoglobin concentration and tissue oxygenation ( <math> <mrow><msub><mi>StO</mi> <mn>2</mn></msub> </mrow> </math> ). The model was upgraded to consider EGFP fluorescence excitation and emission. Moreover, we conducted additional experiments involving tissue phantoms, human forearm skin imaging, and numerical simulations.</p><p><strong>Results: </strong>Hyperspectral image renormalization and the addition of EGFP fluorescence in the murine skin model reduced the mean absolute percentage errors (MAPEs) of fitted and measured spectra by up to 10% in tissue phantoms, 0.55% to 1.5% in the human forearm experiment and numerical simulations, and up to 0.7% in 4T1 tumors. Similarly, the MAPEs for tissue parameters extracted by IAD were reduced by up to 3% in human forearms and numerical simulations. For some parameters, statistically significant differences ( <math><mrow><mi>p</mi> <mo><</mo> <mn>0.05</mn></mrow> </math> ) were observed in 4T1 tumors. Ultimately, we have shown that fluorescence emission could be helpful for 4T1 tumor segmentation.</p><p><strong>Conclusions: </strong>The results contribute to improving intravital monitoring of DWSC models using HSI and pave the way for more accurate and precise quantitative imaging.</p>","PeriodicalId":15264,"journal":{"name":"Journal of Biomedical Optics","volume":"29 9","pages":"093504"},"PeriodicalIF":3.0,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11262746/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141748313","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jeeseong Hwang, Philip Cheney, Stephen C Kanick, Hanh N D Le, David M McClatchy, Helen Zhang, Nian Liu, Zhan-Qian John Lu, Tae Joon Cho, Kimberly Briggman, David W Allen, Wendy A Wells, Brian W Pogue
{"title":"Hyperspectral dark-field microscopy of human breast lumpectomy samples for tumor margin detection in breast-conserving surgery.","authors":"Jeeseong Hwang, Philip Cheney, Stephen C Kanick, Hanh N D Le, David M McClatchy, Helen Zhang, Nian Liu, Zhan-Qian John Lu, Tae Joon Cho, Kimberly Briggman, David W Allen, Wendy A Wells, Brian W Pogue","doi":"10.1117/1.JBO.29.9.093503","DOIUrl":"10.1117/1.JBO.29.9.093503","url":null,"abstract":"<p><strong>Significance: </strong>Hyperspectral dark-field microscopy (HSDFM) and data cube analysis algorithms demonstrate successful detection and classification of various tissue types, including carcinoma regions in human post-lumpectomy breast tissues excised during breast-conserving surgeries.</p><p><strong>Aim: </strong>We expand the application of HSDFM to the classification of tissue types and tumor subtypes in pre-histopathology human breast lumpectomy samples.</p><p><strong>Approach: </strong>Breast tissues excised during breast-conserving surgeries were imaged by the HSDFM and analyzed. The performance of the HSDFM is evaluated by comparing the backscattering intensity spectra of polystyrene microbead solutions with the Monte Carlo simulation of the experimental data. For classification algorithms, two analysis approaches, a supervised technique based on the spectral angle mapper (SAM) algorithm and an unsupervised technique based on the <math><mrow><mi>K</mi></mrow></math>-means algorithm are applied to classify various tissue types including carcinoma subtypes. In the supervised technique, the SAM algorithm with manually extracted endmembers guided by H&E annotations is used as reference spectra, allowing for segmentation maps with classified tissue types including carcinoma subtypes.</p><p><strong>Results: </strong>The manually extracted endmembers of known tissue types and their corresponding threshold spectral correlation angles for classification make a good reference library that validates endmembers computed by the unsupervised <math><mrow><mi>K</mi></mrow></math>-means algorithm. The unsupervised <math><mrow><mi>K</mi></mrow></math>-means algorithm, with no <i>a priori</i> information, produces abundance maps with dominant endmembers of various tissue types, including carcinoma subtypes of invasive ductal carcinoma and invasive mucinous carcinoma. The two carcinomas' unique endmembers produced by the two methods agree with each other within <math><mrow><mo><</mo><mn>2</mn><mo>%</mo></mrow></math> residual error margin.</p><p><strong>Conclusions: </strong>Our report demonstrates a robust procedure for the validation of an unsupervised algorithm with the essential set of parameters based on the ground truth, histopathological information. We have demonstrated that a trained library of the histopathology-guided endmembers and associated threshold spectral correlation angles computed against well-defined reference data cubes serve such parameters. Two classification algorithms, supervised and unsupervised algorithms, are employed to identify regions with carcinoma subtypes of invasive ductal carcinoma and invasive mucinous carcinoma present in the tissues. The two carcinomas' unique endmembers used by the two methods agree to <math><mrow><mo><</mo><mn>2</mn><mo>%</mo></mrow></math> residual error margin. This library of high quality and collected under an environment with no ambient background may be instrumental to develop or va","PeriodicalId":15264,"journal":{"name":"Journal of Biomedical Optics","volume":"29 9","pages":"093503"},"PeriodicalIF":3.0,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11075096/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140876462","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Bilour Khan, Ervin Nippolainen, Fatemeh Shahini, Nonappa, Alexey Popov, Juha Töyräs, Isaac O Afara
{"title":"Relationship between depth-wise refractive index and biomechanical properties of human articular cartilage.","authors":"Bilour Khan, Ervin Nippolainen, Fatemeh Shahini, Nonappa, Alexey Popov, Juha Töyräs, Isaac O Afara","doi":"10.1117/1.JBO.29.9.095003","DOIUrl":"10.1117/1.JBO.29.9.095003","url":null,"abstract":"<p><strong>Significance: </strong>Optical properties of biological tissues, such as refractive index (RI), are fundamental properties, intrinsically linked to the tissue's composition and structure. We hypothesize that, as the RI and the functional properties of articular cartilage (AC) are dependent on the tissue's structure and composition, the RI of AC is related to its biomechanical properties.</p><p><strong>Aim: </strong>This study aims to investigate the relationship between RI of human AC and its biomechanical properties.</p><p><strong>Approach: </strong>Human cartilage samples ( <math><mrow><mi>n</mi> <mo>=</mo> <mn>22</mn></mrow> </math> ) were extracted from the right knee joint of three cadaver donors (one female, aged 47 years, and two males, aged 64 and 68 years) obtained from a commercial biobank (Science Care, Phoenix, Arizona, United States). The samples were initially subjected to mechanical indentation testing to determine elastic [equilibrium modulus (EM) and instantaneous modulus (IM)] and dynamic [dynamic modulus (DM)] viscoelastic properties. An Abbemat 3200 automatic one-wavelength refractometer operating at 600 nm was used to measure the RI of the extracted sections. Similarly, Spearman's and Pearson's correlation coefficients were employed for non-normal and normal datasets, respectively, to determine the correlation between the depth-wise RI and biomechanical properties of the cartilage samples as a function of the collagen fibril orientation.</p><p><strong>Results: </strong>A positive correlation with statistically significant relations ( <math><mrow><mi>p</mi> <mo>-</mo> <mtext>values</mtext> <mo><</mo> <mn>0.05</mn></mrow> </math> ) was observed between the RI and the biomechanical properties (EM, IM, and DM) along the tissue depth for each zone, e.g., superficial, middle, and deep zones. Likewise, a lower positive correlation with statistically significant relations ( <math><mrow><mi>p</mi> <mo>-</mo> <mtext>values</mtext> <mo><</mo> <mn>0.05</mn></mrow> </math> ) was also observed for collagen fibril orientation of all zones with the biomechanical properties.</p><p><strong>Conclusions: </strong>The results indicate that, although the RI exhibits different levels of correlation with different biomechanical properties, the relationship varies as a function of the tissue depth. This knowledge paves the way for optically monitoring changes in AC biomechanical properties nondestructively via changes in the RI. Thus, the RI could be a potential biomarker for assessing the mechanical competency of AC, particularly in degenerative diseases, such as osteoarthritis.</p>","PeriodicalId":15264,"journal":{"name":"Journal of Biomedical Optics","volume":"29 9","pages":"095003"},"PeriodicalIF":3.0,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11413650/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142288117","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Alberto Martín-Pérez, Alejandro Martinez de Ternero, Alfonso Lagares, Eduardo Juarez, César Sanz
{"title":"Spectral analysis comparison of pushbroom and snapshot hyperspectral cameras for <i>in vivo</i> brain tissues and chromophore identification.","authors":"Alberto Martín-Pérez, Alejandro Martinez de Ternero, Alfonso Lagares, Eduardo Juarez, César Sanz","doi":"10.1117/1.JBO.29.9.093510","DOIUrl":"https://doi.org/10.1117/1.JBO.29.9.093510","url":null,"abstract":"<p><strong>Significance: </strong>Hyperspectral imaging sensors have rapidly advanced, aiding in tumor diagnostics for <i>in vivo</i> brain tumors. Linescan cameras effectively distinguish between pathological and healthy tissue, whereas snapshot cameras offer a potential alternative to reduce acquisition time.</p><p><strong>Aim: </strong>Our research compares linescan and snapshot hyperspectral cameras for <i>in vivo</i> brain tissues and chromophore identification.</p><p><strong>Approach: </strong>We compared a linescan pushbroom camera and a snapshot camera using images from 10 patients with various pathologies. Objective comparisons were made using unnormalized and normalized data for healthy and pathological tissues. We utilized the interquartile range (IQR) for the spectral angle mapping (SAM), the goodness-of-fit coefficient (GFC), and the root mean square error (RMSE) within the 659.95 to 951.42 nm range. In addition, we assessed the ability of both cameras to capture tissue chromophores by analyzing absorbance from reflectance information.</p><p><strong>Results: </strong>The SAM metric indicates reduced dispersion and high similarity between cameras for pathological samples, with a 9.68% IQR for normalized data compared with 2.38% for unnormalized data. This pattern is consistent across GFC and RMSE metrics, regardless of tissue type. Moreover, both cameras could identify absorption peaks of certain chromophores. For instance, using the absorbance measurements of the linescan camera, we obtained SAM values below 0.235 for four peaks, regardless of the tissue and type of data under inspection. These peaks are one for cytochrome b in its oxidized form at <math><mrow><mi>λ</mi> <mo>=</mo> <mn>422</mn> <mtext> </mtext> <mi>nm</mi></mrow> </math> , two for <math> <mrow> <msub><mrow><mi>HbO</mi></mrow> <mrow><mn>2</mn></mrow> </msub> </mrow> </math> at <math><mrow><mi>λ</mi> <mo>=</mo> <mn>542</mn> <mtext> </mtext> <mi>nm</mi></mrow> </math> and <math><mrow><mi>λ</mi> <mo>=</mo> <mn>576</mn> <mtext> </mtext> <mi>nm</mi></mrow> </math> , and one for water at <math><mrow><mi>λ</mi> <mo>=</mo> <mn>976</mn> <mtext> </mtext> <mi>nm</mi></mrow> </math> .</p><p><strong>Conclusion: </strong>The spectral signatures of the cameras show more similarity with unnormalized data, likely due to snapshot sensor noise, resulting in noisier signatures post-normalization. Comparisons in this study suggest that snapshot cameras might be viable alternatives to linescan cameras for real-time brain tissue identification.</p>","PeriodicalId":15264,"journal":{"name":"Journal of Biomedical Optics","volume":"29 9","pages":"093510"},"PeriodicalIF":3.0,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11420787/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142347391","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Minh Ha Tran, Ling Ma, Hasan Mubarak, Ofelia Gomez, James Yu, Michelle Bryarly, Baowei Fei
{"title":"Detection and margin assessment of thyroid carcinoma with microscopic hyperspectral imaging using transformer networks.","authors":"Minh Ha Tran, Ling Ma, Hasan Mubarak, Ofelia Gomez, James Yu, Michelle Bryarly, Baowei Fei","doi":"10.1117/1.JBO.29.9.093505","DOIUrl":"10.1117/1.JBO.29.9.093505","url":null,"abstract":"<p><strong>Significance: </strong>Hyperspectral imaging (HSI) is an emerging imaging modality for oncological applications and can improve cancer detection with digital pathology.</p><p><strong>Aim: </strong>The study aims to highlight the increased accuracy and sensitivity of detecting the margin of thyroid carcinoma in hematoxylin and eosin (H&E)-stained histological slides using HSI and data augmentation methods.</p><p><strong>Approach: </strong>Using an automated microscopic imaging system, we captured 2599 hyperspectral images from 65 H&E-stained human thyroid slides. Images were then preprocessed into 153,906 image patches of dimension <math><mrow><mn>250</mn> <mo>×</mo> <mn>250</mn> <mo>×</mo> <mn>84</mn> <mtext> pixels</mtext></mrow> </math> . We modified the TimeSformer network architecture, which used alternating spectral attention and spatial attention layers. We implemented several data augmentation methods for HSI based on the RandAugment algorithm. We compared the performances of TimeSformer on HSI against the performances of pretrained ConvNext and pretrained vision transformers (ViT) networks on red, green, and blue (RGB) images. Finally, we applied attention unrolling techniques on the trained TimeSformer network to identify the biological features to which the network paid attention.</p><p><strong>Results: </strong>In the testing dataset, TimeSformer achieved an accuracy of 90.87%, a weighted <math> <mrow><msub><mi>F</mi> <mn>1</mn></msub> </mrow> </math> score of 89.79%, a sensitivity of 91.50%, and an area under the receiving operator characteristic curve (AU-ROC) score of 97.04%. Additionally, TimeSformer produced thyroid carcinoma tumor margins with an average Jaccard score of 0.76 mm. Without data augmentation, TimeSformer achieved an accuracy of 88.23%, a weighted <math> <mrow><msub><mi>F</mi> <mn>1</mn></msub> </mrow> </math> score of 86.46%, a sensitivity of 85.53%, and an AU-ROC score of 94.94%. In comparison, the ViT network achieved an 89.98% accuracy, an 88.14% weighted <math> <mrow><msub><mi>F</mi> <mn>1</mn></msub> </mrow> </math> score, an 84.77% sensitivity, and a 96.17% AU-ROC. Our visualization results showed that the network paid attention to biological features.</p><p><strong>Conclusions: </strong>The TimeSformer model trained with hyperspectral histological data consistently outperformed conventional RGB-based models, highlighting the superiority of HSI in this context. Our proposed augmentation methods improved the accuracy, the <math> <mrow><msub><mi>F</mi> <mn>1</mn></msub> </mrow> </math> score, and the sensitivity score.</p>","PeriodicalId":15264,"journal":{"name":"Journal of Biomedical Optics","volume":"29 9","pages":"093505"},"PeriodicalIF":3.0,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11268383/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141758976","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Thomas T Livecchi, Steven L Jacques, Hrebesh M Subhash, Mark C Pierce
{"title":"Hyperspectral imaging with deep learning for quantification of tissue hemoglobin, melanin, and scattering.","authors":"Thomas T Livecchi, Steven L Jacques, Hrebesh M Subhash, Mark C Pierce","doi":"10.1117/1.JBO.29.9.093507","DOIUrl":"10.1117/1.JBO.29.9.093507","url":null,"abstract":"<p><strong>Significance: </strong>Hyperspectral cameras capture spectral information at each pixel in an image. Acquired spectra can be analyzed to estimate quantities of absorbing and scattering components, but the use of traditional fitting algorithms over megapixel images can be computationally intensive. Deep learning algorithms can be trained to rapidly analyze spectral data and can potentially process hyperspectral camera data in real time.</p><p><strong>Aim: </strong>A hyperspectral camera was used to capture <math><mrow><mn>1216</mn> <mo>×</mo> <mn>1936</mn> <mtext> pixel</mtext></mrow> </math> wide-field reflectance images of <i>in vivo</i> human tissue at 205 wavelength bands from 420 to 830 nm.</p><p><strong>Approach: </strong>The optical properties of oxyhemoglobin, deoxyhemoglobin, melanin, and scattering were used with multi-layer Monte Carlo models to generate simulated diffuse reflectance spectra for 24,000 random combinations of physiologically relevant tissue components. These spectra were then used to train an artificial neural network (ANN) to predict tissue component concentrations from an input reflectance spectrum.</p><p><strong>Results: </strong>The ANN achieved low root mean square errors in a test set of 6000 independent simulated diffuse reflectance spectra while calculating concentration values more than 4000× faster than a conventional iterative least squares approach.</p><p><strong>Conclusions: </strong><i>In vivo</i> finger occlusion and gingival abrasion studies demonstrate the ability of this approach to rapidly generate high-resolution images of tissue component concentrations from a hyperspectral dataset acquired from human subjects.</p>","PeriodicalId":15264,"journal":{"name":"Journal of Biomedical Optics","volume":"29 9","pages":"093507"},"PeriodicalIF":3.0,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11378079/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142154206","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Wihan Adi, Bryan E Rubio Perez, Yuming Liu, Sydney Runkle, Kevin W Eliceiri, Filiz Yesilkoy
{"title":"Machine learning-assisted mid-infrared spectrochemical fibrillar collagen imaging in clinical tissues.","authors":"Wihan Adi, Bryan E Rubio Perez, Yuming Liu, Sydney Runkle, Kevin W Eliceiri, Filiz Yesilkoy","doi":"10.1117/1.JBO.29.9.093511","DOIUrl":"10.1117/1.JBO.29.9.093511","url":null,"abstract":"<p><strong>Significance: </strong>Label-free multimodal imaging methods that can provide complementary structural and chemical information from the same sample are critical for comprehensive tissue analyses. These methods are specifically needed to study the complex tumor-microenvironment where fibrillar collagen's architectural changes are associated with cancer progression. To address this need, we present a multimodal computational imaging method where mid-infrared spectral imaging (MIRSI) is employed with second harmonic generation (SHG) microscopy to identify fibrillar collagen in biological tissues.</p><p><strong>Aim: </strong>To demonstrate a multimodal approach where a morphology-specific contrast mechanism guides an MIRSI method to detect fibrillar collagen based on its chemical signatures.</p><p><strong>Approach: </strong>We trained a supervised machine learning (ML) model using SHG images as ground truth collagen labels to classify fibrillar collagen in biological tissues based on their mid-infrared hyperspectral images. Five human pancreatic tissue samples (sizes are in the order of millimeters) were imaged by both MIRSI and SHG microscopes. In total, 2.8 million MIRSI spectra were used to train a random forest (RF) model. The other 68 million spectra were used to validate the collagen images generated by the RF-MIRSI model in terms of collagen segmentation, orientation, and alignment.</p><p><strong>Results: </strong>Compared with the SHG ground truth, the generated RF-MIRSI collagen images achieved a high average boundary <math><mrow><mi>F</mi></mrow> </math> -score (0.8 at 4-pixel thresholds) in the collagen distribution, high correlation (Pearson's <math><mrow><mi>R</mi></mrow> </math> 0.82) in the collagen orientation, and similarly high correlation (Pearson's <math><mrow><mi>R</mi></mrow> </math> 0.66) in the collagen alignment.</p><p><strong>Conclusions: </strong>We showed the potential of ML-aided label-free mid-infrared hyperspectral imaging for collagen fiber and tumor microenvironment analysis in tumor pathology samples.</p>","PeriodicalId":15264,"journal":{"name":"Journal of Biomedical Optics","volume":"29 9","pages":"093511"},"PeriodicalIF":3.0,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11448345/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142371949","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Xavier Attendu, Paul R Bloemen, Niels H Kind, Dirk J Faber, Daniel M de Bruin, Caroline Boudoux, Ton G van Leeuwen
{"title":"All-reflective tethered capsule endoscope for multimodal optical coherence tomography in the esophagus.","authors":"Xavier Attendu, Paul R Bloemen, Niels H Kind, Dirk J Faber, Daniel M de Bruin, Caroline Boudoux, Ton G van Leeuwen","doi":"10.1117/1.JBO.29.9.096003","DOIUrl":"https://doi.org/10.1117/1.JBO.29.9.096003","url":null,"abstract":"<p><strong>Significance: </strong>Esophageal cancer is becoming increasingly prevalent in Western countries. Early detection is crucial for effective treatment. Multimodal imaging combining optical coherence tomography (OCT) with complementary optical imaging techniques may provide enhanced diagnostic capabilities by simultaneously assessing tissue morphology and biochemical content.</p><p><strong>Aim: </strong>We aim to develop a tethered capsule endoscope (TCE) that can accommodate a variety of point-scanning techniques in addition to OCT without requiring design iterations on the optical or mechanical design.</p><p><strong>Approach: </strong>We propose a TCE utilizing exclusively reflective optics to focus and steer light from and to a double-clad fiber. Specifically, we use an ellipsoidal mirror to achieve finite conjugation between the fiber tip and the imaging plane.</p><p><strong>Results: </strong>We demonstrate a functional all-reflective TCE. We first detail the design, fabrication, and assembly steps required to obtain such a device. We then characterize its performance and demonstrate combined OCT at 1300 nm and visible spectroscopic imaging in the 500- to 700-nm range. Finally, we discuss the advantages and limitations of the proposed design.</p><p><strong>Conclusions: </strong>An all-reflective TCE is feasible and allows for achromatic high-quality imaging. Such a device could be utilized as a platform for testing various combinations of modalities to identify the optimal candidates without requiring design iterations.</p>","PeriodicalId":15264,"journal":{"name":"Journal of Biomedical Optics","volume":"29 9","pages":"096003"},"PeriodicalIF":3.0,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11412323/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142288116","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}