{"title":"ArthroNet: a monocular depth estimation technique with 3D segmented maps for knee arthroscopy","authors":"Shahnewaz Ali, Ajay K. Pandey","doi":"10.1016/j.imed.2022.05.001","DOIUrl":"https://doi.org/10.1016/j.imed.2022.05.001","url":null,"abstract":"<div><h3>Background</h3><p>Lack of depth perception from medical imaging systems is one of the long-standing technological limitations of minimally invasive surgeries. The ability to visualize anatomical structures in 3D can improve conventional arthroscopic surgeries, as a full 3D semantic representation of the surgical site can directly improve surgeons’ ability. It also brings the possibility of intraoperative image registration with preoperative clinical records for the development of semi-autonomous, and fully autonomous platforms. This study aimed to present a novel monocular depth prediction model to infer depth maps from a single-color arthroscopic video frame.</p></div><div><h3>Methods</h3><p>We applied a novel technique that provides the ability to combine both supervised and self-supervised loss terms and thus eliminate the drawback of each technique. It enabled the estimation of edge-preserving depth maps from a single untextured arthroscopic frame. The proposed image acquisition technique projected artificial textures on the surface to improve the quality of disparity maps from stereo images. Moreover, following the integration of the attention-ware multi-scale feature extraction technique along with scene global contextual constraints and multiscale depth fusion, the model could predict reliable and accurate tissue depth of the surgical sites that complies with scene geometry.</p></div><div><h3>Results</h3><p>A total of 4,128 stereo frames from a knee phantom were used to train a network, and during the pre-trained stage, the network learned disparity maps from the stereo images. The fine-tuned training phase uses 12,695 knee arthroscopic stereo frames from cadaver experiments along with their corresponding coarse disparity maps obtained from the stereo matching technique. In a supervised fashion, the network learns the left image to the disparity map transformation process, whereas the self-supervised loss term refines the coarse depth map by minimizing reprojection, gradients, and structural dissimilarity loss. Together, our method produces high-quality 3D maps with minimum re-projection loss that are 0.0004132 (structural similarity index), 0.00036120156 (L1 error distance) and 6.591908 × 10<sup>−5</sup> (L1 gradient error distance).</p></div><div><h3>Conclusion</h3><p>Machine learning techniques for monocular depth prediction is studied to infer accurate depth maps from a single-color arthroscopic video frame. Moreover, the study integrates segmentation model hence, 3D segmented maps are inferred that provides extended perception ability and tissue awareness.</p></div>","PeriodicalId":73400,"journal":{"name":"Intelligent medicine","volume":"3 2","pages":"Pages 129-138"},"PeriodicalIF":0.0,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50190786","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Reflection on the equitable attribution of responsibility for artificial intelligence-assisted diagnosis and treatment decisions","authors":"Antian Chen , Chenyu Wang , Xinqing Zhang","doi":"10.1016/j.imed.2022.04.002","DOIUrl":"10.1016/j.imed.2022.04.002","url":null,"abstract":"<div><p>Artificial intelligence (AI) is developing rapidly and is being used in several medical capacities, including assisting in diagnosis and treatment decisions. As a result, this raises the conceptual and practical problem of how to distribute responsibility when AI-assisted diagnosis and treatment have been used and patients are harmed in the process. Regulations on this issue have not yet been established. It would be beneficial to tackle responsibility attribution prior to the development of biomedical AI technologies and ethical guidelines.</p><p>In general, human doctors acting as superiors need to bear responsibility for their clinical decisions. However, human doctors should not bear responsibility for the behavior of an AI doctor that is practicing medicine independently. According to the degree of fault—which includes internal institutional ethics, the AI bidding process in procurement, and the medical process—clinical institutions are required to bear corresponding responsibility. AI manufacturers are responsible for creating accurate algorithms, network security, and insuring patient privacy protection. However, the AI itself should not be subjected to legal evaluation since there is no need for it to bear responsibility. Corresponding responsibility should be borne by the employer, in this case the medical institution.</p></div>","PeriodicalId":73400,"journal":{"name":"Intelligent medicine","volume":"3 2","pages":"Pages 139-143"},"PeriodicalIF":0.0,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47178596","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yuchao Zheng , Chen Li , Xiaomin Zhou , Haoyuan Chen , Hao Xu , Yixin Li , Haiqing Zhang , Xiaoyan Li , Hongzan Sun , Xinyu Huang , Marcin Grzegorzek
{"title":"Application of transfer learning and ensemble learning in image-level classification for breast histopathology","authors":"Yuchao Zheng , Chen Li , Xiaomin Zhou , Haoyuan Chen , Hao Xu , Yixin Li , Haiqing Zhang , Xiaoyan Li , Hongzan Sun , Xinyu Huang , Marcin Grzegorzek","doi":"10.1016/j.imed.2022.05.004","DOIUrl":"https://doi.org/10.1016/j.imed.2022.05.004","url":null,"abstract":"<div><h3>Background</h3><p>Breast cancer has the highest prevalence among all cancers in women globally. The classification of histopathological images in the diagnosis of breast cancers is an area of clinical concern. In computer-aided diagnosis, most traditional classification models use a single network to extract features, although this approach has significant limitations. Moreover, many networks are trained and optimized on patient-level datasets, ignoring lower-level data labels.</p></div><div><h3>Methods</h3><p>This paper proposed a deep ensemble model based on image-level labels for the binary classification of breast histopathological images of benign and malignant lesions. First, the BreaKHis dataset was randomly divided into training, validation, and test sets. Then, data augmentation techniques were used to balance the numbers of benign and malignant samples. Third, based on their transfer learning performance and the complementarity between networks, VGG16, Xception, ResNet50, and DenseNet201 were selected as base classifiers.</p></div><div><h3>Results</h3><p>In a ensemble network model with accuracy as the weight, the image-level binary classification achieved an accuracy of <span><math><mrow><mn>98.90</mn><mo>%</mo></mrow></math></span>. To verify the capabilities of our method, it was experimentally compared with the latest transformer and multilayer perception (MLP) models on the same dataset. Our ensemble model showed a <span><math><mrow><mn>5</mn><mo>%</mo></mrow></math></span>–<span><math><mrow><mn>20</mn><mo>%</mo></mrow></math></span> advantage, emphasizing its far-reaching abilities in classification tasks.</p></div><div><h3>Conclusions</h3><p>This research focuses on improving the performance of a classification model with an ensemble algorithm. Transfer learning has an essential role in classification of small datasets, improving training speed and accuracy. Our model may outperform many existing approaches with respect to accuracy and has applications in the field of auxiliary medical diagnosis.</p></div>","PeriodicalId":73400,"journal":{"name":"Intelligent medicine","volume":"3 2","pages":"Pages 115-128"},"PeriodicalIF":0.0,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50190783","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Honghao Shi , Jingyuan Wang , Jiawei Cheng , Xiaopeng Qi , Hanran Ji , Claudio J Struchiner , Daniel AM Villela , Eduard V Karamov , Ali S Turgiev
{"title":"Big data technology in infectious diseases modeling, simulation, and prediction after the COVID-19 outbreak","authors":"Honghao Shi , Jingyuan Wang , Jiawei Cheng , Xiaopeng Qi , Hanran Ji , Claudio J Struchiner , Daniel AM Villela , Eduard V Karamov , Ali S Turgiev","doi":"10.1016/j.imed.2023.01.002","DOIUrl":"10.1016/j.imed.2023.01.002","url":null,"abstract":"<div><p>After the outbreak of COVID-19, the interaction of infectious disease systems and social systems has challenged traditional infectious disease modeling methods. Starting from the research purpose and data, researchers improved the structure and data of the compartment model or used agents and artificial intelligence based models to solve epidemiological problems. In terms of modeling methods, the researchers use compartment subdivision, dynamic parameters, agent-based model methods, and artificial intelligence related methods. In terms of factors studied, the researchers studied 6 categories: human mobility, nonpharmaceutical interventions (NPIs), ages, medical resources, human response, and vaccine. The researchers completed the study of factors through modeling methods to quantitatively analyze the impact of social systems and put forward their suggestions for the future transmission status of infectious diseases and prevention and control strategies. This review started with a research structure of research purpose, factor, data, model, and conclusion. Focusing on the post-COVID-19 infectious disease prediction simulation research, this study summarized various improvement methods and analyzes matching improvements for various specific research purposes.</p></div>","PeriodicalId":73400,"journal":{"name":"Intelligent medicine","volume":"3 2","pages":"Pages 85-96"},"PeriodicalIF":0.0,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9851724/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9639163","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Li Cai , Tong Zhao , Yongheng Wang , Xiaoyu Luo , Hao Gao
{"title":"Fluid–structure interaction simulation of pathological mitral valve dynamics in a coupled mitral valve-left ventricle model","authors":"Li Cai , Tong Zhao , Yongheng Wang , Xiaoyu Luo , Hao Gao","doi":"10.1016/j.imed.2022.06.005","DOIUrl":"https://doi.org/10.1016/j.imed.2022.06.005","url":null,"abstract":"<div><p><strong>Background</strong> Understanding the interaction between the mitral valve (MV) and the left ventricle (LV) is very important in assessing cardiac pump function, especially when the MV is dysfunctional. Such dysfunction is a major medical problem owing to the essential role of the MV in cardiac pump function. Computational modelling can provide new approaches to gain insight into the functions of the MV and LV.</p><p><strong>Methods</strong> In this study, a previously developed LV–MV model was used to study cardiac dynamics of MV leaflets under normal and pathological conditions, including hypertrophic cardiomyopathy (HOCM) and calcification of the valve. The coupled LV–MV model was implemented using a hybrid immersed boundary/finite element method to enable assessment of MV haemodynamic performance. Constitutive parameters of the HOCM and calcified valves were inversely determined from published experimental data. The LV compensation mechanism was further studied in the case of the calcified MV.</p><p><strong>Results</strong> Our results showed that MV dynamics and LV pump function could be greatly affected by MV pathology. For example, the HOCM case showed bulged MV leaflets at the systole owing to low stiffness, and the calcified MV was associated with impaired diastolic filling and much-reduced stroke volume. We further demonstrated that either increasing the LV filling pressure or increasing myocardial contractility could enable a calcified valve to achieve near-normal pump function.</p><p><strong>Conclusion</strong> The modelling approach developed in this study may deepen our understanding of the interactions between the MV and the LV and help in risk stratification of heart valve disease and <em>in silico</em> treatment planning by exploring intrinsic compensation mechanisms.</p></div>","PeriodicalId":73400,"journal":{"name":"Intelligent medicine","volume":"3 2","pages":"Pages 104-114"},"PeriodicalIF":0.0,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50190782","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yahan Yang , Ruiyang Li , Yifan Xiang , Duoru Lin , Anqi Yan , Wenben Chen , Zhongwen Li , Weiyi Lai , Xiaohang Wu , Cheng Wan , Wei Bai , Xiucheng Huang , Qiang Li , Wenrui Deng , Xiyang Liu , Yucong Lin , Pisong Yan , Haotian Lin , Chinese Association of Artificial Intelligence, Medical Artificial Intelligence Branch of Guangdong Medical Association
{"title":"Expert recommendation on collection, storage, annotation, and management of data related to medical artificial intelligence","authors":"Yahan Yang , Ruiyang Li , Yifan Xiang , Duoru Lin , Anqi Yan , Wenben Chen , Zhongwen Li , Weiyi Lai , Xiaohang Wu , Cheng Wan , Wei Bai , Xiucheng Huang , Qiang Li , Wenrui Deng , Xiyang Liu , Yucong Lin , Pisong Yan , Haotian Lin , Chinese Association of Artificial Intelligence, Medical Artificial Intelligence Branch of Guangdong Medical Association","doi":"10.1016/j.imed.2021.11.002","DOIUrl":"https://doi.org/10.1016/j.imed.2021.11.002","url":null,"abstract":"<div><p>Medical artificial intelligence (AI) and big data technology have rapidly advanced in recent years, and they are now routinely used for image-based diagnosis. China has a massive amount of medical data. However, a uniform criteria for medical data quality have yet to be established. Therefore, this review aimed to develop a standardized and detailed set of quality criteria for medical data collection, storage, annotation, and management related to medical AI. This would greatly improve the process of medical data resource sharing and the use of AI in clinical medicine.</p></div>","PeriodicalId":73400,"journal":{"name":"Intelligent medicine","volume":"3 2","pages":"Pages 144-149"},"PeriodicalIF":0.0,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50190785","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yiwen Wang , Xiaojian Ji , Lidong Hu, Jian Zhu, Jianglin Zhang, Feng Huang
{"title":"Internet-based nationwide evaluation of patient preferences for mobile health features in ankylosing spondylitis","authors":"Yiwen Wang , Xiaojian Ji , Lidong Hu, Jian Zhu, Jianglin Zhang, Feng Huang","doi":"10.1016/j.imed.2022.05.002","DOIUrl":"https://doi.org/10.1016/j.imed.2022.05.002","url":null,"abstract":"<div><h3>Background</h3><p>Ankylosing spondylitis (AS) generally occurs in young adults. The functional impairments resulting in limitation in activities and social participation might exert lifetime impacts. The present study investigated the preferences for mobile health (mHealth) features motivating the self-management behaviors in AS.</p></div><div><h3>Methods</h3><p>The present study was an internet-based, nationwide quantitative study based on the Chinese Ankylosing Spondylitis Prospective Imaging Cohort (CASPIC) study, which was a nationwide, ongoing, prospective cohort study launched in conjunction with Smart-phone SpondyloArthritis Management System (SpAMS) in China. Participants with AS from the CASPIC were invited to report their mHealth preferences from December 2019 to February 2020. The questionnaire was designed to determine the patient preferences for 28 mHealth features. Sociodemographic characteristics, including age, gender, and work status, were collected.</p></div><div><h3>Results</h3><p>Among all the visitors to the online questionnaire (<em>n</em> = 872), 93.9% (819/872) respondents fully completed the questionnaire and were enrolled in the present study. The mean age was (33.4 ± 9.0) years, and 70.57% (578/819) of the respondents were males. The mean scores of 22 (78.57%) features were greater than 4 (like or strongly like). The mean standard deviation (SD) score of exercise instructions was 4.70 (0.63), which was the most preferred feature, whereas the social interaction features were preferred the least. Pain analysis was more preferred among female respondents (4.72 <em>vs.</em> 4.60, <em>P</em> = 0.012), whereas all items of the social interaction theme and social interaction as a whole (3.73 <em>vs.</em> 3.52, <em>P</em> < 0.001) were less preferred among female respondents. Additionally, the following themes were more preferred by respondents aged ≤ 40 years: credibility and styling (4.37 <em>vs.</em> 4.19, <em>P</em> < 0.001); disease action support (4.55 <em>vs.</em> 4.47, <em>P</em> = 0.007); and incentivization (4.35 <em>vs</em>. 4.24, <em>P</em> = 0.025).</p></div><div><h3>Conclusion</h3><p>AS patients show great interest for the majority of mHealth features. Exercise instructions and exercise scheduling are the most preferred features, whereas social interaction is the least preferred feature. In addition, gender-related and age-related differences exist in mHealth feature preferences.</p></div>","PeriodicalId":73400,"journal":{"name":"Intelligent medicine","volume":"3 2","pages":"Pages 97-103"},"PeriodicalIF":0.0,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50190781","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Real-time digital data of international passengers will shine in the precaution of epidemics","authors":"Naizhe Li , Lu Dong","doi":"10.1016/j.imed.2022.10.002","DOIUrl":"10.1016/j.imed.2022.10.002","url":null,"abstract":"<div><p>International movement plays an important role in spatial spread of infectious diseases. Here, we share two successful COVID-19 interventions based on real-time digital information collected from international passengers, which have been performed in Greece and China respectively. Both of the interventions demonstrated good performance and showed the potential of real-time digital data in containing the spread. However, several key points should not be ignored when we promote similar strategies.</p></div>","PeriodicalId":73400,"journal":{"name":"Intelligent medicine","volume":"3 1","pages":"Pages 44-45"},"PeriodicalIF":0.0,"publicationDate":"2023-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9595419/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9117733","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Application of big data and artificial intelligence in epidemic surveillance and containment","authors":"Zengtao Jiao , Hanran Ji , Jun Yan , Xiaopeng Qi","doi":"10.1016/j.imed.2022.10.003","DOIUrl":"10.1016/j.imed.2022.10.003","url":null,"abstract":"<div><p>Faced with the current time-sensitive COVID-19 pandemic, the overburdened healthcare systems have resulted in a strong demand to develop newer methods to control the spread of the pandemic. Big data and artificial intelligence (AI) have been leveraged amid the COVID-19 pandemic; however, little is known about their use for supporting public health efforts. In epidemic surveillance and containment, efforts are needed to treat critical patients, track and manage the health status of residents, isolate suspected cases, and develop vaccines and antiviral drugs. The applications of emerging practices of artificial intelligence and big data have become powerful “weapons” to fight against the pandemic and provide strong support in pandemic prevention and control, such as early warning, analysis and judgment, interruption and intervention of epidemic, to achieve goals of early detection, early report, early diagnosis, early isolation and early treatment. These are the decisive factors to control the spread of the epidemic and reduce the mortality. This paper systematically summarized the application of big data and AI in epidemic, and describes practical cases and challenges with emphasis on epidemic prevention and control. The included studies showed that big data and AI have the potential strength to fight against COVID-19. However, many of the proposed methods are not yet widely accepted. Thus, the most rewarding research would be on methods that promise value beyond COVID-19. More efforts are needed for developing standardized reporting protocols or guidelines for practice.</p></div>","PeriodicalId":73400,"journal":{"name":"Intelligent medicine","volume":"3 1","pages":"Pages 36-43"},"PeriodicalIF":0.0,"publicationDate":"2023-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9636598/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9263302","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}