利用深度学习网络和 RE-WAPICP 算法进行混合现实中的协同诊断

IF 4.1 3区计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS

ICT Express Pub Date : 2024-04-01 DOI:10.1016/j.icte.2023.11.002

Jiann-Der Lee , Jong-Chih Chien , Kuan-Chen Wang , Chieh-Tsai Wu

{"title":"利用深度学习网络和 RE-WAPICP 算法进行混合现实中的协同诊断","authors":"Jiann-Der Lee , Jong-Chih Chien , Kuan-Chen Wang , Chieh-Tsai Wu","doi":"10.1016/j.icte.2023.11.002","DOIUrl":null,"url":null,"abstract":"<div><p>This investigation explores the use of mixed-reality in collaborative diagnosis by sharing medical data in real-time between multiple physicians using Head-Mounted Display (HMD) devices. Object detection and alignment of the digitized data with the object are the backbone in any mixed-reality application. In this paper, deep-learning networks are used in detecting the patient’s face in the physical world and the medical data is aligned to the patient via the Region-Enhanced-Weight-and-Perturb Iterative-Closest-Point (RE-WAPICP) algorithm. Experiments were performed by sharing a 3D digital model of intracerebral vascular with multi-viewers in a mix-reality environment and the results show that this approach is feasible.</p></div>","PeriodicalId":48526,"journal":{"name":"ICT Express","volume":"10 2","pages":"Pages 451-457"},"PeriodicalIF":4.1000,"publicationDate":"2024-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2405959523001455/pdfft?md5=5c8ddc9ac0322633b9337d402b886a0c&pid=1-s2.0-S2405959523001455-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Collaborative diagnosis in mixed-reality using deep-learning networks and RE-WAPICP algorithm\",\"authors\":\"Jiann-Der Lee , Jong-Chih Chien , Kuan-Chen Wang , Chieh-Tsai Wu\",\"doi\":\"10.1016/j.icte.2023.11.002\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>This investigation explores the use of mixed-reality in collaborative diagnosis by sharing medical data in real-time between multiple physicians using Head-Mounted Display (HMD) devices. Object detection and alignment of the digitized data with the object are the backbone in any mixed-reality application. In this paper, deep-learning networks are used in detecting the patient’s face in the physical world and the medical data is aligned to the patient via the Region-Enhanced-Weight-and-Perturb Iterative-Closest-Point (RE-WAPICP) algorithm. Experiments were performed by sharing a 3D digital model of intracerebral vascular with multi-viewers in a mix-reality environment and the results show that this approach is feasible.</p></div>\",\"PeriodicalId\":48526,\"journal\":{\"name\":\"ICT Express\",\"volume\":\"10 2\",\"pages\":\"Pages 451-457\"},\"PeriodicalIF\":4.1000,\"publicationDate\":\"2024-04-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S2405959523001455/pdfft?md5=5c8ddc9ac0322633b9337d402b886a0c&pid=1-s2.0-S2405959523001455-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ICT Express\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2405959523001455\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ICT Express","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2405959523001455","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}

引用次数: 0

摘要

这项研究探讨了混合现实技术在协作诊断中的应用，即多名医生使用头戴式显示器（HMD）设备实时共享医疗数据。对象检测和数字化数据与对象的对齐是任何混合现实应用的支柱。本文使用深度学习网络检测物理世界中患者的面部，并通过区域增强-重量-扰动迭代-闭合点（RE-WAPICP）算法将医疗数据与患者对齐。实验是通过在混合现实环境中与多人共享脑内血管的三维数字模型进行的，结果表明这种方法是可行的。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

Collaborative diagnosis in mixed-reality using deep-learning networks and RE-WAPICP algorithm

This investigation explores the use of mixed-reality in collaborative diagnosis by sharing medical data in real-time between multiple physicians using Head-Mounted Display (HMD) devices. Object detection and alignment of the digitized data with the object are the backbone in any mixed-reality application. In this paper, deep-learning networks are used in detecting the patient’s face in the physical world and the medical data is aligned to the patient via the Region-Enhanced-Weight-and-Perturb Iterative-Closest-Point (RE-WAPICP) algorithm. Experiments were performed by sharing a 3D digital model of intracerebral vascular with multi-viewers in a mix-reality environment and the results show that this approach is feasible.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

ICT Express Multiple-

CiteScore

10.20

自引率

1.90%

发文量

167

审稿时长

35 weeks

期刊介绍： The ICT Express journal published by the Korean Institute of Communications and Information Sciences (KICS) is an international, peer-reviewed research publication covering all aspects of information and communication technology. The journal aims to publish research that helps advance the theoretical and practical understanding of ICT convergence, platform technologies, communication networks, and device technologies. The technology advancement in information and communication technology (ICT) sector enables portable devices to be always connected while supporting high data rate, resulting in the recent popularity of smartphones that have a considerable impact in economic and social development.