{"title":"Real-time surgical tool detection with multi-scale positional encoding and contrastive learning","authors":"Gerardo Loza, Pietro Valdastri, Sharib Ali","doi":"10.1049/htl2.12060","DOIUrl":"10.1049/htl2.12060","url":null,"abstract":"<p>Real-time detection of surgical tools in laparoscopic data plays a vital role in understanding surgical procedures, evaluating the performance of trainees, facilitating learning, and ultimately supporting the autonomy of robotic systems. Existing detection methods for surgical data need to improve processing speed and high prediction accuracy. Most methods rely on anchors or region proposals, limiting their adaptability to variations in tool appearance and leading to sub-optimal detection results. Moreover, using non-anchor-based detectors to alleviate this problem has been partially explored without remarkable results. An anchor-free architecture based on a transformer that allows real-time tool detection is introduced. The proposal is to utilize multi-scale features within the feature extraction layer and at the transformer-based detection architecture through positional encoding that can refine and capture context-aware and structural information of different-sized tools. Furthermore, a supervised contrastive loss is introduced to optimize representations of object embeddings, resulting in improved feed-forward network performances for classifying localized bounding boxes. The strategy demonstrates superiority to state-of-the-art (SOTA) methods. Compared to the most accurate existing SOTA (DSSS) method, the approach has an improvement of nearly 4% on mAP<span></span><math>\u0000 <semantics>\u0000 <msub>\u0000 <mrow></mrow>\u0000 <mn>50</mn>\u0000 </msub>\u0000 <annotation>$_{50}$</annotation>\u0000 </semantics></math> and a reduction in the inference time by 113%. It also showed a 7% higher mAP<span></span><math>\u0000 <semantics>\u0000 <msub>\u0000 <mrow></mrow>\u0000 <mn>50</mn>\u0000 </msub>\u0000 <annotation>$_{50}$</annotation>\u0000 </semantics></math> than the baseline model.</p>","PeriodicalId":37474,"journal":{"name":"Healthcare Technology Letters","volume":"11 2-3","pages":"48-58"},"PeriodicalIF":2.1,"publicationDate":"2023-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/htl2.12060","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138593167","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Guansen Tong, Jiayi Xu, Michael Pfister, Jumanh Atoum, Kavita Prasad, Alexis Miller, Michael Topf, Jie Ying Wu
{"title":"Development of an augmented reality guidance system for head and neck cancer resection","authors":"Guansen Tong, Jiayi Xu, Michael Pfister, Jumanh Atoum, Kavita Prasad, Alexis Miller, Michael Topf, Jie Ying Wu","doi":"10.1049/htl2.12062","DOIUrl":"10.1049/htl2.12062","url":null,"abstract":"<p>The use of head-mounted augmented reality (AR) for surgeries has grown rapidly in recent years. AR aids in intraoperative surgical navigation through overlaying three-dimensional (3D) holographic reconstructions of medical data. However, performing AR surgeries on complex areas such as the head and neck region poses challenges in terms of accuracy and speed. This study explores the feasibility of an AR guidance system for resections of positive tumour margins in a cadaveric specimen. The authors present an intraoperative solution that enables surgeons to upload and visualize holographic reconstructions of resected cadaver tissues. The solution involves using a 3D scanner to capture detailed scans of the resected tissue, which are subsequently uploaded into our software. The software converts the scans of resected tissues into specimen holograms that are viewable through a head-mounted AR display. By re-aligning these holograms with cadavers with gestures or voice commands, surgeons can navigate the head and neck tumour site. This workflow can run concurrently with frozen section analysis. On average, the authors achieve an uploading time of 2.98 min, visualization time of 1.05 min, and re-alignment time of 4.39 min, compared to the 20 to 30 min typical for frozen section analysis. The authors achieve a mean re-alignment error of 3.1 mm. The authors’ software provides a foundation for new research and product development for using AR to navigate complex 3D anatomy in surgery.</p>","PeriodicalId":37474,"journal":{"name":"Healthcare Technology Letters","volume":"11 2-3","pages":"93-100"},"PeriodicalIF":2.1,"publicationDate":"2023-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/htl2.12062","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138590745","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Proof-of-concept of a robotic-driven photogrammetric scanner for intra-operative knee cartilage repair","authors":"Álvaro Bertelsen, Amaia Iribar-Zabala, Ekiñe Otegi-Alvaro, Rafael Benito, Karen López-Linares, Iván Macía","doi":"10.1049/htl2.12054","DOIUrl":"10.1049/htl2.12054","url":null,"abstract":"<p>This work presents a proof-of-concept of a robotic-driven intra-operative scanner designed for knee cartilage lesion repair, part of a system for direct in vivo bioprinting. The proposed system is based on a photogrammetric pipeline, which reconstructs the cartilage and lesion surfaces from sets of photographs acquired by a robotic-handled endoscope, and produces 3D grafts for further printing path planning. A validation on a synthetic phantom is presented, showing that, despite the cartilage smooth and featureless surface, the current prototype can accurately reconstruct osteochondral lesions and their surroundings with mean error values of 0.199 ± 0.096 mm but with noticeable concentration on areas with poor lighting or low photographic coverage. The system can also accurately generate grafts for bioprinting, although with a slight tendency to underestimate the actual lesion sizes, producing grafts with coverage errors of −12.2 ± 3.7, −7.9 ± 4.9, and −15.2 ± 3.4% for the medio-lateral, antero-posterior, and craneo-caudal directions, respectively. Improvements in lighting and acquisition for enhancing reconstruction accuracy are planned as future work, as well as integration into a complete bioprinting pipeline and validation with ex vivo phantoms.</p>","PeriodicalId":37474,"journal":{"name":"Healthcare Technology Letters","volume":"11 2-3","pages":"59-66"},"PeriodicalIF":2.1,"publicationDate":"2023-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/htl2.12054","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138598457","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ruiqing Wang, Jie Zhang, Shilin He, Huayuan Guo, Tao Li, Qin Zhong, Jun Ma, Jie Xu, Kunlun He
{"title":"Design and application of a novel telemedicine system jointly driven by multinetwork integration and remote control: Practical experience from PLAGH, China","authors":"Ruiqing Wang, Jie Zhang, Shilin He, Huayuan Guo, Tao Li, Qin Zhong, Jun Ma, Jie Xu, Kunlun He","doi":"10.1049/htl2.12057","DOIUrl":"10.1049/htl2.12057","url":null,"abstract":"<p>In China, several problems were common in the telemedicine systems, such as the poor network stability and difficult interconnection. A new telemedicine system jointly driven by multinetwork integration and remote control has been designed to address these problems. A multilink aggregation algorithm and an overlay network for telemedicine system (ONTMS) were developed to improve network stability, and a non-intervention remote control method was designed for Internet of Things (IoT) devices/systems. The authors monitored the network parameters, and distributed the questionnaire to participants, for evaluating the telemedicine system and services. Under a detection bandwidth of 8 Mbps, the aggregation parameters of Unicom 4G, Telecom 4G, and China Mobile 4G were optimal, with an uplink bandwidth, delay, and packet loss ratio (PLR) of 7.93 Mbps, 58.80 ms, and 0.06%, respectively. These parameters were significantly superior to those of China Mobile 4G, the best single network (<i>p</i> < 0.001). Through the ONTMS, the mean round-trip transporting delay from Beijing to Sanya was 76 ms, and the PLR was 0 at vast majority of time. A total of 1988 participants, including 1920 patients and 68 doctors, completed the questionnaires. More than 97% of participants felt that the audio and video transmission and remote control were fluent and convenient. 96% of patients rated the telemedicine services with scores of 4 or 5. This system has shown robust network property and excellent interaction ability, and satisfied the needs of patients and doctors.</p>","PeriodicalId":37474,"journal":{"name":"Healthcare Technology Letters","volume":"10 6","pages":"113-121"},"PeriodicalIF":2.1,"publicationDate":"2023-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ietresearch.onlinelibrary.wiley.com/doi/epdf/10.1049/htl2.12057","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138600245","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Nadia Cattari, Fabrizio Cutolo, Luciana La Placa, Vincenzo Ferrari
{"title":"Visualization modality for augmented reality guidance of in-depth tumour enucleation procedures","authors":"Nadia Cattari, Fabrizio Cutolo, Luciana La Placa, Vincenzo Ferrari","doi":"10.1049/htl2.12058","DOIUrl":"10.1049/htl2.12058","url":null,"abstract":"<p>Recent research studies reported that the employment of wearable augmented reality (AR) systems such as head-mounted displays for the in situ visualisation of ultrasound (US) images can improve the outcomes of US-guided biopsies through reduced procedure completion times and improved accuracy. Here, the authors continue in the direction of recent developments and present the first AR system for guiding an in-depth tumour enucleation procedure under US guidance. The system features an innovative visualisation modality with cutting trajectories that ‘sink’ into the tissue according to the depth reached by the electric scalpel, tracked in real-time, and a virtual-to-virtual alignment between the scalpel's tip and the trajectory. The system has high accuracy in estimating the scalpel's tip position (mean depth error of 0.4 mm and mean radial error of 1.34 mm). Furthermore, we demonstrated with a preliminary user study that our system allowed us to successfully guide an in-depth tumour enucleation procedure (i.e. preserving the safety margin around the lesion).</p>","PeriodicalId":37474,"journal":{"name":"Healthcare Technology Letters","volume":"11 2-3","pages":"101-107"},"PeriodicalIF":2.1,"publicationDate":"2023-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/htl2.12058","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138605002","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jasper Hofman, Pieter De Backer, Ilaria Manghi, Jente Simoens, Ruben De Groote, Hannes Van Den Bossche, Mathieu D'Hondt, Tim Oosterlinck, Julie Lippens, Charles Van Praet, Federica Ferraguti, Charlotte Debbaut, Zhijin Li, Oliver Kutter, Alexandre Mottrie, Karel Decaestecker
{"title":"First-in-human real-time AI-assisted instrument deocclusion during augmented reality robotic surgery","authors":"Jasper Hofman, Pieter De Backer, Ilaria Manghi, Jente Simoens, Ruben De Groote, Hannes Van Den Bossche, Mathieu D'Hondt, Tim Oosterlinck, Julie Lippens, Charles Van Praet, Federica Ferraguti, Charlotte Debbaut, Zhijin Li, Oliver Kutter, Alexandre Mottrie, Karel Decaestecker","doi":"10.1049/htl2.12056","DOIUrl":"10.1049/htl2.12056","url":null,"abstract":"<p>The integration of Augmented Reality (AR) into daily surgical practice is withheld by the correct registration of pre-operative data. This includes intelligent 3D model superposition whilst simultaneously handling real and virtual occlusions caused by the AR overlay. Occlusions can negatively impact surgical safety and as such deteriorate rather than improve surgical care. Robotic surgery is particularly suited to tackle these integration challenges in a stepwise approach as the robotic console allows for different inputs to be displayed in parallel to the surgeon. Nevertheless, real-time de-occlusion requires extensive computational resources which further complicates clinical integration. This work tackles the problem of instrument occlusion and presents, to the authors’ best knowledge, the first-in-human on edge deployment of a real-time binary segmentation pipeline during three robot-assisted surgeries: partial nephrectomy, migrated endovascular stent removal, and liver metastasectomy. To this end, a state-of-the-art real-time segmentation and 3D model pipeline was implemented and presented to the surgeon during live surgery. The pipeline allows real-time binary segmentation of 37 non-organic surgical items, which are never occluded during AR. The application features real-time manual 3D model manipulation for correct soft tissue alignment. The proposed pipeline can contribute towards surgical safety, ergonomics, and acceptance of AR in minimally invasive surgery.</p>","PeriodicalId":37474,"journal":{"name":"Healthcare Technology Letters","volume":"11 2-3","pages":"33-39"},"PeriodicalIF":2.1,"publicationDate":"2023-12-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/htl2.12056","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138607728","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Albert Alexander Stonier, Rakesh Krishna Gorantla, K Manoj
{"title":"Cardiac disease risk prediction using machine learning algorithms","authors":"Albert Alexander Stonier, Rakesh Krishna Gorantla, K Manoj","doi":"10.1049/htl2.12053","DOIUrl":"10.1049/htl2.12053","url":null,"abstract":"<p>Heart attack is a life-threatening condition which is mostly caused due to coronary disease resulting in death in human beings. Detecting the risk of heart diseases is one of the most important problems in medical science that can be prevented and treated with early detection and appropriate medical management; it can also help to predict a large number of medical needs and reduce expenses for treatment. Predicting the occurrence of heart diseases by machine learning (ML) algorithms has become significant work in healthcare industry. This study aims to create a such system that is used for predicting whether a patient is likely to develop heart attacks, by analysing various data sources including electronic health records and clinical diagnosis reports from hospital clinics. ML is used as a process in which computers learn from data in order to make predictions about new datasets. The algorithms created for predictive data analysis are often used for commercial purposes. This paper presents an overview to forecast the likelihood of a heart attack for which many ML methodologies and techniques are applied. In order to improve medical diagnosis, the paper compares various algorithms such as Random Forest, Regression models, K-nearest neighbour imputation (KNN), Naïve Bayes algorithm etc. It is found that the Random Forest algorithm provides a better accuracy of 88.52% in forecasting heart attack risk, which could herald a revolution in the diagnosis and treatment of cardiovascular illnesses.</p>","PeriodicalId":37474,"journal":{"name":"Healthcare Technology Letters","volume":"11 4","pages":"213-217"},"PeriodicalIF":2.8,"publicationDate":"2023-11-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/htl2.12053","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139203718","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Richard Laugharne, Mohsen Farid, Christopher James, Anirban Dutta, Christopher Mould, Noelle Molten, Jonathan Laugharne, Rohit Shankar
{"title":"Neurotechnological solutions for post-traumatic stress disorder: A perspective review and concept proposal","authors":"Richard Laugharne, Mohsen Farid, Christopher James, Anirban Dutta, Christopher Mould, Noelle Molten, Jonathan Laugharne, Rohit Shankar","doi":"10.1049/htl2.12055","DOIUrl":"https://doi.org/10.1049/htl2.12055","url":null,"abstract":"<p>Post-traumatic stress disorder (PTSD) is an anxiety condition caused by exposure to severe trauma. It is characterised by nightmares, flashbacks, hyper-vigilance and avoidance behaviour. These all lead to impaired functioning reducing quality of life. PTSD affects 2–5% of the population globally. Most sufferers cannot access effective treatment, leading to impaired psychological functioning reducing quality of life. Eye movement desensitisation and reprocessing (EMDR) is a non-invasive brain stimulation treatment that has shown significant clinical effectiveness in PTSD. Another treatment modality, that is, trauma-focused cognitive behavioural therapy is also an effective intervention. However, both evidence-based treatments are significantly resource intensive as they need trained therapists to deliver them. A concept of a neuro-digital tool for development is proposed to put to clinical practice of delivering EMDR to improve availability, efficiency and effectiveness of treatment. The evidence in using new technologies to measure sleep, geolocation and conversational analysis of social media to report objective outcome measures is explored. If achieved, this can be fed back to users with data anonymously collated to evaluate and improve the tool. Coproduction would be at the heart of product development so that the tool is acceptable and accessible to people with the condition.</p>","PeriodicalId":37474,"journal":{"name":"Healthcare Technology Letters","volume":"10 6","pages":"133-138"},"PeriodicalIF":2.1,"publicationDate":"2023-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ietresearch.onlinelibrary.wiley.com/doi/epdf/10.1049/htl2.12055","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138713840","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Electronic health records perception among three healthcare providers specialties in Saudi Arabia: A cross-sectional study","authors":"A. Karim Jabali, Fuad A. Abdulla","doi":"10.1049/htl2.12052","DOIUrl":"10.1049/htl2.12052","url":null,"abstract":"<p>Worldwide, more health care facilities are adapting the use of electronic health record (EHR). Healthcare providers (HCP) have different perceptions toward the use of EHR. To investigate the perception of three classes of HCP in Saudi Arabia toward using EHR, a questionnaire (targeting satisfaction, easiness, and benefits of use as major perception indicators) was prepared. The questionnaire was assessed by an expert panel for content validity. The questionnaire internal consistency was examined using Cronbach's alpha. 108 physicians, physical therapists (PT) and respiratory care therapists (RT) from different hospitals in Saudi Arabia answered the questionnaire. Most of respondents perceived EHR systems as beneficial and made work easier. Most HCP were satisfied with the use of EHR, however, with the use of EHR more time was needed to finish the work. Age, experience, job, and job rank of HCP are of different importance in determining responses, perception, and obstacles of using EHR. Moreover, the perception of using EHR seems to be field specific. There is a positive perception among Saudi Arabia HCP about EHR use.</p>","PeriodicalId":37474,"journal":{"name":"Healthcare Technology Letters","volume":"10 5","pages":"104-111"},"PeriodicalIF":2.1,"publicationDate":"2023-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/b5/9c/HTL2-10-104.PMC10546086.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41145457","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Dumtoochukwu Obiora Oyeka, John Batchelor, Rachel Saunders
{"title":"A comparison of conductive ink usage optimization techniques used in fabrication of epidermal UHF radio frequency identification tags for medical and sensing applications","authors":"Dumtoochukwu Obiora Oyeka, John Batchelor, Rachel Saunders","doi":"10.1049/htl2.12051","DOIUrl":"10.1049/htl2.12051","url":null,"abstract":"<p>The aim of this work is to assess the performance of various inkjet printing techniques. These techniques are aimed at optimizing the volume of conductive ink used in the fabrication of inkjet printed Radio Frequency Identification tags. It is also possible that they can be used in fabricating other electronic and electromagnetic devices and structures. Three ink optimization approaches were examined viz. gridded (meshed) designs, conductive area trimming and selective ink deposition. The volume of conductive ink utilized in tag fabrication and the measured on-body (forearm) read range of the tag were used to develop a figure of merit which determined the best printing approach. Although the longest read range was obtained from the tag with 48% conductive area trimming (Trim 1), the best figure of merit, that is, the tag with the best balance between measured read range and utilized conductive ink, was obtained from the tag that had its surface area trimmed by 65% (Trim 2). It is however suggested that optimum use of conductive ink would be achieved with a combination of 65% surface area trimming and selective ink deposition technique.</p>","PeriodicalId":37474,"journal":{"name":"Healthcare Technology Letters","volume":"10 5","pages":"99-103"},"PeriodicalIF":2.1,"publicationDate":"2023-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ietresearch.onlinelibrary.wiley.com/doi/epdf/10.1049/htl2.12051","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41173348","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}