{"title":"利用注意力和门控机制增强运算器学习的深度神经网络,用于肿瘤生长的长期预测","authors":"Qijing Chen, He Li, Xiaoning Zheng","doi":"10.1007/s00366-024-02003-0","DOIUrl":null,"url":null,"abstract":"<p>Forecasting tumor progression and assessing the uncertainty of predictions play a crucial role in clinical settings, especially for determining disease outlook and making informed decisions about treatment approaches. In this work, we propose TGM-ONets, a deep neural operator learning (PI-DeepONet) based computational framework, which combines bioimaging and tumor growth modeling (TGM) for enhanced prediction of tumor growth. Deep neural operators have recently emerged as a powerful tool for learning the solution maps between the function spaces, and they have demonstrated their generalization capability in making predictions based on unseen input instances once trained. Incorporating the physics laws into the loss function of the deep neural operator can significantly reduce the amount of the training data. The novelties of the design of TGM-ONets include the employment of a convolutional block attention module (CBAM) and a gating mechanism (i.e., mixture of experts (MoE)) to extract the features of the input images. Our results show that the TGM-ONets not only can capture the detailed morphological characteristics of the mild and aggressive tumors within and outside the training domain but also can be used to predict the long-term dynamics of both mild and aggressive tumor growth for up to 6 months with a maximum error of less than 6.7 <span>\\(\\times 10^{-2}\\)</span> for unseen input instances with two or three snapshots added. We also systematically study the effects of the number of training snapshots and noisy data on the performance of TGM-ONets as well as quantify the uncertainty of the model predictions. We demonstrate the efficiency and accuracy by comparing the performance of TGM-ONets with three state-of-the-art (SOTA) baseline models. In summary, we propose a new deep learning model capable of integrating the TGM and sequential observations of tumor morphology to improve the current approaches for predicting tumor growth and thus provide an advanced computational tool for patient-specific tumor prognosis.</p>","PeriodicalId":11696,"journal":{"name":"Engineering with Computers","volume":null,"pages":null},"PeriodicalIF":8.7000,"publicationDate":"2024-07-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A deep neural network for operator learning enhanced by attention and gating mechanisms for long-time forecasting of tumor growth\",\"authors\":\"Qijing Chen, He Li, Xiaoning Zheng\",\"doi\":\"10.1007/s00366-024-02003-0\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Forecasting tumor progression and assessing the uncertainty of predictions play a crucial role in clinical settings, especially for determining disease outlook and making informed decisions about treatment approaches. In this work, we propose TGM-ONets, a deep neural operator learning (PI-DeepONet) based computational framework, which combines bioimaging and tumor growth modeling (TGM) for enhanced prediction of tumor growth. Deep neural operators have recently emerged as a powerful tool for learning the solution maps between the function spaces, and they have demonstrated their generalization capability in making predictions based on unseen input instances once trained. Incorporating the physics laws into the loss function of the deep neural operator can significantly reduce the amount of the training data. The novelties of the design of TGM-ONets include the employment of a convolutional block attention module (CBAM) and a gating mechanism (i.e., mixture of experts (MoE)) to extract the features of the input images. Our results show that the TGM-ONets not only can capture the detailed morphological characteristics of the mild and aggressive tumors within and outside the training domain but also can be used to predict the long-term dynamics of both mild and aggressive tumor growth for up to 6 months with a maximum error of less than 6.7 <span>\\\\(\\\\times 10^{-2}\\\\)</span> for unseen input instances with two or three snapshots added. We also systematically study the effects of the number of training snapshots and noisy data on the performance of TGM-ONets as well as quantify the uncertainty of the model predictions. We demonstrate the efficiency and accuracy by comparing the performance of TGM-ONets with three state-of-the-art (SOTA) baseline models. In summary, we propose a new deep learning model capable of integrating the TGM and sequential observations of tumor morphology to improve the current approaches for predicting tumor growth and thus provide an advanced computational tool for patient-specific tumor prognosis.</p>\",\"PeriodicalId\":11696,\"journal\":{\"name\":\"Engineering with Computers\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":8.7000,\"publicationDate\":\"2024-07-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Engineering with Computers\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1007/s00366-024-02003-0\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"Mathematics\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering with Computers","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1007/s00366-024-02003-0","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"Mathematics","Score":null,"Total":0}
A deep neural network for operator learning enhanced by attention and gating mechanisms for long-time forecasting of tumor growth
Forecasting tumor progression and assessing the uncertainty of predictions play a crucial role in clinical settings, especially for determining disease outlook and making informed decisions about treatment approaches. In this work, we propose TGM-ONets, a deep neural operator learning (PI-DeepONet) based computational framework, which combines bioimaging and tumor growth modeling (TGM) for enhanced prediction of tumor growth. Deep neural operators have recently emerged as a powerful tool for learning the solution maps between the function spaces, and they have demonstrated their generalization capability in making predictions based on unseen input instances once trained. Incorporating the physics laws into the loss function of the deep neural operator can significantly reduce the amount of the training data. The novelties of the design of TGM-ONets include the employment of a convolutional block attention module (CBAM) and a gating mechanism (i.e., mixture of experts (MoE)) to extract the features of the input images. Our results show that the TGM-ONets not only can capture the detailed morphological characteristics of the mild and aggressive tumors within and outside the training domain but also can be used to predict the long-term dynamics of both mild and aggressive tumor growth for up to 6 months with a maximum error of less than 6.7 \(\times 10^{-2}\) for unseen input instances with two or three snapshots added. We also systematically study the effects of the number of training snapshots and noisy data on the performance of TGM-ONets as well as quantify the uncertainty of the model predictions. We demonstrate the efficiency and accuracy by comparing the performance of TGM-ONets with three state-of-the-art (SOTA) baseline models. In summary, we propose a new deep learning model capable of integrating the TGM and sequential observations of tumor morphology to improve the current approaches for predicting tumor growth and thus provide an advanced computational tool for patient-specific tumor prognosis.
期刊介绍:
Engineering with Computers is an international journal dedicated to simulation-based engineering. It features original papers and comprehensive reviews on technologies supporting simulation-based engineering, along with demonstrations of operational simulation-based engineering systems. The journal covers various technical areas such as adaptive simulation techniques, engineering databases, CAD geometry integration, mesh generation, parallel simulation methods, simulation frameworks, user interface technologies, and visualization techniques. It also encompasses a wide range of application areas where engineering technologies are applied, spanning from automotive industry applications to medical device design.