Wei-Chang Yeh, Wei-Chung Shia, Yun-Ting Hsu, Chun-Hui Huang, Yong-Shiuan Lee
{"title":"基于简化群优化和知识蒸馏的轻量级乳腺癌质量分类模型。","authors":"Wei-Chang Yeh, Wei-Chung Shia, Yun-Ting Hsu, Chun-Hui Huang, Yong-Shiuan Lee","doi":"10.3390/bioengineering12060640","DOIUrl":null,"url":null,"abstract":"<p><p>In recent years, an increasing number of women worldwide have been affected by breast cancer. Early detection is crucial, as it is the only way to identify abnormalities at an early stage. However, most deep learning models developed for classifying breast cancer abnormalities tend to be large-scale and computationally intensive, often overlooking the constraints of cost and limited computational resources. This research addresses these challenges by utilizing the CBIS-DDSM dataset and introducing a novel concatenated classification architecture and a two-stage strategy to develop an optimized, lightweight model for breast mass abnormality classification. Through data augmentation and image preprocessing, the proposed model demonstrates a superior performance compared to standalone CNN and DNN models. The two-stage strategy involves first constructing a compact model using knowledge distillation and then refining its structure with a heuristic approach known as Simplified Swarm Optimization (SSO). The experimental results confirm that knowledge distillation significantly enhances the model's performance. Furthermore, by applying SSO's full-variable update mechanism, the final model-SSO-Concatenated NASNetMobile (SSO-CNNM)-achieves outstanding performance metrics. It attains a compression rate of 96.17%, along with accuracy, precision, recall, and AUC scores of 96.47%, 97.4%, 94.94%, and 98.23%, respectively, outperforming other existing methods.</p>","PeriodicalId":8874,"journal":{"name":"Bioengineering","volume":"12 6","pages":""},"PeriodicalIF":3.8000,"publicationDate":"2025-06-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12189441/pdf/","citationCount":"0","resultStr":"{\"title\":\"A Lightweight Breast Cancer Mass Classification Model Utilizing Simplified Swarm Optimization and Knowledge Distillation.\",\"authors\":\"Wei-Chang Yeh, Wei-Chung Shia, Yun-Ting Hsu, Chun-Hui Huang, Yong-Shiuan Lee\",\"doi\":\"10.3390/bioengineering12060640\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>In recent years, an increasing number of women worldwide have been affected by breast cancer. Early detection is crucial, as it is the only way to identify abnormalities at an early stage. However, most deep learning models developed for classifying breast cancer abnormalities tend to be large-scale and computationally intensive, often overlooking the constraints of cost and limited computational resources. This research addresses these challenges by utilizing the CBIS-DDSM dataset and introducing a novel concatenated classification architecture and a two-stage strategy to develop an optimized, lightweight model for breast mass abnormality classification. Through data augmentation and image preprocessing, the proposed model demonstrates a superior performance compared to standalone CNN and DNN models. The two-stage strategy involves first constructing a compact model using knowledge distillation and then refining its structure with a heuristic approach known as Simplified Swarm Optimization (SSO). The experimental results confirm that knowledge distillation significantly enhances the model's performance. Furthermore, by applying SSO's full-variable update mechanism, the final model-SSO-Concatenated NASNetMobile (SSO-CNNM)-achieves outstanding performance metrics. It attains a compression rate of 96.17%, along with accuracy, precision, recall, and AUC scores of 96.47%, 97.4%, 94.94%, and 98.23%, respectively, outperforming other existing methods.</p>\",\"PeriodicalId\":8874,\"journal\":{\"name\":\"Bioengineering\",\"volume\":\"12 6\",\"pages\":\"\"},\"PeriodicalIF\":3.8000,\"publicationDate\":\"2025-06-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12189441/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Bioengineering\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.3390/bioengineering12060640\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, BIOMEDICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Bioengineering","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.3390/bioengineering12060640","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
A Lightweight Breast Cancer Mass Classification Model Utilizing Simplified Swarm Optimization and Knowledge Distillation.
In recent years, an increasing number of women worldwide have been affected by breast cancer. Early detection is crucial, as it is the only way to identify abnormalities at an early stage. However, most deep learning models developed for classifying breast cancer abnormalities tend to be large-scale and computationally intensive, often overlooking the constraints of cost and limited computational resources. This research addresses these challenges by utilizing the CBIS-DDSM dataset and introducing a novel concatenated classification architecture and a two-stage strategy to develop an optimized, lightweight model for breast mass abnormality classification. Through data augmentation and image preprocessing, the proposed model demonstrates a superior performance compared to standalone CNN and DNN models. The two-stage strategy involves first constructing a compact model using knowledge distillation and then refining its structure with a heuristic approach known as Simplified Swarm Optimization (SSO). The experimental results confirm that knowledge distillation significantly enhances the model's performance. Furthermore, by applying SSO's full-variable update mechanism, the final model-SSO-Concatenated NASNetMobile (SSO-CNNM)-achieves outstanding performance metrics. It attains a compression rate of 96.17%, along with accuracy, precision, recall, and AUC scores of 96.47%, 97.4%, 94.94%, and 98.23%, respectively, outperforming other existing methods.
期刊介绍:
Aims
Bioengineering (ISSN 2306-5354) provides an advanced forum for the science and technology of bioengineering. It publishes original research papers, comprehensive reviews, communications and case reports. Our aim is to encourage scientists to publish their experimental and theoretical results in as much detail as possible. All aspects of bioengineering are welcomed from theoretical concepts to education and applications. There is no restriction on the length of the papers. The full experimental details must be provided so that the results can be reproduced. There are, in addition, four key features of this Journal:
● We are introducing a new concept in scientific and technical publications “The Translational Case Report in Bioengineering”. It is a descriptive explanatory analysis of a transformative or translational event. Understanding that the goal of bioengineering scholarship is to advance towards a transformative or clinical solution to an identified transformative/clinical need, the translational case report is used to explore causation in order to find underlying principles that may guide other similar transformative/translational undertakings.
● Manuscripts regarding research proposals and research ideas will be particularly welcomed.
● Electronic files and software regarding the full details of the calculation and experimental procedure, if unable to be published in a normal way, can be deposited as supplementary material.
● We also accept manuscripts communicating to a broader audience with regard to research projects financed with public funds.
Scope
● Bionics and biological cybernetics: implantology; bio–abio interfaces
● Bioelectronics: wearable electronics; implantable electronics; “more than Moore” electronics; bioelectronics devices
● Bioprocess and biosystems engineering and applications: bioprocess design; biocatalysis; bioseparation and bioreactors; bioinformatics; bioenergy; etc.
● Biomolecular, cellular and tissue engineering and applications: tissue engineering; chromosome engineering; embryo engineering; cellular, molecular and synthetic biology; metabolic engineering; bio-nanotechnology; micro/nano technologies; genetic engineering; transgenic technology
● Biomedical engineering and applications: biomechatronics; biomedical electronics; biomechanics; biomaterials; biomimetics; biomedical diagnostics; biomedical therapy; biomedical devices; sensors and circuits; biomedical imaging and medical information systems; implants and regenerative medicine; neurotechnology; clinical engineering; rehabilitation engineering
● Biochemical engineering and applications: metabolic pathway engineering; modeling and simulation
● Translational bioengineering