{"title":"符号网:通过中间特征解释连接潜在神经表征和符号推理","authors":"Sungheon Jeong;Hyungjoon Kim;Yoojeong Song","doi":"10.1109/ACCESS.2025.3565638","DOIUrl":null,"url":null,"abstract":"The interpretation of intermediate representations in deep neural networks is critical for enhancing the transparency, trustworthiness, and applicability of artificial intelligence (AI) systems. In this paper, we propose SymbolNet, a framework that extracts mid-level features from trained models and transforms them into human-interpretable symbolic representations. SymbolNet constructs a symbolic graph composed of nodes and edges that capture both the semantic meaning and relational structure within the model’s internal reasoning process. This symbolic decoding bridges the model’s internal computations with human cognitive understanding, enabling structured and meaningful interpretation of AI behavior. Experimental results on the GTSRB dataset demonstrate that SymbolNet improves classification accuracy by 4% over the baseline and significantly enhances robustness against various noise conditions and adversarial attacks. Our work contributes to the field of explainable AI by introducing a novel approach that reveals the internal learning dynamics of non-interpretable models through symbolic reasoning.","PeriodicalId":13079,"journal":{"name":"IEEE Access","volume":"13 ","pages":"78221-78230"},"PeriodicalIF":3.4000,"publicationDate":"2025-04-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10980088","citationCount":"0","resultStr":"{\"title\":\"SymbolNet: Bridging Latent Neural Representations and Symbolic Reasoning via Intermediate Feature Interpretation\",\"authors\":\"Sungheon Jeong;Hyungjoon Kim;Yoojeong Song\",\"doi\":\"10.1109/ACCESS.2025.3565638\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The interpretation of intermediate representations in deep neural networks is critical for enhancing the transparency, trustworthiness, and applicability of artificial intelligence (AI) systems. In this paper, we propose SymbolNet, a framework that extracts mid-level features from trained models and transforms them into human-interpretable symbolic representations. SymbolNet constructs a symbolic graph composed of nodes and edges that capture both the semantic meaning and relational structure within the model’s internal reasoning process. This symbolic decoding bridges the model’s internal computations with human cognitive understanding, enabling structured and meaningful interpretation of AI behavior. Experimental results on the GTSRB dataset demonstrate that SymbolNet improves classification accuracy by 4% over the baseline and significantly enhances robustness against various noise conditions and adversarial attacks. Our work contributes to the field of explainable AI by introducing a novel approach that reveals the internal learning dynamics of non-interpretable models through symbolic reasoning.\",\"PeriodicalId\":13079,\"journal\":{\"name\":\"IEEE Access\",\"volume\":\"13 \",\"pages\":\"78221-78230\"},\"PeriodicalIF\":3.4000,\"publicationDate\":\"2025-04-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10980088\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Access\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10980088/\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Access","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10980088/","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
SymbolNet: Bridging Latent Neural Representations and Symbolic Reasoning via Intermediate Feature Interpretation
The interpretation of intermediate representations in deep neural networks is critical for enhancing the transparency, trustworthiness, and applicability of artificial intelligence (AI) systems. In this paper, we propose SymbolNet, a framework that extracts mid-level features from trained models and transforms them into human-interpretable symbolic representations. SymbolNet constructs a symbolic graph composed of nodes and edges that capture both the semantic meaning and relational structure within the model’s internal reasoning process. This symbolic decoding bridges the model’s internal computations with human cognitive understanding, enabling structured and meaningful interpretation of AI behavior. Experimental results on the GTSRB dataset demonstrate that SymbolNet improves classification accuracy by 4% over the baseline and significantly enhances robustness against various noise conditions and adversarial attacks. Our work contributes to the field of explainable AI by introducing a novel approach that reveals the internal learning dynamics of non-interpretable models through symbolic reasoning.
IEEE AccessCOMPUTER SCIENCE, INFORMATION SYSTEMSENGIN-ENGINEERING, ELECTRICAL & ELECTRONIC
CiteScore
9.80
自引率
7.70%
发文量
6673
审稿时长
6 weeks
期刊介绍:
IEEE Access® is a multidisciplinary, open access (OA), applications-oriented, all-electronic archival journal that continuously presents the results of original research or development across all of IEEE''s fields of interest.
IEEE Access will publish articles that are of high interest to readers, original, technically correct, and clearly presented. Supported by author publication charges (APC), its hallmarks are a rapid peer review and publication process with open access to all readers. Unlike IEEE''s traditional Transactions or Journals, reviews are "binary", in that reviewers will either Accept or Reject an article in the form it is submitted in order to achieve rapid turnaround. Especially encouraged are submissions on:
Multidisciplinary topics, or applications-oriented articles and negative results that do not fit within the scope of IEEE''s traditional journals.
Practical articles discussing new experiments or measurement techniques, interesting solutions to engineering.
Development of new or improved fabrication or manufacturing techniques.
Reviews or survey articles of new or evolving fields oriented to assist others in understanding the new area.