Artificial intelligence-based image interpretation system: Unlocking a new dimension of artwork analysis

IF 5.3 Q2 COMPUTER SCIENCE, THEORY & METHODS
Array Pub Date : 2026-03-01 Epub Date: 2026-02-02 DOI:10.1016/j.array.2025.100670
Lijun Huang , Shizheng Sun , Yunhan Liu , Pinxian Mao , Xiaoyu Zhou
{"title":"Artificial intelligence-based image interpretation system: Unlocking a new dimension of artwork analysis","authors":"Lijun Huang ,&nbsp;Shizheng Sun ,&nbsp;Yunhan Liu ,&nbsp;Pinxian Mao ,&nbsp;Xiaoyu Zhou","doi":"10.1016/j.array.2025.100670","DOIUrl":null,"url":null,"abstract":"<div><div>This paper presents an artificial intelligence-based image interpretation system for automated, multi-perspective analysis of visual artworks. The system integrates a multimodal perception-generation pipeline that combines visual feature encoding with structured knowledge retrieval to enable context-aware art understanding. Specifically, the system employs a graph retrieval-augmented generation (GRAG) framework built upon an art context knowledge graph (ACKG). This framework not only models the relationships among artists, styles, historical periods, and cultural symbols, but also performs graph-based entity retrieval and subgraph reasoning to efficiently extract semantically relevant contextual knowledge. Subsequently, this knowledge is integrated with visual representations to generate high-quality textual interpretations. We evaluate the system on two public painting datasets, SemArt and Artpedia, and compare it with several state-of-the-art methods. Experimental results demonstrate that our approach significantly outperforms baseline models in both descriptive accuracy and richness of artistic context, while also achieving higher scores in human evaluations. These findings provide a new technological pathway and practical reference for applications in art education, intelligent museum guidance, and public art appreciation.</div></div>","PeriodicalId":8417,"journal":{"name":"Array","volume":"29 ","pages":"Article 100670"},"PeriodicalIF":5.3000,"publicationDate":"2026-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Array","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2590005625002978","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/2/2 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"COMPUTER SCIENCE, THEORY & METHODS","Score":null,"Total":0}
引用次数: 0

Abstract

This paper presents an artificial intelligence-based image interpretation system for automated, multi-perspective analysis of visual artworks. The system integrates a multimodal perception-generation pipeline that combines visual feature encoding with structured knowledge retrieval to enable context-aware art understanding. Specifically, the system employs a graph retrieval-augmented generation (GRAG) framework built upon an art context knowledge graph (ACKG). This framework not only models the relationships among artists, styles, historical periods, and cultural symbols, but also performs graph-based entity retrieval and subgraph reasoning to efficiently extract semantically relevant contextual knowledge. Subsequently, this knowledge is integrated with visual representations to generate high-quality textual interpretations. We evaluate the system on two public painting datasets, SemArt and Artpedia, and compare it with several state-of-the-art methods. Experimental results demonstrate that our approach significantly outperforms baseline models in both descriptive accuracy and richness of artistic context, while also achieving higher scores in human evaluations. These findings provide a new technological pathway and practical reference for applications in art education, intelligent museum guidance, and public art appreciation.
基于人工智能的图像解读系统:开启艺术品分析的新维度
本文提出了一种基于人工智能的图像解释系统,用于视觉艺术品的自动化、多视角分析。该系统集成了一个多模态感知生成管道,该管道将视觉特征编码与结构化知识检索相结合,以实现上下文感知的艺术理解。具体来说,该系统采用了基于艺术上下文知识图(ACKG)的图形检索增强生成(GRAG)框架。该框架不仅对艺术家、风格、历史时期和文化符号之间的关系进行建模,而且还执行基于图的实体检索和子图推理,以有效地提取语义相关的上下文知识。随后,将这些知识与视觉表示相结合,生成高质量的文本解释。我们在两个公共绘画数据集(SemArt和Artpedia)上评估了该系统,并将其与几种最先进的方法进行了比较。实验结果表明,我们的方法在描述准确性和艺术背景的丰富性方面都明显优于基线模型,同时在人类评估中也获得了更高的分数。这些发现为艺术教育、智慧博物馆指导和公共艺术欣赏提供了新的技术途径和实践参考。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Array
Array Computer Science-General Computer Science
CiteScore
4.40
自引率
0.00%
发文量
93
审稿时长
45 days
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书