基于情感识别和超像素色彩分辨率的卡通图像着色

Zhibin Su, Yun-fang Zhang, Jia Li, Nan Gao
{"title":"基于情感识别和超像素色彩分辨率的卡通图像着色","authors":"Zhibin Su, Yun-fang Zhang, Jia Li, Nan Gao","doi":"10.1109/ICCST50977.2020.00090","DOIUrl":null,"url":null,"abstract":"With the development of artificial intelligence technology, it is possible to automatically colorize the hand drawn sketch by machine. Researchers have conducted in-depth and meticulous study on hand-drawn manuscript recognition, generation, and retrieval. For the emotion-based line art colorization, facial expression should be also extracted from the image itself. To solve the recognition and colorization problem, this paper has proposed an algorithm with the DenseNet network for emotional recognition of anime faces and performed a two-stage interactive coloring method in view of superpixel color analysis features. Among them, the superpixel color analysis technology used a simple linear iterative clustering of SLIC algorithm. According to the experiment, the prompt color information of corresponding position could be generated through the emotion recognition result. After the prediction of superpixel color analysis by GAN (generative adversarial network), the original cartoon image could be rendered with suitable color scheme. The visualization results proved that our algorithm proposed would effectively realize the emotion-based line art colorization of high interactivity and reasonable color distribution.","PeriodicalId":189809,"journal":{"name":"2020 International Conference on Culture-oriented Science & Technology (ICCST)","volume":"150 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"Cartoon image colorization based on emotion recognition and superpixel color resolution\",\"authors\":\"Zhibin Su, Yun-fang Zhang, Jia Li, Nan Gao\",\"doi\":\"10.1109/ICCST50977.2020.00090\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"With the development of artificial intelligence technology, it is possible to automatically colorize the hand drawn sketch by machine. Researchers have conducted in-depth and meticulous study on hand-drawn manuscript recognition, generation, and retrieval. For the emotion-based line art colorization, facial expression should be also extracted from the image itself. To solve the recognition and colorization problem, this paper has proposed an algorithm with the DenseNet network for emotional recognition of anime faces and performed a two-stage interactive coloring method in view of superpixel color analysis features. Among them, the superpixel color analysis technology used a simple linear iterative clustering of SLIC algorithm. According to the experiment, the prompt color information of corresponding position could be generated through the emotion recognition result. After the prediction of superpixel color analysis by GAN (generative adversarial network), the original cartoon image could be rendered with suitable color scheme. The visualization results proved that our algorithm proposed would effectively realize the emotion-based line art colorization of high interactivity and reasonable color distribution.\",\"PeriodicalId\":189809,\"journal\":{\"name\":\"2020 International Conference on Culture-oriented Science & Technology (ICCST)\",\"volume\":\"150 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2020 International Conference on Culture-oriented Science & Technology (ICCST)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICCST50977.2020.00090\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 International Conference on Culture-oriented Science & Technology (ICCST)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICCST50977.2020.00090","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2

摘要

随着人工智能技术的发展,用机器对手绘草图进行自动上色已成为可能。研究者们对手绘手稿的识别、生成和检索进行了深入细致的研究。对于基于情感的线条艺术着色,还需要从图像本身提取面部表情。为了解决识别和上色问题,本文提出了一种基于DenseNet网络的动漫人脸情感识别算法,并针对超像素色彩分析特点,进行了两阶段交互上色方法。其中,超像素色彩分析技术采用了简单的线性迭代聚类SLIC算法。实验表明,通过情绪识别结果可以生成相应位置的提示颜色信息。通过GAN(生成式对抗网络)对超像素颜色分析进行预测后,可以将原始卡通图像渲染成合适的配色方案。可视化结果证明,本文提出的算法能够有效地实现基于情感的线条艺术着色,具有高交互性和合理的色彩分布。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Cartoon image colorization based on emotion recognition and superpixel color resolution
With the development of artificial intelligence technology, it is possible to automatically colorize the hand drawn sketch by machine. Researchers have conducted in-depth and meticulous study on hand-drawn manuscript recognition, generation, and retrieval. For the emotion-based line art colorization, facial expression should be also extracted from the image itself. To solve the recognition and colorization problem, this paper has proposed an algorithm with the DenseNet network for emotional recognition of anime faces and performed a two-stage interactive coloring method in view of superpixel color analysis features. Among them, the superpixel color analysis technology used a simple linear iterative clustering of SLIC algorithm. According to the experiment, the prompt color information of corresponding position could be generated through the emotion recognition result. After the prediction of superpixel color analysis by GAN (generative adversarial network), the original cartoon image could be rendered with suitable color scheme. The visualization results proved that our algorithm proposed would effectively realize the emotion-based line art colorization of high interactivity and reasonable color distribution.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信