从单个未校准图像进行无监督轻量级面部3D重建

Yuhang Shi, Huan Jin, Dapeng Tao
{"title":"从单个未校准图像进行无监督轻量级面部3D重建","authors":"Yuhang Shi, Huan Jin, Dapeng Tao","doi":"10.1145/3529570.3529599","DOIUrl":null,"url":null,"abstract":"Reconstruct 3D model from 2D image is an important task in the field of deep learning, which aims to make computers have the ability to perceive the 3D world like human-beings. In this paper, a lightweight method is proposed for 3D face reconstruction from a single image without any supervision. Specifically, our method employs encoder-decoder architectures to extract depth map, light condition, transformation matrix and albedo from input image. According to the principle of rendering, we can obtain the connection between 2D image coordinates and 3D model vertices coordinates, using the above elements, we can get the projection image of the reconstructed model. Then the reconstruction loss can be used to optimize the network parameters. Experiments show that our method surpasses the previous work in reconstruction speed and the size of model.","PeriodicalId":430367,"journal":{"name":"Proceedings of the 6th International Conference on Digital Signal Processing","volume":"104 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-02-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Unsupervised Lightweight Face 3D Reconstruction From a Single Uncalibrated Image\",\"authors\":\"Yuhang Shi, Huan Jin, Dapeng Tao\",\"doi\":\"10.1145/3529570.3529599\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Reconstruct 3D model from 2D image is an important task in the field of deep learning, which aims to make computers have the ability to perceive the 3D world like human-beings. In this paper, a lightweight method is proposed for 3D face reconstruction from a single image without any supervision. Specifically, our method employs encoder-decoder architectures to extract depth map, light condition, transformation matrix and albedo from input image. According to the principle of rendering, we can obtain the connection between 2D image coordinates and 3D model vertices coordinates, using the above elements, we can get the projection image of the reconstructed model. Then the reconstruction loss can be used to optimize the network parameters. Experiments show that our method surpasses the previous work in reconstruction speed and the size of model.\",\"PeriodicalId\":430367,\"journal\":{\"name\":\"Proceedings of the 6th International Conference on Digital Signal Processing\",\"volume\":\"104 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-02-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 6th International Conference on Digital Signal Processing\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3529570.3529599\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 6th International Conference on Digital Signal Processing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3529570.3529599","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

从二维图像重构三维模型是深度学习领域的一项重要任务,其目的是使计算机具有像人类一样感知三维世界的能力。本文提出了一种基于单幅图像的无监督三维人脸重建的轻量化方法。具体来说,我们的方法采用编码器-解码器架构从输入图像中提取深度图、光照条件、变换矩阵和反照率。根据绘制原理,我们可以得到二维图像坐标与三维模型顶点坐标之间的联系,利用上述元素,我们可以得到重建模型的投影图像。然后利用重构损失对网络参数进行优化。实验表明,该方法在重建速度和模型尺寸上都优于以往的方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Unsupervised Lightweight Face 3D Reconstruction From a Single Uncalibrated Image
Reconstruct 3D model from 2D image is an important task in the field of deep learning, which aims to make computers have the ability to perceive the 3D world like human-beings. In this paper, a lightweight method is proposed for 3D face reconstruction from a single image without any supervision. Specifically, our method employs encoder-decoder architectures to extract depth map, light condition, transformation matrix and albedo from input image. According to the principle of rendering, we can obtain the connection between 2D image coordinates and 3D model vertices coordinates, using the above elements, we can get the projection image of the reconstructed model. Then the reconstruction loss can be used to optimize the network parameters. Experiments show that our method surpasses the previous work in reconstruction speed and the size of model.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信