{"title":"从单个未校准图像进行无监督轻量级面部3D重建","authors":"Yuhang Shi, Huan Jin, Dapeng Tao","doi":"10.1145/3529570.3529599","DOIUrl":null,"url":null,"abstract":"Reconstruct 3D model from 2D image is an important task in the field of deep learning, which aims to make computers have the ability to perceive the 3D world like human-beings. In this paper, a lightweight method is proposed for 3D face reconstruction from a single image without any supervision. Specifically, our method employs encoder-decoder architectures to extract depth map, light condition, transformation matrix and albedo from input image. According to the principle of rendering, we can obtain the connection between 2D image coordinates and 3D model vertices coordinates, using the above elements, we can get the projection image of the reconstructed model. Then the reconstruction loss can be used to optimize the network parameters. Experiments show that our method surpasses the previous work in reconstruction speed and the size of model.","PeriodicalId":430367,"journal":{"name":"Proceedings of the 6th International Conference on Digital Signal Processing","volume":"104 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-02-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Unsupervised Lightweight Face 3D Reconstruction From a Single Uncalibrated Image\",\"authors\":\"Yuhang Shi, Huan Jin, Dapeng Tao\",\"doi\":\"10.1145/3529570.3529599\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Reconstruct 3D model from 2D image is an important task in the field of deep learning, which aims to make computers have the ability to perceive the 3D world like human-beings. In this paper, a lightweight method is proposed for 3D face reconstruction from a single image without any supervision. Specifically, our method employs encoder-decoder architectures to extract depth map, light condition, transformation matrix and albedo from input image. According to the principle of rendering, we can obtain the connection between 2D image coordinates and 3D model vertices coordinates, using the above elements, we can get the projection image of the reconstructed model. Then the reconstruction loss can be used to optimize the network parameters. Experiments show that our method surpasses the previous work in reconstruction speed and the size of model.\",\"PeriodicalId\":430367,\"journal\":{\"name\":\"Proceedings of the 6th International Conference on Digital Signal Processing\",\"volume\":\"104 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-02-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 6th International Conference on Digital Signal Processing\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3529570.3529599\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 6th International Conference on Digital Signal Processing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3529570.3529599","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Unsupervised Lightweight Face 3D Reconstruction From a Single Uncalibrated Image
Reconstruct 3D model from 2D image is an important task in the field of deep learning, which aims to make computers have the ability to perceive the 3D world like human-beings. In this paper, a lightweight method is proposed for 3D face reconstruction from a single image without any supervision. Specifically, our method employs encoder-decoder architectures to extract depth map, light condition, transformation matrix and albedo from input image. According to the principle of rendering, we can obtain the connection between 2D image coordinates and 3D model vertices coordinates, using the above elements, we can get the projection image of the reconstructed model. Then the reconstruction loss can be used to optimize the network parameters. Experiments show that our method surpasses the previous work in reconstruction speed and the size of model.