Daoshun Xie, Zongyue Wang, Guorong Cai, Qiming Xia, Yidong Chen, S. Yang
{"title":"基于单目摄像机视频的三维人体模型重建","authors":"Daoshun Xie, Zongyue Wang, Guorong Cai, Qiming Xia, Yidong Chen, S. Yang","doi":"10.1145/3573428.3573670","DOIUrl":null,"url":null,"abstract":"This paper addresses a method to obtain an accurate 3D human body model and a photorealistic free-view image of an arbitrary person from a monocular camera video. Recent works has shown that it is possible to reconstruct a human model at a level of detail from a single image. However, inferring a complete 3D human model from a network model will be ill-posed if rely on a single photograph of a person. In order to reasonably infer the 3D human model, we propose method based on implicit field representation to integrate the information of video frames by a set of structured latent code. The core of our method is to construct the implicit field by relatively sparse structured latent code. Meanwhile, align the vertices of the parametric human model and structured latent code to the same coordinate system. Extensive experimental results on monocular datasets demonstrate the effectiveness of our approach in generating accurate 3D human models. Our method utilizes a monocular camera to obtain a 3D model which enables consumers create their personality digital model.","PeriodicalId":314698,"journal":{"name":"Proceedings of the 2022 6th International Conference on Electronic Information Technology and Computer Engineering","volume":"24 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Monocular Camera Video Based Reconstruction of 3D human model\",\"authors\":\"Daoshun Xie, Zongyue Wang, Guorong Cai, Qiming Xia, Yidong Chen, S. Yang\",\"doi\":\"10.1145/3573428.3573670\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This paper addresses a method to obtain an accurate 3D human body model and a photorealistic free-view image of an arbitrary person from a monocular camera video. Recent works has shown that it is possible to reconstruct a human model at a level of detail from a single image. However, inferring a complete 3D human model from a network model will be ill-posed if rely on a single photograph of a person. In order to reasonably infer the 3D human model, we propose method based on implicit field representation to integrate the information of video frames by a set of structured latent code. The core of our method is to construct the implicit field by relatively sparse structured latent code. Meanwhile, align the vertices of the parametric human model and structured latent code to the same coordinate system. Extensive experimental results on monocular datasets demonstrate the effectiveness of our approach in generating accurate 3D human models. Our method utilizes a monocular camera to obtain a 3D model which enables consumers create their personality digital model.\",\"PeriodicalId\":314698,\"journal\":{\"name\":\"Proceedings of the 2022 6th International Conference on Electronic Information Technology and Computer Engineering\",\"volume\":\"24 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-10-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 2022 6th International Conference on Electronic Information Technology and Computer Engineering\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3573428.3573670\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 2022 6th International Conference on Electronic Information Technology and Computer Engineering","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3573428.3573670","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Monocular Camera Video Based Reconstruction of 3D human model
This paper addresses a method to obtain an accurate 3D human body model and a photorealistic free-view image of an arbitrary person from a monocular camera video. Recent works has shown that it is possible to reconstruct a human model at a level of detail from a single image. However, inferring a complete 3D human model from a network model will be ill-posed if rely on a single photograph of a person. In order to reasonably infer the 3D human model, we propose method based on implicit field representation to integrate the information of video frames by a set of structured latent code. The core of our method is to construct the implicit field by relatively sparse structured latent code. Meanwhile, align the vertices of the parametric human model and structured latent code to the same coordinate system. Extensive experimental results on monocular datasets demonstrate the effectiveness of our approach in generating accurate 3D human models. Our method utilizes a monocular camera to obtain a 3D model which enables consumers create their personality digital model.