{"title":"基于多尺度分层解纠缠的无监督生成图像编辑方法","authors":"Jianlong Zhang, Xincheng Yu, Bin Wang, Chen Chen","doi":"10.1109/SmartIoT55134.2022.00038","DOIUrl":null,"url":null,"abstract":"In order to solve the problem of semantic entanglement in generated image latent space of the StyleGAN2 network, we propose an unsupervised generated image editing method based on a multi-scale hierarchical disentanglement network structure. In our method, we first combine the mapping layer with the style mapping layer of each resolution branch in the StyleGAN2 network, and utilize the weight matrix eigen decomposition method at each scale independently to achieve the first-level disentanglement of image attributes and obtain the semantic direction vector of the scale. Then, we use Schmidt orthogonal decomposition based on the adjacent scale eigen vector to achieve the second-level disentanglement of image attributes. The result show that, compared with other mainstream unsupervised image editing methods, our method can achieve precise image editing at multiple scales, and the measurement of disentanglement between each attribute has also reached the best.","PeriodicalId":422269,"journal":{"name":"2022 IEEE International Conference on Smart Internet of Things (SmartIoT)","volume":"61 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Unsupervised Generated Image Editing Method Based on Multi-Scale Hierarchical Disentanglement\",\"authors\":\"Jianlong Zhang, Xincheng Yu, Bin Wang, Chen Chen\",\"doi\":\"10.1109/SmartIoT55134.2022.00038\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In order to solve the problem of semantic entanglement in generated image latent space of the StyleGAN2 network, we propose an unsupervised generated image editing method based on a multi-scale hierarchical disentanglement network structure. In our method, we first combine the mapping layer with the style mapping layer of each resolution branch in the StyleGAN2 network, and utilize the weight matrix eigen decomposition method at each scale independently to achieve the first-level disentanglement of image attributes and obtain the semantic direction vector of the scale. Then, we use Schmidt orthogonal decomposition based on the adjacent scale eigen vector to achieve the second-level disentanglement of image attributes. The result show that, compared with other mainstream unsupervised image editing methods, our method can achieve precise image editing at multiple scales, and the measurement of disentanglement between each attribute has also reached the best.\",\"PeriodicalId\":422269,\"journal\":{\"name\":\"2022 IEEE International Conference on Smart Internet of Things (SmartIoT)\",\"volume\":\"61 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 IEEE International Conference on Smart Internet of Things (SmartIoT)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/SmartIoT55134.2022.00038\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 IEEE International Conference on Smart Internet of Things (SmartIoT)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/SmartIoT55134.2022.00038","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Unsupervised Generated Image Editing Method Based on Multi-Scale Hierarchical Disentanglement
In order to solve the problem of semantic entanglement in generated image latent space of the StyleGAN2 network, we propose an unsupervised generated image editing method based on a multi-scale hierarchical disentanglement network structure. In our method, we first combine the mapping layer with the style mapping layer of each resolution branch in the StyleGAN2 network, and utilize the weight matrix eigen decomposition method at each scale independently to achieve the first-level disentanglement of image attributes and obtain the semantic direction vector of the scale. Then, we use Schmidt orthogonal decomposition based on the adjacent scale eigen vector to achieve the second-level disentanglement of image attributes. The result show that, compared with other mainstream unsupervised image editing methods, our method can achieve precise image editing at multiple scales, and the measurement of disentanglement between each attribute has also reached the best.