{"title":"基于CNN分类的移动教育自底向上/自顶向下几何对象重建","authors":"Ting Guo, Rundong Cui, Xiaoran Qin, Yongtao Wang, Zhi Tang","doi":"10.2312/pg.20181269","DOIUrl":null,"url":null,"abstract":"Geometric objects in educational materials are often illustrated as 2D line drawings, which results in the loss of depth information. To alleviate the problem of fully understanding the 3D structure of geometric objects, we propose a novel method to reconstruct the 3D shape of a geometric object illustrated in a line drawing image. In contrast to most existing methods, ours directly take a single line drawing image as input and generate a valid sketch for reconstruction. Given a single input line drawing image, we first classify the geometric object in the image with convolution neural network (CNN). More specifically, we pre-train the model with simulated images to alleviate the problems of data collection and unbalanced distribution among different classes. Then, we generate the sketch of the geometric object with our proposed bottom-up and top-down scheme. Finally, we finish reconstruction by minimizing an objective function of reconstruction error. Extensive experimental results demonstrate that our method performs significantly better in both accuracy and efficiency compared with the existing methods.","PeriodicalId":88304,"journal":{"name":"Proceedings. Pacific Conference on Computer Graphics and Applications","volume":"21 1","pages":"13-16"},"PeriodicalIF":0.0000,"publicationDate":"2018-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Bottom-up/Top-down Geometric Object Reconstruction with CNN Classification for Mobile Education\",\"authors\":\"Ting Guo, Rundong Cui, Xiaoran Qin, Yongtao Wang, Zhi Tang\",\"doi\":\"10.2312/pg.20181269\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Geometric objects in educational materials are often illustrated as 2D line drawings, which results in the loss of depth information. To alleviate the problem of fully understanding the 3D structure of geometric objects, we propose a novel method to reconstruct the 3D shape of a geometric object illustrated in a line drawing image. In contrast to most existing methods, ours directly take a single line drawing image as input and generate a valid sketch for reconstruction. Given a single input line drawing image, we first classify the geometric object in the image with convolution neural network (CNN). More specifically, we pre-train the model with simulated images to alleviate the problems of data collection and unbalanced distribution among different classes. Then, we generate the sketch of the geometric object with our proposed bottom-up and top-down scheme. Finally, we finish reconstruction by minimizing an objective function of reconstruction error. Extensive experimental results demonstrate that our method performs significantly better in both accuracy and efficiency compared with the existing methods.\",\"PeriodicalId\":88304,\"journal\":{\"name\":\"Proceedings. Pacific Conference on Computer Graphics and Applications\",\"volume\":\"21 1\",\"pages\":\"13-16\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2018-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings. Pacific Conference on Computer Graphics and Applications\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.2312/pg.20181269\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings. Pacific Conference on Computer Graphics and Applications","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2312/pg.20181269","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Bottom-up/Top-down Geometric Object Reconstruction with CNN Classification for Mobile Education
Geometric objects in educational materials are often illustrated as 2D line drawings, which results in the loss of depth information. To alleviate the problem of fully understanding the 3D structure of geometric objects, we propose a novel method to reconstruct the 3D shape of a geometric object illustrated in a line drawing image. In contrast to most existing methods, ours directly take a single line drawing image as input and generate a valid sketch for reconstruction. Given a single input line drawing image, we first classify the geometric object in the image with convolution neural network (CNN). More specifically, we pre-train the model with simulated images to alleviate the problems of data collection and unbalanced distribution among different classes. Then, we generate the sketch of the geometric object with our proposed bottom-up and top-down scheme. Finally, we finish reconstruction by minimizing an objective function of reconstruction error. Extensive experimental results demonstrate that our method performs significantly better in both accuracy and efficiency compared with the existing methods.