{"title":"Estimation of structure of four-scene comics by convolutional neural networks","authors":"Miki Ueno, N. Mori, Toshinori Suenaga, H. Isahara","doi":"10.1145/3011549.3011558","DOIUrl":"https://doi.org/10.1145/3011549.3011558","url":null,"abstract":"The computational interpretation of comics is one of the important topics being studied in the field of artificial intelligence and image recognition. There are a lot of challenging tasks to undertake in order to interpret comics, i.e., recognize objects in gray-scaled drawing image, extract emotional information of scenes, and define models of continuous scenes by considering the structure of comics. In this paper, we focused on four scene comics and their transition. Four-scene comics have a structure which originated in four-part of Chinese-poetry so creators clearly draw the semantic distance between each scene. It is very important for expressing the interesting and lyrical aspects of comics. To detect the transition of scenes, convolutional neural networks(CNNs) are constructed and computer experiments were carried out. The results suggest that CNN is able to detect the transition of scenes and that the features of each scene are quite different.","PeriodicalId":319382,"journal":{"name":"Proceedings of the 1st International Workshop on coMics ANalysis, Processing and Understanding","volume":"111 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124122152","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Natsumi Kubota, Shinjiro Niino, Satoshi Nakamura, M. Suzuki
{"title":"A sustainable practice method of hand-drawing by merging user's stroke and model's stroke","authors":"Natsumi Kubota, Shinjiro Niino, Satoshi Nakamura, M. Suzuki","doi":"10.1145/3011549.3011559","DOIUrl":"https://doi.org/10.1145/3011549.3011559","url":null,"abstract":"Nowadays, people have become able to publish their comics easily because of the spread of Web services featuring their own content. However, it is not easy for them to publish such comics because of the difficulty of improving their hand-drawing skill. One practice method is tracing. However, it is not easy for people to maintain motivation for this practice method. In this paper, we propose a method which enables people to improve their hand-drawing skills and motivation by creating a merging of their hand-drawn character and a corresponding model which is drawn by others automatically. We validate the usefulness of our method by using the system and show how to change the appearance of illustrations.","PeriodicalId":319382,"journal":{"name":"Proceedings of the 1st International Workshop on coMics ANalysis, Processing and Understanding","volume":"44 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122804360","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Pose estimation of anime/manga characters: a case for synthetic data","authors":"Pramook Khungurn, Derek Chou","doi":"10.1145/3011549.3011552","DOIUrl":"https://doi.org/10.1145/3011549.3011552","url":null,"abstract":"2D articulated pose estimation is the task of locating the body joint positions of a human figure in an image. A pose estimator that works on anime/manga images could be an important component of an automatic system to create 3D animation from existing manga or anime, which could significantly the lower cost of media production. To create an accurate pose estimator, however, a sizable and high-quality dataset is needed, and such a dataset can be expensive to create. To alleviate data scarcity, we propose using a database of 3D character models and poses to generate synthetic training data for 2D pose estimators of anime/manga characters based on convolutional neural networks (CNN). We demonstrate that a high-performing estimator can be obtained by pretraining a network on a large synthetic dataset and then fine-tuning it on a small dataset of drawings. We also show that the approach yields a pose estimator competitive with many previous works when applied to a photograph-based dataset, establishing our synthetic data's usefulness beyond the intended domain.","PeriodicalId":319382,"journal":{"name":"Proceedings of the 1st International Workshop on coMics ANalysis, Processing and Understanding","volume":"9 1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126029374","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Manga content analysis using physiological signals","authors":"Charles Lima Sanches, Olivier Augereau, K. Kise","doi":"10.1145/3011549.3011555","DOIUrl":"https://doi.org/10.1145/3011549.3011555","url":null,"abstract":"Recently, the physiological signals have been analyzed more and more, especially in the context of everyday life activities such as watching video or looking at pictures. Tracking these signals gives access to the mental state of the user (interest, tiredness, stress) but also to his emotions (sadness, fright, happiness). The analysis of the reader's physiological signals during reading can provide a better understanding of the reader's feelings but also a better understanding of the documents. Our main research direction is to find the relationship between a change in the reader's physiological signal and the content of the reading. As a first step, we investigate whether it is possible to distinguish a manga (Japanese comic book) from another by analyzing the physiological signals of the reader. We use 3 different manga genres (horror, romance, comedy) and try to predict which one is read by analyzing the features extracted from the physiological signals of the reader. Our method uses the blood volume pulse, the electrodermal activity and the skin temperature of the reader while reading. We show that by using these physiological signals with a support vector machine we can retrieve which manga has been read with a 90% average accuracy.","PeriodicalId":319382,"journal":{"name":"Proceedings of the 1st International Workshop on coMics ANalysis, Processing and Understanding","volume":"26 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127149387","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}