{"title":"Real-time activity prediction: a gaze-based approach for early recognition of pen-based interaction tasks","authors":"Çagla Çig, T. M. Sezgin","doi":"10.2312/EXP.20151179","DOIUrl":"https://doi.org/10.2312/EXP.20151179","url":null,"abstract":"Recently there has been a growing interest in sketch recognition technologies for facilitating human-computer interaction. Existing sketch recognition studies mainly focus on recognizing pre-defined symbols and gestures. However, just as there is a need for systems that can automatically recognize symbols and gestures, there is also a pressing need for systems that can automatically recognize pen-based manipulation activities (e.g. dragging, maximizing, minimizing, scrolling). There are two main challenges in classifying manipulation activities. First is the inherent lack of characteristic visual appearances of pen inputs that correspond to manipulation activities. Second is the necessity of real-time classification based upon the principle that users must receive immediate and appropriate visual feedback about the effects of their actions. In this paper (1) an existing activity prediction system for pen-based devices is modified for real-time activity prediction and (2) an alternative time-based activity prediction system is introduced. Both systems use eye gaze movements that naturally accompany pen-based user interaction for activity classification. The results of our comprehensive experiments demonstrate that the newly developed alternative system is a more successful candidate (in terms of prediction accuracy and early prediction speed) than the existing system for real-time activity prediction. More specifically, midway through an activity, the alternative system reaches 66% of its maximum accuracy value (i.e. 66% of 70.34%) whereas the existing system reaches only 36% of its maximum accuracy value (i.e. 36% of 55.69%).","PeriodicalId":289409,"journal":{"name":"International Symposium on Sketch-Based Interfaces and Modeling","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128304320","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Inverse toon shading: interactive normal field modeling with isophotes","authors":"Qiuying Xu, Y. Gingold, Karan Singh","doi":"10.2312/EXP.20151175","DOIUrl":"https://doi.org/10.2312/EXP.20151175","url":null,"abstract":"We introduce an interactive modeling tool for designing a smooth 3D normal field from the isophotes of a discretely shaded 2D image. Block or cartoon shading is a visual style in which artists depict a smoothly shaded 3D object using a small number of discrete brightness values, manifested as regions or bands of constant color. In our approach, artists trace isophotes, or curves of constant brightness, along the boundaries between constant color bands. Our algorithm first estimates light directions and computes 3D normals along the object silhouette and at intersections between isophotes from different light sources. We then propagate these 3D normals smoothly along isophotes, and subsequently throughout the interior of the shape. We describe our user interface for editing isophotes and correcting unintended normals produced by our algorithm. We validate our approach with a perceptual experiment and comparisons to ground truth data. Finally, we present a set of 3D renderings created using our interface.","PeriodicalId":289409,"journal":{"name":"International Symposium on Sketch-Based Interfaces and Modeling","volume":"3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126807918","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A combined junction-cue dictionary for labelling sketch drawings with artistic shadows and table-line cues","authors":"Alexandra Bonnici, K. Camilleri","doi":"10.2312/EXP.20151185","DOIUrl":"https://doi.org/10.2312/EXP.20151185","url":null,"abstract":"The interpretation of user sketches generates research interest in the product design community since the computer interpretation of sketches may reduce the design-to-market time while giving the designer greater flexibility and control of the design process. This paper describes how cues, namely shadows and table lines used to express structural form in the drawing, may be used in a line-labelling algorithm to obtain a drawing interpretation that matches some design intent. To this extent, this paper describes canonical forms of the cues from which a combined junction and cue dictionary is created and used within a genetic algorithm framework to label the drawing. This paper also describes how such cues may be identified from the sketch.","PeriodicalId":289409,"journal":{"name":"International Symposium on Sketch-Based Interfaces and Modeling","volume":"39 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134331147","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Kemal Tugrul Yesilbek, Cansu Sen, S. Cakmak, T. M. Sezgin
{"title":"SVM-based sketch recognition: which hyperparameter interval to try?","authors":"Kemal Tugrul Yesilbek, Cansu Sen, S. Cakmak, T. M. Sezgin","doi":"10.2312/EXP.20151184","DOIUrl":"https://doi.org/10.2312/EXP.20151184","url":null,"abstract":"Hyperparameters are among the most crucial factors that affect the performance of machine learning algorithms. In general, there is no direct method for determining a set of satisfactory parameters, so hyperparameter search needs to be conducted each time a model is to be trained. In this work, we analyze how similar hyperparameters perform across various datasets from the sketch recognition domain. Results show that hyperparameter search space can be reduced to a subspace despite differences in characteristics of datasets.","PeriodicalId":289409,"journal":{"name":"International Symposium on Sketch-Based Interfaces and Modeling","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128521996","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ronan M. Amorim, E. V. Brazil, F. Samavati, M. Sousa
{"title":"3D geological modeling using sketches and annotations from geologic maps","authors":"Ronan M. Amorim, E. V. Brazil, F. Samavati, M. Sousa","doi":"10.1145/2630407.2630411","DOIUrl":"https://doi.org/10.1145/2630407.2630411","url":null,"abstract":"Constructing 3D geological models is a fundamental task in oil/gas exploration and production. A critical stage in the existing 3D geological modeling workflow is moving from a geological interpretation (usually 2D) to a 3D geological model. The construction of 3D geological models can be a cumbersome task mainly because of the models' complexity, and inconsistencies between the interpretation and modeling tasks. To narrow the gap between interpretation and modeling tasks, we propose a sketched based approach. Our main goal is to mimic how domain experts interpret geological structures and allow the creation of models directly from the interpretation task, therefore avoiding the drawbacks of a separate modeling stage. Our sketch-based modeler is based on standard annotations of 2D geological maps and on geologists' interpretation sketches. Specific geological rules and constraints are applied and evaluated during the sketch-based modeling process to guarantee the construction of a valid 3D geologic model.","PeriodicalId":289409,"journal":{"name":"International Symposium on Sketch-Based Interfaces and Modeling","volume":"57 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129197965","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Mixed heuristic search for sketch prediction on chemical structure drawing","authors":"Bo Kang, Hao Hu, J. Laviola","doi":"10.1145/2630407.2630408","DOIUrl":"https://doi.org/10.1145/2630407.2630408","url":null,"abstract":"Sketching is a natural way to input chemical structures that can be used to query information from a large chemical structure database. Based on a user's incomplete sketch of a chemical structure, sketch prediction becomes a challenging problem not only due to arbitrary drawings orders among users but also similarities among chemical structure layouts. In this paper, we present a graph-based approach to handle the sketch prediction problem. We use multisets as the data representation of hand-drawn chemical structures and create an undirected graph to handle data in all multisets. This approach transforms the sketch prediction problem into a search problem to find a hamiltonian path in the corresponding sub-graph with polynomial time complexity. We introduce mixed heuristics to guide the search procedure. Through an initial experiment on a hand-drawn chemical structure dataset, we demonstrate that in comparison with a baseline method, the proposed approach improves the prediction accuracy and efficiently predicts chemical structures from only partially sketched drawings.","PeriodicalId":289409,"journal":{"name":"International Symposium on Sketch-Based Interfaces and Modeling","volume":"344 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134227335","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Sketch based skirt image retrieval","authors":"Shin-ichiro Kondo, M. Toyoura, Xiaoyang Mao","doi":"10.1145/2630407.2630410","DOIUrl":"https://doi.org/10.1145/2630407.2630410","url":null,"abstract":"Although many online shops allow users to search for clothes by categories or keywords, it is usually impossible to specify the details of the design. This paper presents a new technology for retrieving skirt images based on sketches. We first conducted a user study to investigate the typical features illustrated in a sketch. Then algorithms have been developed for automatically extracting those features from both the skirt images and the sketches. A prototype system has been implemented to retrieve and present the best matched skirts in real time when a user interactively sketches her imagined skirt on the canvas.","PeriodicalId":289409,"journal":{"name":"International Symposium on Sketch-Based Interfaces and Modeling","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121525452","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
R. Abdrashitov, Emilie Guy, Jiaxian Yao, Karan Singh
{"title":"Mosaic: sketch-based interface for creating digital decorative mosaics","authors":"R. Abdrashitov, Emilie Guy, Jiaxian Yao, Karan Singh","doi":"10.1145/2630407.2630409","DOIUrl":"https://doi.org/10.1145/2630407.2630409","url":null,"abstract":"Mosaic is a sketch-based system that simplifies and automates the creation of digital decorative mosaics from scratch. The creation of each tile piece of unique shape, color and orientation, in a complex mosaic is a tedious process. Our core contribution is two-fold: first, we present a new tile growing algorithm, that balances the shape and placement of tiles with need for uniform grout; second, we develop a suite of sketch-based tools on top of this algorithm to create and clone tiles and tile patterns along sketched paths, and color them efficiently. A user evaluation shows that our system makes the creation of mosaics fast and accessible to a broad audience.","PeriodicalId":289409,"journal":{"name":"International Symposium on Sketch-Based Interfaces and Modeling","volume":"3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116903251","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Hong-hoe Kim, Paul Taele, Stephanie Valentine, Erin M. McTigue, T. Hammond
{"title":"KimCHI: a sketch-based developmental skill classifier to enhance pen-driven educational interfaces for children","authors":"Hong-hoe Kim, Paul Taele, Stephanie Valentine, Erin M. McTigue, T. Hammond","doi":"10.1145/2487381.2487389","DOIUrl":"https://doi.org/10.1145/2487381.2487389","url":null,"abstract":"Sketching is one of the many valuable lifelong skills that children require in their overall development, and many educational psychologists manually analyze children's sketches to assess their developmental progress. The disadvantages of manual assessment are that it is time-consuming and prone to human error and bias, so intelligent sketching interfaces have strong potential in automating this process. Unfortunately, current sketch recognition techniques concentrate solely on recognizing the meaning of sketches, rather than the sketcher's developmental skill; and do not perform well on children's sketched input, as most are trained on and developed for adult's sketches. We introduce our proposed solution called KimCHI, a specialized sketch classification technique which utilizes a sketching interface for assessing the developmental skills of children from their sketches. Our approach relies on sketch feature selection to automatically classify the developmental progress of children's sketches as either developmental or mature. We evaluated our classifiers through a user study, and our classifiers were able to differentiate the users' development skill and gender with reasonable accuracy. We subsequently created an initial sketching interface utilizing our specialized classifier called EasySketch for demonstrating educational applications to assist children in developing their sketching skills.","PeriodicalId":289409,"journal":{"name":"International Symposium on Sketch-Based Interfaces and Modeling","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125208081","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
R. Wasson, D. Mould, R. Biddle, Cristina S. Martinez
{"title":"A sketching game for art history instruction","authors":"R. Wasson, D. Mould, R. Biddle, Cristina S. Martinez","doi":"10.1145/2487381.2487384","DOIUrl":"https://doi.org/10.1145/2487381.2487384","url":null,"abstract":"Study of images, in contexts as widespread as medicine, geography, and art history, demands attention to detail and exercise of memory. Presented with traditional textbooks, students have difficulty concentrating for the long periods of time needed to absorb the information. This paper presents a sketch-based game for learning images. We tested the game in the domain of art history, and in a controlled user study, we found that it dramatically increased the time that participants chose to spend learning about historical paintings. The increase in study time was accompanied by a proportionate increase in information retention and familiarity with the images.","PeriodicalId":289409,"journal":{"name":"International Symposium on Sketch-Based Interfaces and Modeling","volume":"473 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116233818","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}