J. WSCGPub Date : 2023-08-03DOI: 10.24132/JWSCG.2022.2
A. Sommer, Ulrich Schwanecke, E. Schoemer
{"title":"Interactive High-Resolution Simulation of Granular Material","authors":"A. Sommer, Ulrich Schwanecke, E. Schoemer","doi":"10.24132/JWSCG.2022.2","DOIUrl":"https://doi.org/10.24132/JWSCG.2022.2","url":null,"abstract":"We introduce a particle-based simulation method for granular material in interactive frame rates. We divide the simulation into two decoupled steps. In the first step, a relatively small number of particles is accurately simulated with a constraint-based method. Here, all collisions and the resulting friction between the particles are taken into account. In the second step, the small number of particles is significantly increased by an efficient sampling algorithm without creating additional artifacts. The method is particularly robust and allows relatively large time steps, which makes it well suited for real-time applications. With our method, up to 500k particles can be computed in interactive frame rates on consumer CPUs without relying on GPU support for massive parallel computing. This makes it well suited for applications where a lot of GPU power is already needed for render tasks.","PeriodicalId":338597,"journal":{"name":"J. WSCG","volume":"111 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-08-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115181819","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. WSCGPub Date : 2023-07-01DOI: 10.24132/jwscg.2023.5
J. Colom, H. Saito
{"title":"Reconstruction from Multi-view Sketches: an Inverse Rendering Approach","authors":"J. Colom, H. Saito","doi":"10.24132/jwscg.2023.5","DOIUrl":"https://doi.org/10.24132/jwscg.2023.5","url":null,"abstract":"Reconstruction from real images has evolved very differently from reconstruction from sketches. Even though both present similarities, the latter aims to surpass the subjectivity that drawings present, increasing the task\"s uncertainty and complexity. In this work, we draw inspiration from reconstruction over real multi-view images and adapt existing methods in this area to work over sketches. We leverage inverse rendering as a refinement process for 3D colored meshes while proposing modifications for the domain of drawings. Compared to previous reconstructions from sketches, our proposal recovers not only shape but color, offering an optimization system that does not require previous training. Through the results, we evaluate how different quality factors in sketches affect the reconstruction quality and report how our proposal adapts to them compared to directly applying existing inverse rendering systems for real images.","PeriodicalId":338597,"journal":{"name":"J. WSCG","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129645324","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. WSCGPub Date : 2023-07-01DOI: 10.24132/jwscg.2023.3
S. Lengauer, Lin Shao, Magdalena Mayerhofer, R. Preiner, S. Karl, E. Trinkl, I. Sipiran, Benjamin Bustos, T. Schreck
{"title":"Visual Exploration of Repetitive Patterns on Ancient Peruvian Pottery","authors":"S. Lengauer, Lin Shao, Magdalena Mayerhofer, R. Preiner, S. Karl, E. Trinkl, I. Sipiran, Benjamin Bustos, T. Schreck","doi":"10.24132/jwscg.2023.3","DOIUrl":"https://doi.org/10.24132/jwscg.2023.3","url":null,"abstract":"The analysis and understanding of artefact properties and their relationships is a key goal in archaeological analysis of cultural heritage objects. There are many aspects of concern, including shape properties of the objects, but also appearance properties stemming from paintings and ornamentations on the object surfaces. To date, these are considered by experts mostly holistically and on a per-object basis. We present an approach for the interactive visual exploration and correlation of shape- and ornament-based properties of a large collection of ancient vessels. Our approach allows to group objects by properties, and to relate them in side-by-side and bipartite graph displays. To this end, we define an encompassing set of feature descriptors, which are leveraged to cluster the objects by properties, selected by the user. Case studies show that a comparative overview of all objects effectively supports the discovery of interesting co-occurrences of shape and ornament properties. This way, our tool opens new possibilities for the domain analysis of cultural heritage object collections by data-driven visual exploration.","PeriodicalId":338597,"journal":{"name":"J. WSCG","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116679152","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. WSCGPub Date : 2023-07-01DOI: 10.24132/jwscg.2023.7
Roman Sandu, A. Shcherbakov
{"title":"A Resource Allocation Algorithm for a History-Aware Frame Graph","authors":"Roman Sandu, A. Shcherbakov","doi":"10.24132/jwscg.2023.7","DOIUrl":"https://doi.org/10.24132/jwscg.2023.7","url":null,"abstract":"We consider the problem of memory consumption by a real-time GPU-accelerated graphical application. A history of a resource is defined for a particular frame to be the final contents of such a resource at the end of the previous frame. When organizing a graphical application using a frame rendering graph approach, it makes sense to implement automatic serving of resource history read requests of nodes. In absence of history resource requests, allocating resources for a fixed frame graph is the classic problem of dynamic storage allocation (DSA). In this paper, we formulate a generalization of DSA that enables memory reuse for resources with history requests and provide a practical approximate algorithm for solving it.","PeriodicalId":338597,"journal":{"name":"J. WSCG","volume":"58 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126572567","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. WSCGPub Date : 2023-07-01DOI: 10.24132/jwscg.2023.2
Sumit Shekhar
{"title":"ALIVE: Adaptive-Chromaticity for Interactive Low-light Image and Video Enhancement","authors":"Sumit Shekhar","doi":"10.24132/jwscg.2023.2","DOIUrl":"https://doi.org/10.24132/jwscg.2023.2","url":null,"abstract":"Ray tracing remains of interest to Computer Graphics community with its elegant framing of how light interacts with objects, being able to easily support multiple light sources, and simple framework of merging synthetic and real cameras. Recent trends to provide implementations at the chip-level means raytracing’s constant quest of realism would propel its usage in real-time applications. AR/VR, Animations, 3DGames Industry, 3D-large scale simulations, and future social computing platforms are just a few examples of possible major impact. Raytracing is also appealing to HCI community because raytracing extends well along the 3D-space and time, seamlessly blending both synthetic and real cameras at multiple scales to support storytelling. This presentation will include a few milestones from my work such as the Slicing Extent technique and Directed Safe Zones. Our recent applications of applying machine learning techniques creating novel synthetic views, which could also provide a future doorway to handle dynamic scenes with more compute power as needed, will also be presented. It is once again renaissance for ray tracing which for last 50+ years has remained the most elegant technique for modeling light phenomena in virtual worlds at whatever scale compute power could support.","PeriodicalId":338597,"journal":{"name":"J. WSCG","volume":"47 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133320216","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. WSCGPub Date : 2023-07-01DOI: 10.24132/jwscg.2023.9
R. Dȩbski, O. Schmitt, P. Trenz, M. Reimann, J. Döllner, Matthias Trapp, H. Plattner
{"title":"A Framework for Art-directed Augmentation of Human Motion in Videos on Mobile Devices","authors":"R. Dȩbski, O. Schmitt, P. Trenz, M. Reimann, J. Döllner, Matthias Trapp, H. Plattner","doi":"10.24132/jwscg.2023.9","DOIUrl":"https://doi.org/10.24132/jwscg.2023.9","url":null,"abstract":"This paper presents a framework and mobile video editing app for interactive artistic augmentation of human motion in videos. While creating motion effects with industry-standard software is time-intensive and requires expertise, and popular video effect apps have limited customization options, our approach enables a multitude of art-directable, highly customizable motion effects. We propose a graph-based video processing framework that uses mobile-optimized machine learning models for human segmentation and pose estimation to augment RGB video data, enabling the rendering and animation of content-adaptive graphical elements that highlight and emphasize motion. Our modular framework architecture enables effect designers to create diverse motion effects that include body pose-based effects such as glow stick or light trail effects, silhouette-based effects such as halos and outlines, and layer-based effects that provide depth perception and enable interaction with virtual objects.","PeriodicalId":338597,"journal":{"name":"J. WSCG","volume":"26 5","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"120937178","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. WSCGPub Date : 2023-07-01DOI: 10.24132/jwscg.2023.4
Alex Shaw, B. Wünsche, Kevin Mariono, Aiden Ranveer, Manhui Xiao, Ryo Hajika, Yitong Liu
{"title":"JengASL: A Gamified Approach to Sign Language Learning in VR","authors":"Alex Shaw, B. Wünsche, Kevin Mariono, Aiden Ranveer, Manhui Xiao, Ryo Hajika, Yitong Liu","doi":"10.24132/jwscg.2023.4","DOIUrl":"https://doi.org/10.24132/jwscg.2023.4","url":null,"abstract":"Learning sign language has many advantages ranging from being able to communicate with millions of hearing impaired people, to improving cognitive function and communication skills. Sign language is recognised as an official language in 74 countries, including Germany, Japan, and the UK. Despite that only a small percentage of people attempt to learn sign language. In this research we investigate how virtual reality and gamification can be used to make learning sign language more enjoyable and motivating. We present JengASL, a gamified approach using 3D hand models, gesture recognition, and interactive gameplay in Virtual Reality to teach American Sign Language. We evaluate this system with a pilot study using eight participants and found that while it is less effective for sign memorisation than traditional 2D image-based learning methods, learning is more, but not significantly more, enjoyable and motivating.","PeriodicalId":338597,"journal":{"name":"J. WSCG","volume":"90 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131750375","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. WSCGPub Date : 2023-07-01DOI: 10.24132/jwscg.2023.10
Latifah Abduh, Luma Omar, I. Ivrissimtzis
{"title":"Anomaly Detection with Transformer in Face Anti-spoofing","authors":"Latifah Abduh, Luma Omar, I. Ivrissimtzis","doi":"10.24132/jwscg.2023.10","DOIUrl":"https://doi.org/10.24132/jwscg.2023.10","url":null,"abstract":"Transformers are emerging as the new gold standard in various computer vision applications, and have already been used in face anti-spoofing demonstrating competitive performance. In this paper, we propose a network with the ViT transformer and ResNet as the backbone for anomaly detection in face anti-spoofing and compare the performance of various one-class classifiers at the end of the pipeline, such as one-class SVM, Isolation Forest, and decoders. Test results on the RA and SiW databases show the proposed approach to be competitive as an anomaly detection method for face anti-spoofing.","PeriodicalId":338597,"journal":{"name":"J. WSCG","volume":"14 2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124091315","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. WSCGPub Date : 2020-05-01DOI: 10.24132/jwscg.2020.28.13
Fernando Reyes-Aviles, Philipp Fleck, D. Schmalstieg, Clemens Arth
{"title":"Improving RGB Image Consistency for Depth-Camera based Reconstruction through Image Warping","authors":"Fernando Reyes-Aviles, Philipp Fleck, D. Schmalstieg, Clemens Arth","doi":"10.24132/jwscg.2020.28.13","DOIUrl":"https://doi.org/10.24132/jwscg.2020.28.13","url":null,"abstract":"Indoor reconstruction using depth camera algorithms (e.g., InfiniTAMv3) is becoming increasingly popular. Simple reconstruction methods solely use the frames of the depth camera, leaving any imagery from the adjunct RGB camera untouched. Recent approaches also incorporate color camera information to improve consistency. However, the results heavily depend on the accuracy of the rig calibration, which can strongly vary in quality. Unfortunately, any errors in the rig calibration result in apparent visual discrepancies when it comes to colorization of the 3D reconstruction. We propose an easy approach to fix this issue for the purpose of image-based rendering. We show that a relatively simple warping function can be calculated from a 3D checkerboard pattern for a rig with poor calibration between cameras. The warping is applied to the RGB images online during reconstruction, leading to a significantly improved visual result.","PeriodicalId":338597,"journal":{"name":"J. WSCG","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122502459","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. WSCGPub Date : 2019-10-07DOI: 10.24132/JWSCG.2019.27.2.9
Daniel Organisciak, Chirine Riachy, N. Aslam, Hubert P. H. Shum
{"title":"Triplet Loss with Channel Attention for Person Re-identification","authors":"Daniel Organisciak, Chirine Riachy, N. Aslam, Hubert P. H. Shum","doi":"10.24132/JWSCG.2019.27.2.9","DOIUrl":"https://doi.org/10.24132/JWSCG.2019.27.2.9","url":null,"abstract":"The triplet loss function has seen extensive use within person re-identification. Most works focus on either improving the mining algorithm or adding new terms to the loss function itself. Our work instead concentrates on two other core components of the triplet loss that have been under-researched. First, we improve the standard Euclidean distance with dynamic weights, which are selected based on the standard deviation of features across the batch. Second, we exploit channel attention via a squeeze and excitation unit in the backbone model to emphasise important features throughout all layers of the model. This ensures that the output feature vector is a better representation of the image, and is also more suitable to use within our dynamically weighted Euclidean distance function. We demonstrate that our alterations provide significant performance improvement across popular reidentification data sets, including almost 10% mAP improvement on the CUHK03 data set. The proposed model attains results competitive with many state-of-the-art person re-identification models.","PeriodicalId":338597,"journal":{"name":"J. WSCG","volume":"53 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-10-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124084460","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}