ACM Transactions on Graphics最新文献_第10页

Self-Supervised High Dynamic Range Imaging: What Can Be Learned from a Single 8-bit Video? 自监督高动态范围成像：从单个 8 位视频中能学到什么？

IF 6.2 1区计算机科学

ACM Transactions on Graphics Pub Date : 2024-02-20 DOI: 10.1145/3648570

Francesco Banterle, Demetris Marnerides, Thomas Bashford-Rogers, Kurt Debattista

引用次数: 0

GIPC: Fast and stable Gauss-Newton optimization of IPC barrier energy GIPC：快速稳定的工频阻挡能高斯-牛顿优化算法

IF 6.2 1区计算机科学

ACM Transactions on Graphics Pub Date : 2024-01-27 DOI: 10.1145/3643028

Kemeng Huang, Floyd M. Chitalu, Huancheng Lin, Taku Komura

{"title":"GIPC: Fast and stable Gauss-Newton optimization of IPC barrier energy","authors":"Kemeng Huang, Floyd M. Chitalu, Huancheng Lin, Taku Komura","doi":"10.1145/3643028","DOIUrl":"https://doi.org/10.1145/3643028","url":null,"abstract":"Barrier functions are crucial for maintaining an intersection and inversion free simulation trajectory but existing methods which directly use distance can restrict implementation design and performance. We present an approach to rewriting the barrier function for arriving at an efficient and robust approximation of its Hessian. The key idea is to formulate a simplicial geometric measure of contact using mesh boundary elements, from which analytic eigensystems are derived and enhanced with filtering and stiffening terms that ensure robustness with respect to the convergence of a Project-Newton solver. A further advantage of our rewriting of the barrier function is that it naturally caters to the notorious case of nearly-parallel edge-edge contacts for which we also present a novel analytic eigensystem. Our approach is thus well suited for standard second order unconstrained optimization strategies for resolving contacts, minimizing nonlinear nonconvex functions where the Hessian may be indefinite. The efficiency of our eigensystems alone yields a 3 × speedup over the standard IPC barrier formulation. We further apply our analytic proxy eigensystems to produce an entirely GPU-based implementation of IPC with significant further acceleration.","PeriodicalId":50913,"journal":{"name":"ACM Transactions on Graphics","volume":"56 1","pages":""},"PeriodicalIF":6.2,"publicationDate":"2024-01-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139568249","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Spectral Total-Variation Processing of Shapes - Theory and Applications 形状的光谱总变化处理 - 理论与应用

IF 6.2 1区计算机科学

ACM Transactions on Graphics Pub Date : 2024-01-26 DOI: 10.1145/3641845

Jonathan Brokman, Martin Burger, Guy Gilboa

{"title":"Spectral Total-Variation Processing of Shapes - Theory and Applications","authors":"Jonathan Brokman, Martin Burger, Guy Gilboa","doi":"10.1145/3641845","DOIUrl":"https://doi.org/10.1145/3641845","url":null,"abstract":"We present a comprehensive analysis of total variation (TV) on non-Euclidean domains and its eigenfunctions. We specifically address parameterized surfaces, a natural representation of the shapes used in 3D graphics. Our work sheds new light on the celebrated Beltrami and Anisotropic TV flows, and explains experimental findings from recent years on shape spectral TV [Fumero et al. 2020] and adaptive anisotropic spectral TV [Biton and Gilboa 2022]. A new notion of convexity on surfaces is derived by characterizing structures that are stable throughout the TV flow, performed on surfaces. We establish and numerically demonstrate quantitative relationships between TV, area, eigenvalue, and eigenfunctions of the TV operator on surfaces. Moreover, we expand the shape spectral TV toolkit to include zero-homogeneous flows, leading to efficient and versatile shape processing methods. These methods are exemplified through applications in smoothing, enhancement, and exaggeration filters. We introduce a novel method which, for the first time, addresses the shape deformation task using TV. This deformation technique is characterized by the concentration of deformation along geometrical bottlenecks, shown to coincide with the discontinuities of eigenfunctions. Overall, our findings elucidate recent experimental observations in spectral TV, provide a diverse framework for shape filtering, and present the first TV-based approach to shape deformation.","PeriodicalId":50913,"journal":{"name":"ACM Transactions on Graphics","volume":"38 1","pages":""},"PeriodicalIF":6.2,"publicationDate":"2024-01-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139565693","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

NeuralVDB: High-resolution Sparse Volume Representation using Hierarchical Neural Networks NeuralVDB：利用层次神经网络进行高分辨率稀疏体表示

IF 6.2 1区计算机科学

ACM Transactions on Graphics Pub Date : 2024-01-23 DOI: 10.1145/3641817

Doyub Kim, Minjae Lee, Ken Museth

{"title":"NeuralVDB: High-resolution Sparse Volume Representation using Hierarchical Neural Networks","authors":"Doyub Kim, Minjae Lee, Ken Museth","doi":"10.1145/3641817","DOIUrl":"https://doi.org/10.1145/3641817","url":null,"abstract":"We introduce NeuralVDB, which improves on an existing industry standard for efficient storage of sparse volumetric data, denoted VDB [Museth 2013], by leveraging recent advancements in machine learning. Our novel hybrid data structure can reduce the memory footprints of VDB volumes by orders of magnitude, while maintaining its flexibility and only incurring small (user-controlled) compression errors. Specifically, NeuralVDB replaces the lower nodes of a shallow and wide VDB tree structure with multiple hierarchical neural networks that separately encode topology and value information by means of neural classifiers and regressors respectively. This approach is proven to maximize the compression ratio while maintaining the spatial adaptivity offered by the higher-level VDB data structure. For sparse signed distance fields and density volumes, we have observed compression ratios on the order of 10 × to more than 100 × from already compressed VDB inputs, with little to no visual artifacts. Furthermore, NeuralVDB is shown to offer more effective compression performance compared to other neural representations such as Neural Geometric Level of Detail [Takikawa et al. 2021], Variable Bitrate Neural Fields [Takikawa et al. 2022a], and Instant Neural Graphics Primitives [Müller et al. 2022]. Finally, we demonstrate how warm-starting from previous frames can accelerate training, i.e., compression, of animated volumes as well as improve temporal coherency of model inference, i.e., decompression.","PeriodicalId":50913,"journal":{"name":"ACM Transactions on Graphics","volume":"65 1","pages":""},"PeriodicalIF":6.2,"publicationDate":"2024-01-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139522653","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

DeadWood: Including disturbance and decay in the depiction of digital nature: ACM Transactions on Graphics: Vol 0, No ja DeadWood：将干扰和衰变纳入数字自然描绘：ACM Transactions on Graphics：Vol 0, No ja

IF 6.2 1区计算机科学

ACM Transactions on Graphics Pub Date : 2024-01-23 DOI: 10.1145/3641816

Adrien Peytavie, James Gain, Eric Guérin, Oscar Argudo, Eric Galin

{"title":"DeadWood: Including disturbance and decay in the depiction of digital nature: ACM Transactions on Graphics: Vol 0, No ja","authors":"Adrien Peytavie, James Gain, Eric Guérin, Oscar Argudo, Eric Galin","doi":"10.1145/3641816","DOIUrl":"https://doi.org/10.1145/3641816","url":null,"abstract":"The creation of truly believable simulated natural environments remains an unsolved problem in Computer Graphics. This is, in part, due to a lack of visual variety. In nature, apart from variation due to abiotic and biotic growth factors, a significant role is played by disturbance events, such as fires, windstorms, disease, and death and decay processes, which give rise to both standing dead trees (snags) and downed woody debris (logs). For instance, snags constitute on average (10% ) of unmanaged forests by basal area, and logs account for (2 frac{1}{2} ) times this quantity. While previous systems have incorporated individual elements of disturbance (e.g., forest fires) and decay (e.g., the formation of humus), there has been no unifying treatment, perhaps because of the challenge of matching simulation results with generated geometric models. In this paper, we present a framework that combines an ecosystem simulation, which explicitly incorporates disturbance events and decay processes, with a model realization process, which balances the uniqueness arising from life history with the need for instancing due to memory constraints. We tested our hypothesis concerning the visual impact of disturbance and decay with a two-alternative forced-choice experiment (n = 116). Our findings are that the presence of dead wood in various forms, as snags or logs, significantly improves the believability of natural scenes, while, surprisingly, general variation in the number of model instances, with up to 8 models per species, and a focus on disturbance events, does not.","PeriodicalId":50913,"journal":{"name":"ACM Transactions on Graphics","volume":"39 1","pages":""},"PeriodicalIF":6.2,"publicationDate":"2024-01-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139522554","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Creation of Dihedral Escher-like Tilings Based on As-Rigid-As-Possible Deformation 基于 "尽可能刚性 "变形的二面埃舍尔式结构的创建

IF 6.2 1区计算机科学

ACM Transactions on Graphics Pub Date : 2023-12-21 DOI: 10.1145/3638048

Yuichi Nagata, Shinji Imahori

{"title":"Creation of Dihedral Escher-like Tilings Based on As-Rigid-As-Possible Deformation","authors":"Yuichi Nagata, Shinji Imahori","doi":"10.1145/3638048","DOIUrl":"https://doi.org/10.1145/3638048","url":null,"abstract":"An Escher-like tiling is a tiling consisting of one or a few artistic shapes of tile. This paper proposes a method for generating Escher-like tilings consisting of two distinct shapes (dihedral Escher-like tilings) that are as similar as possible to the two goal shapes specified by the user. This study is an extension of a previous study that successfully generated Escher-like tilings consisting of a single tile shape for a single goal shape. Building upon the previous study, our method attempts to exhaustively search for which parts of the discretized tile contours are adjacent to each other to form a tiling. For each configuration, two tile shapes are optimized to be similar to the given two goal shapes. By evaluating the similarity based on as-rigid-as possible deformation energy, the optimized tile shapes preserve the local structures of the goal shapes, even if substantial deformations are necessary to form a tiling. However, in the dihedral case, this approach is seemingly unrealistic because it suffers from the complexity of the energy function and the combinatorial explosion of the possible configurations. We developed a method to address these issues and show that the proposed algorithms can generate satisfactory dihedral Escher-like tilings in a realistic computation time, even for somewhat complex goal shapes.","PeriodicalId":50913,"journal":{"name":"ACM Transactions on Graphics","volume":"5 1","pages":""},"PeriodicalIF":6.2,"publicationDate":"2023-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138822787","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

A Unified MPM Framework supporting Phase-field Models and Elastic-viscoplastic Phase Transition 支持相场模型和弹塑性-粘塑性相变的统一 MPM 框架

IF 6.2 1区计算机科学

ACM Transactions on Graphics Pub Date : 2023-12-20 DOI: 10.1145/3638047

Zaili Tu, Chen Li, Zipeng Zhao, Long Liu, Chenhui Wang, Changbo Wang, Hong Qin

{"title":"A Unified MPM Framework supporting Phase-field Models and Elastic-viscoplastic Phase Transition","authors":"Zaili Tu, Chen Li, Zipeng Zhao, Long Liu, Chenhui Wang, Changbo Wang, Hong Qin","doi":"10.1145/3638047","DOIUrl":"https://doi.org/10.1145/3638047","url":null,"abstract":"Recent years have witnessed the rapid deployment of numerous physics-based modeling and simulation algorithms and techniques for fluids, solids, and their delicate coupling in computer animation. However, it still remains a challenging problem to model the complex elastic-viscoplastic (EVP) behaviors during fluid-solid phase transitions and facilitate their seamless interactions inside the same framework. In this paper, we propose a practical method capable of simulating granular flows, viscoplastic liquids, elastic-plastic solids, rigid bodies, and interacting with each other, to support novel phenomena all heavily involving realistic phase transitions, including dissolution, melting, cooling, expansion, shrinking, etc. At the physics level, we propose to combine and morph von Mises with Drucker-Prager and Cam-Clay yield models to establish a unified phase-field-driven EVP model, capable of describing the behaviors of granular, elastic, plastic, viscous materials, liquid, non-Newtonian fluids, and their smooth evolution. At the numerical level, we derive the discretization form of Cahn-Hilliard and Allen-Cahn equations with the material point method (MPM) to effectively track the phase-field evolution, so as to avoid explicit handling of the boundary conditions at the interface. At the application level, we design a novel heuristic strategy to control specialized behaviors via user-defined schemes, including chemical potential, density curve, etc. We exhibit a set of numerous experimental results consisting of challenging scenarios in order to validate the effectiveness and versatility of the new unified approach. This flexible and highly stable framework, founded upon the unified treatment and seamless coupling among various phases, and effective numerical discretization, has its unique advantage in animation creation towards novel phenomena heavily involving phase transitions with artistic creativity and guidance.","PeriodicalId":50913,"journal":{"name":"ACM Transactions on Graphics","volume":"35 6 1","pages":""},"PeriodicalIF":6.2,"publicationDate":"2023-12-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138770840","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Promptable Game Models: Text-Guided Game Simulation via Masked Diffusion Models 提示游戏模型:通过蒙面扩散模型的文本引导游戏模拟

IF 6.2 1区计算机科学

ACM Transactions on Graphics Pub Date : 2023-12-05 DOI: 10.1145/3635705

Willi Menapace, Aliaksandr Siarohin, Stéphane Lathuilière, Panos Achlioptas, Vladislav Golyanik, Sergey Tulyakov, Elisa Ricci

{"title":"Promptable Game Models: Text-Guided Game Simulation via Masked Diffusion Models","authors":"Willi Menapace, Aliaksandr Siarohin, Stéphane Lathuilière, Panos Achlioptas, Vladislav Golyanik, Sergey Tulyakov, Elisa Ricci","doi":"10.1145/3635705","DOIUrl":"https://doi.org/10.1145/3635705","url":null,"abstract":"Neural video game simulators emerged as powerful tools to generate and edit videos. Their idea is to represent games as the evolution of an environment’s state driven by the actions of its agents. While such a paradigm enables users to play a game action-by-action, its rigidity precludes more semantic forms of control. To overcome this limitation, we augment game models with prompts specified as a set of natural language actions and desired states. The result—a Promptable Game Model (PGM)—makes it possible for a user to play the game by prompting it with high- and low-level action sequences. Most captivatingly, our PGM unlocks the director’s mode, where the game is played by specifying goals for the agents in the form of a prompt. This requires learning “game AI”, encapsulated by our animation model, to navigate the scene using high-level constraints, play against an adversary, and devise a strategy to win a point. To render the resulting state, we use a compositional NeRF representation encapsulated in our synthesis model. To foster future research, we present newly collected, annotated and calibrated Tennis and Minecraft datasets. Our method significantly outperforms existing neural video game simulators in terms of rendering quality and unlocks applications beyond the capabilities of the current state of the art. Our framework, data, and models are available at snap-research.github.io/promptable-game-models.","PeriodicalId":50913,"journal":{"name":"ACM Transactions on Graphics","volume":"11 1","pages":""},"PeriodicalIF":6.2,"publicationDate":"2023-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138544775","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 6

Neural Wavelet-domain Diffusion for 3D Shape Generation, Inversion, and Manipulation 神经小波域扩散三维形状生成，反演和操作

IF 6.2 1区计算机科学

ACM Transactions on Graphics Pub Date : 2023-12-01 DOI: 10.1145/3635304

Jingyu Hu, Ka-Hei Hui, Zhengzhe Liu, Ruihui Li, Chi-Wing Fu

引用次数: 2

Haisor: Human-Aware Indoor Scene Optimization via Deep Reinforcement Learning Haisor:基于深度强化学习的人类感知室内场景优化

IF 6.2 1区计算机科学

ACM Transactions on Graphics Pub Date : 2023-11-18 DOI: 10.1145/3632947

Jia-Mu Sun, Jie Yang, Kaichun Mo, Yu-Kun Lai, Leonidas Guibas, Lin Gao

{"title":"Haisor: Human-Aware Indoor Scene Optimization via Deep Reinforcement Learning","authors":"Jia-Mu Sun, Jie Yang, Kaichun Mo, Yu-Kun Lai, Leonidas Guibas, Lin Gao","doi":"10.1145/3632947","DOIUrl":"https://doi.org/10.1145/3632947","url":null,"abstract":"3D scene synthesis facilitates and benefits many real-world applications. Most scene generators focus on making indoor scenes plausible via learning from training data and leveraging extra constraints such as adjacency and symmetry. Although the generated 3D scenes are mostly plausible with visually realistic layouts, they can be functionally unsuitable for human users to navigate and interact with furniture. Our key observation is that human activity plays a critical role and sufficient free space is essential for human-scene interactions. This is exactly where many existing synthesized scenes fail – the seemingly correct layouts are often not fit for living. To tackle this, we present a human-aware optimization framework Haisor for 3D indoor scene arrangement via reinforcement learning, which aims to find an action sequence to optimize the indoor scene layout automatically. Based on the hierarchical scene graph representation, an optimal action sequence is predicted and performed via Deep Q-Learning with Monte Carlo Tree Search (MCTS), where MCTS is our key feature to search for the optimal solution in long-term sequences and large action space. Multiple human-aware rewards are designed as our core criteria of human-scene interaction, aiming to identify the next smart action by leveraging powerful reinforcement learning. Our framework is optimized end-to-end by giving the indoor scenes with part-level furniture layout including part mobility information. Furthermore, our methodology is extensible and allows utilizing different reward designs to achieve personalized indoor scene synthesis. Extensive experiments demonstrate that our approach optimizes the layout of 3D indoor scenes in a human-aware manner, which is more realistic and plausible than original state-of-the-art generator results, and our approach produces superior smart actions, outperforming alternative baselines.","PeriodicalId":50913,"journal":{"name":"ACM Transactions on Graphics","volume":"86 19","pages":""},"PeriodicalIF":6.2,"publicationDate":"2023-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138438944","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0