Proceedings of the ACM on computer graphics and interactive techniques最新文献_第4页

Intersection of Seeing 视野的交叉点

Proceedings of the ACM on computer graphics and interactive techniques Pub Date : 2023-08-12 DOI: 10.1145/3597632

Seonghoon Ban, Taeha Yi, Kyung Hoon Hyun

引用次数: 0

Lights! Dance! Freeze! 灯!跳舞!冻结!

Proceedings of the ACM on computer graphics and interactive techniques Pub Date : 2023-08-12 DOI: 10.1145/3597620

Theodoros Papatheodorou, Jessica Wolpert

引用次数: 0

Physics-based Motion Retargeting from Sparse Inputs 稀疏输入的基于物理的运动重定向

Proceedings of the ACM on computer graphics and interactive techniques Pub Date : 2023-07-04 DOI: 10.1145/3606928

Daniele Reda, Jungdam Won, Yuting Ye, M. V. D. Panne, Alexander W. Winkler

{"title":"Physics-based Motion Retargeting from Sparse Inputs","authors":"Daniele Reda, Jungdam Won, Yuting Ye, M. V. D. Panne, Alexander W. Winkler","doi":"10.1145/3606928","DOIUrl":"https://doi.org/10.1145/3606928","url":null,"abstract":"Avatars are important to create interactive and immersive experiences in virtual worlds. One challenge in animating these characters to mimic a user's motion is that commercial AR/VR products consist only of a headset and controllers, providing very limited sensor data of the user's pose. Another challenge is that an avatar might have a different skeleton structure than a human and the mapping between them is unclear. In this work we address both of these challenges. We introduce a method to retarget motions in real-time from sparse human sensor data to characters of various morphologies. Our method uses reinforcement learning to train a policy to control characters in a physics simulator. We only require human motion capture data for training, without relying on artist-generated animations for each avatar. This allows us to use large motion capture datasets to train general policies that can track unseen users from real and sparse data in real-time. We demonstrate the feasibility of our approach on three characters with different skeleton structure: a dinosaur, a mouse-like creature and a human. We show that the avatar poses often match the user surprisingly well, despite having no sensor information of the lower body available. We discuss and ablate the important components in our framework, specifically the kinematic retargeting step, the imitation, contact and action reward as well as our asymmetric actor-critic observations. We further explore the robustness of our method in a variety of settings including unbalancing, dancing and sports motions.","PeriodicalId":74536,"journal":{"name":"Proceedings of the ACM on computer graphics and interactive techniques","volume":" ","pages":"1 - 19"},"PeriodicalIF":0.0,"publicationDate":"2023-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44565345","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Hierarchical Planning and Control for Box Loco-Manipulation 箱体局部操纵的分层规划与控制

Proceedings of the ACM on computer graphics and interactive techniques Pub Date : 2023-06-15 DOI: 10.1145/3606931

Zhaoming Xie, Jo-Han Tseng, S. Starke, M. van de Panne, C. Liu

引用次数: 6

Eye-Based Point Rendering for Dynamic Multiview Effects 基于眼睛的点渲染动态多视图效果

Proceedings of the ACM on computer graphics and interactive techniques Pub Date : 2023-05-12 DOI: 10.1145/3585513

Ajinkya Gavane, B. Watson

引用次数: 0

Efficient Rendering for Light Field Displays using Tailored Projective Mappings 高效渲染光场显示使用量身定制的投影映射

Proceedings of the ACM on computer graphics and interactive techniques Pub Date : 2023-05-12 DOI: 10.1145/3585498

Laura Fink, Svenja Strobel, Linus Franke, M. Stamminger

引用次数: 1

An Interactive Framework for Visually Realistic 3D Motion Synthesis using Evolutionarily-trained Spiking Neural Networks 使用进化训练的脉冲神经网络进行视觉逼真3D运动合成的交互式框架

Proceedings of the ACM on computer graphics and interactive techniques Pub Date : 2023-05-12 DOI: 10.1145/3585509

Ioannis E. Polykretis, Aditi Patil, Mridul Aanjaneya, K. Michmizos

{"title":"An Interactive Framework for Visually Realistic 3D Motion Synthesis using Evolutionarily-trained Spiking Neural Networks","authors":"Ioannis E. Polykretis, Aditi Patil, Mridul Aanjaneya, K. Michmizos","doi":"10.1145/3585509","DOIUrl":"https://doi.org/10.1145/3585509","url":null,"abstract":"We present an end-to-end method for capturing the dynamics of 3D human characters and translating them for synthesizing new, visually-realistic motion sequences. Conventional methods employ sophisticated, but generic, control approaches for driving the joints of articulated characters, paying little attention to the distinct dynamics of human joint movements. In contrast, our approach attempts to synthesize human-like joint movements by exploiting a biologically-plausible, compact network of spiking neurons that drive joint control in primates and rodents. We adapt the controller architecture by introducing learnable components and propose an evolutionary algorithm for training the spiking neural network architectures and capturing diverse joint dynamics. Our method requires only a few samples for capturing the dynamic properties of a joint's motion and exploits the biologically-inspired, trained controller for its reconstruction. More importantly, it can transfer the captured dynamics to new visually-plausible motion sequences. To enable user-dependent tailoring of the resulting motion sequences, we develop an interactive framework that allows for editing and real-time visualization of the controlled 3D character. We also demonstrate the applicability of our method to real human motion capture data by learning the hand joint dynamics from a gesture dataset and using our framework to reconstruct the gestures with our 3D animated character. The compact architecture of our joint controller emerging from its biologically-realistic design, and the inherent capacity of our evolutionary learning algorithm for parallelization, suggest that our approach could provide an efficient and scalable alternative for synthesizing 3D character animations with diverse and visually-realistic motion dynamics.","PeriodicalId":74536,"journal":{"name":"Proceedings of the ACM on computer graphics and interactive techniques","volume":" ","pages":"1 - 19"},"PeriodicalIF":0.0,"publicationDate":"2023-05-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48345177","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Unpaired Translation of 3D Point Clouds with Multi-part Shape Representation 基于多部分形状表示的三维点云非配对平移

Proceedings of the ACM on computer graphics and interactive techniques Pub Date : 2023-05-12 DOI: 10.1145/3585508

Chih-Chia Li, I-Chen Lin

引用次数: 0

Differentiable Curl-Noise 可微的Curl-Noise

Proceedings of the ACM on computer graphics and interactive techniques Pub Date : 2023-05-12 DOI: 10.1145/3585511

Xinwen Ding, Christopher Peter Batty

引用次数: 0

Joint Neural Denoising of Surfaces and Volumes 表面和体积的联合神经去噪

Proceedings of the ACM on computer graphics and interactive techniques Pub Date : 2023-05-12 DOI: 10.1145/3585497

Nikolai Hofmann, J. Hasselgren, Jacob Munkberg

引用次数: 0