Proceedings of the ACM on computer graphics and interactive techniques最新文献_第7页

DiffXPBD DiffXPBD

Proceedings of the ACM on computer graphics and interactive techniques Pub Date : 2023-01-04 DOI: 10.1145/3606923

Tuur Stuyck, Hsiao-yu Chen

{"title":"DiffXPBD","authors":"Tuur Stuyck, Hsiao-yu Chen","doi":"10.1145/3606923","DOIUrl":"https://doi.org/10.1145/3606923","url":null,"abstract":"We present DiffXPBD, a novel and efficient analytical formulation for the differentiable position-based simulation of compliant constrained dynamics (XPBD). Our proposed method allows computation of gradients of numerous parameters with respect to a goal function simultaneously leveraging a performant simulation model. The method is efficient, thus enabling differentiable simulations of high resolution geometries and degrees of freedom (DoFs). Collisions are naturally included in the framework. Our differentiable model allows a user to easily add additional optimization variables. Every control variable gradient requires the computation of only a few partial derivatives which can be computed using automatic differentiation code. We demonstrate the efficacy of the method with examples such as elastic cloth and volumetric material parameter estimation, initial value optimization, optimizing for underlying body shape and pose by only observing the clothing, and optimizing a time-varying external force sequence to match sparse keyframe shapes at specific times. Our approach demonstrates excellent efficiency and we demonstrate this on high resolution meshes with optimizations involving over 26 million degrees of freedom. Making an existing solver differentiable requires only a few modifications and the model is compatible with both modern CPU and GPU multi-core hardware.","PeriodicalId":74536,"journal":{"name":"Proceedings of the ACM on computer graphics and interactive techniques","volume":"6 1","pages":"1 - 14"},"PeriodicalIF":0.0,"publicationDate":"2023-01-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48974283","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

NeRFshop: Interactive Editing of Neural Radiance Fields NeRFshop:神经辐射场的交互式编辑

Proceedings of the ACM on computer graphics and interactive techniques Pub Date : 2023-01-01 DOI: 10.1145/3585499

Clément Jambon, B. Kerbl, Georgios Kopanas, Stavros Diolatzis, Thomas Leimkühler, G. Drettakis

{"title":"NeRFshop: Interactive Editing of Neural Radiance Fields","authors":"Clément Jambon, B. Kerbl, Georgios Kopanas, Stavros Diolatzis, Thomas Leimkühler, G. Drettakis","doi":"10.1145/3585499","DOIUrl":"https://doi.org/10.1145/3585499","url":null,"abstract":"Neural Radiance Fields (NeRFs) have revolutionized novel view synthesis for captured scenes, with recent methods allowing interactive free-viewpoint navigation and fast training for scene reconstruction. However, the implicit representations used by these methods—often including neural networks and complex encodings— make them difficult to edit. Some initial methods have been proposed, but they suffer from limited editing capabilities and/or from a lack of interactivity, and are thus unsuitable for interactive editing of captured scenes. We tackle both limitations and introduce NeRFshop, a novel end-to-end method that allows users to interactively select and deform objects through cage-based transformations. NeRFshop provides fine scribble-based user control for the selection of regions or objects to edit, semi-automatic cage creation, and interactive volumetric manipulation of scene content thanks to our GPU-friendly two-level interpolation scheme. Further, we introduce a preliminary approach that reduces potential resulting artifacts of these transformations with a volumetric membrane interpolation technique inspired by Poisson image editing and provide a process that “distills” the edits into a standalone NeRF representation.","PeriodicalId":74536,"journal":{"name":"Proceedings of the ACM on computer graphics and interactive techniques","volume":"6 1","pages":"1:1-1:21"},"PeriodicalIF":0.0,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"64067887","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 19

NeRFahedron: A Primitive for Animatable Neural Rendering with Interactive Speed NeRFahedron:具有交互速度的可动画神经渲染的原语

Proceedings of the ACM on computer graphics and interactive techniques Pub Date : 2023-01-01 DOI: 10.1145/3585512

Zackary P. T. Sin, P. H. F. Ng, H. Leong

引用次数: 1

HDHumans HDHumans

Proceedings of the ACM on computer graphics and interactive techniques Pub Date : 2022-10-21 DOI: 10.1145/3606927

Marc Habermann, Lingjie Liu, Weipeng Xu, Gerard Pons-Moll, Michael Zollhoefer, C. Theobalt

{"title":"HDHumans","authors":"Marc Habermann, Lingjie Liu, Weipeng Xu, Gerard Pons-Moll, Michael Zollhoefer, C. Theobalt","doi":"10.1145/3606927","DOIUrl":"https://doi.org/10.1145/3606927","url":null,"abstract":"Photo-real digital human avatars are of enormous importance in graphics, as they enable immersive communication over the globe, improve gaming and entertainment experiences, and can be particularly beneficial for AR and VR settings. However, current avatar generation approaches either fall short in high-fidelity novel view synthesis, generalization to novel motions, reproduction of loose clothing, or they cannot render characters at the high resolution offered by modern displays. To this end, we propose HDHumans, which is the first method for HD human character synthesis that jointly produces an accurate and temporally coherent 3D deforming surface and highly photo-realistic images of arbitrary novel views and of motions not seen at training time. At the technical core, our method tightly integrates a classical deforming character template with neural radiance fields (NeRF). Our method is carefully designed to achieve a synergy between classical surface deformation and a NeRF. First, the template guides the NeRF, which allows synthesizing novel views of a highly dynamic and articulated character and even enables the synthesis of novel motions. Second, we also leverage the dense pointclouds resulting from the NeRF to further improve the deforming surface via 3D-to-3D supervision. We outperform the state of the art quantitatively and qualitatively in terms of synthesis quality and resolution, as well as the quality of 3D surface reconstruction.","PeriodicalId":74536,"journal":{"name":"Proceedings of the ACM on computer graphics and interactive techniques","volume":"6 1","pages":"1 - 23"},"PeriodicalIF":0.0,"publicationDate":"2022-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48119283","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Below Victory 胜利之下

Proceedings of the ACM on computer graphics and interactive techniques Pub Date : 2022-09-06 DOI: 10.1145/3533389

S. Hessels

{"title":"Below Victory","authors":"S. Hessels","doi":"10.1145/3533389","DOIUrl":"https://doi.org/10.1145/3533389","url":null,"abstract":"Recent advances in Ground Penetrating Radar have caused the imaging technology to pivot from a simple construction engineering tool to a valuable new option for archaeology. Newfound abilities to model sound echoes resonating through stone have revealed archeological discoveries where excavation is not possible. Working with a transdisciplinary team, the artist secured a GPR scan of 2,000-year-old Gallo-Roman temple ruins below the plaza of a gothic cathedral in France. The technology's sounding image of the hidden site became a visual language that was explored in a 2-year series of artworks based on the discovery. The art + science research project resulted in data visualizations across many creative media including site-specific public trompe l'oeil, augmented reality, and hundreds of design experiments. Using the GPR dataset as a foundational resource in art-making, the project expanded the interpretation of Digital Heritage. Collectively, the works reinforced the understanding of a site hidden since Antiquity but also considered public non-sites in pandemic times. The advances in this scanning technology proved to be a powerful creative tool to highlight themes of how we protect and understand heritage, how we create public experiences in socially distanced times, and our responsibility to continually reconsider complex history.","PeriodicalId":74536,"journal":{"name":"Proceedings of the ACM on computer graphics and interactive techniques","volume":" ","pages":"1 - 10"},"PeriodicalIF":0.0,"publicationDate":"2022-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48137596","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Three Stage Drawing Transfer 三阶段图纸转移

Proceedings of the ACM on computer graphics and interactive techniques Pub Date : 2022-09-06 DOI: 10.1145/3533614

R. Twomey

{"title":"Three Stage Drawing Transfer","authors":"R. Twomey","doi":"10.1145/3533614","DOIUrl":"https://doi.org/10.1145/3533614","url":null,"abstract":"This project creates a visual-mental-physical circuit between a Generative Adversarial Network (GAN), a co-robotic arm, and a five-year-old child. From training images to the latent space of a GAN, through pen on paper to a live human collaborator, it establishes a series of translational stages between humans and non-humans played out through the medium of drawing. Trained on a subset of the Rhoda Kellogg Child Art Collection, the neural network at the center of this piece learns its own representations of these images. The generated results, synthetic children's drawings, are of interest both for being outside of adult conventions and learned expression-like Dubuffet's art brut or Surrealist automatism-and for how they align machine learning with the human act of learning to draw. The project layers many kinds of agency and embodiment: from the thousands of anonymous children who produced the original artwork used as training data, through the co-robot drawing from GAN-generated imagery, to the human child's active perception and graphic response to the robot. These questions of where we search for the other; when we attribute autonomy and intelligence; and why we might wish to escape our human subjectivities speak to core issues in the design and use of AI systems. This project is one attempt to think through those questions in an embodied way.","PeriodicalId":74536,"journal":{"name":"Proceedings of the ACM on computer graphics and interactive techniques","volume":"5 1","pages":"1 - 7"},"PeriodicalIF":0.0,"publicationDate":"2022-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46367492","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Field of Leaves 叶田

Proceedings of the ACM on computer graphics and interactive techniques Pub Date : 2022-09-06 DOI: 10.1145/3533683

Pedro Silva, Daniel Lopes, Pedro Martins, Penousal Machado

引用次数: 0

GROUPTHINK 群体思维

Proceedings of the ACM on computer graphics and interactive techniques Pub Date : 2022-09-06 DOI: 10.1145/3533610

Ali Hossaini, Oliver M. Gingrich, Shama Rahman, M. Grierson, Joshua Murr, A. Chamberlain, Alain Renaud

引用次数: 0

The Ghost in The Machine 机器中的幽灵

Proceedings of the ACM on computer graphics and interactive techniques Pub Date : 2022-09-06 DOI: 10.1145/3533609

S. Elran, Amit R. Zoran

引用次数: 2

Dream Painter 梦幻画家

Proceedings of the ACM on computer graphics and interactive techniques Pub Date : 2022-09-06 DOI: 10.1145/3533386

M. Sola, Varvara Guljajeva

引用次数: 3