{"title":"Facial Capture and Animation in Visual Effects","authors":"D. Cosker, P. Eisert, V. Helzle","doi":"10.1201/b18154-26","DOIUrl":"https://doi.org/10.1201/b18154-26","url":null,"abstract":"In recent years, there has been increasing interest in facial animation re- search from both academia and the entertainment industry. Visual effects and video game companies both want to deliver new audience experiences – whether that is a hyper-realistic human character [Duncan 09] or a fantasy creature driven by a human performer [Duncan 10]. Having more efficient ways of delivering high quality animation, as well as increasing the visual realism of performances, has motivated a surge of innovative academic and industrial developments. Central to many of these developments are key technical advances in computer vision and graphics. Of particular note are advances in multi- view stereo reconstruction, facial tracking and motion capture, dense non- rigid registration of meshes, measurement of skin rendering attributes (e.g. BRDFs for skin and skin subsurface scattering models) and sensing tech- nology. This chapter builds on concepts already described earlier in this book – such as 3D capture, rigging, and non-rigid registration – and takes a more practical look at how they might typically be applied in visual effects. First, methods and applications for facial static capture and rendering are considered, before dynamic capture is addressed. Finally, a case study is examined called The Gathering involving the creation of an animated face – from animation to final composite.","PeriodicalId":141890,"journal":{"name":"Digital Representations of the Real World","volume":"40 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-05-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129646189","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Web-Based Delivery of 3D Mesh Data","authors":"Max Limper, J. Behr, D. Fellner","doi":"10.1201/b18154-28","DOIUrl":"https://doi.org/10.1201/b18154-28","url":null,"abstract":"","PeriodicalId":141890,"journal":{"name":"Digital Representations of the Real World","volume":"36 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121037206","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Statistical Human Body Modeling","authors":"S. Wuhrer, L. German, B. Rosenhahn","doi":"10.1201/b18154-18","DOIUrl":"https://doi.org/10.1201/b18154-18","url":null,"abstract":"","PeriodicalId":141890,"journal":{"name":"Digital Representations of the Real World","volume":"49 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116729905","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Stereo and Multi-View Video","authors":"L. Lucas, C. Loscos, P. Bekaert, A. Hilton","doi":"10.1201/b18154-4","DOIUrl":"https://doi.org/10.1201/b18154-4","url":null,"abstract":"","PeriodicalId":141890,"journal":{"name":"Digital Representations of the Real World","volume":"48 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114883623","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Sensor Fusion","authors":"Andreas Kolb, Jiejie Zhu, Ruigang Yang","doi":"10.1201/b18154-12","DOIUrl":"https://doi.org/10.1201/b18154-12","url":null,"abstract":"Bayesian nonparametric","PeriodicalId":141890,"journal":{"name":"Digital Representations of the Real World","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122419854","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Range Imaging","authors":"A. Kolb, Fabrizio Pece","doi":"10.1201/b18154-6","DOIUrl":"https://doi.org/10.1201/b18154-6","url":null,"abstract":"","PeriodicalId":141890,"journal":{"name":"Digital Representations of the Real World","volume":"48 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127718107","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Bastian Goldlücke, Oliver Klehm, S. Wanner, E. Eisemann
{"title":"Plenoptic Cameras","authors":"Bastian Goldlücke, Oliver Klehm, S. Wanner, E. Eisemann","doi":"10.1201/b18154-7","DOIUrl":"https://doi.org/10.1201/b18154-7","url":null,"abstract":"The light field, as defined by Gershun in 1936 [Gershun 36] describes the radiance traveling in every direction through every point in space. Mathematically, it can be described by a 5D function which is called the plenoptic function, in more generality sometimes given with the two additional dimensions time and wavelength. Outside a scene, in the absence of occluders, however, light intensity does not change while traveling along a ray. Thus, the light field of a scene can be parameterized over a surrounding surface; light intensity is attributed to every ray passing through the surface into any direction. This yields the common definition of the light field as a 4D function. In contrast, a single pinhole view of the scene only captures the rays passing through the center of projection, corresponding to a single 2D cut through the light field. Fortunately, camera sensors have made tremendous progress and nowadays offer extremely high resolutions. For many visual-computing applications, however, spatial resolution is already more than sufficient, while robustness of the results is what really matters. Computational photography explores methods to use the extra resolution in different ways. In particular, it is possible to capture several views of a scene from slightly different directions on a single sensor and thus offer single-shot 4D light field capture. Technically, this capture can be realized by a so-called plenoptic camera, which uses an array of microlenses mounted in front of the sensor [Ng 06]. This type of camera offers interesting opportunities for the design of visual computing algorithms, and it has been predicted that it will play an important role in the consumer market of the future [Levoy 06]. The dense sampling of the light field with view points lying closely together may also offer new insights and opportunities to perform 3D reconstruction. Light fields have thus attracted quite a lot of interest in the computer vision community. In particular, there are indications that small changes in view point, are important for visual understanding. For example, it has been shown that even minuscule changes at occlusion boundaries from view point shifts give a powerful perceptional cue for depth [Rucci 08].","PeriodicalId":141890,"journal":{"name":"Digital Representations of the Real World","volume":"76 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127417071","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Virtual Production","authors":"V. Helzle, O. Grau, Thomas Knop","doi":"10.1201/b18154-29","DOIUrl":"https://doi.org/10.1201/b18154-29","url":null,"abstract":"","PeriodicalId":141890,"journal":{"name":"Digital Representations of the Real World","volume":"44 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133218557","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Cloth Modeling","authors":"A. Hilsmann, Michael Stengel, Lorenz Rogge","doi":"10.1201/b18154-19","DOIUrl":"https://doi.org/10.1201/b18154-19","url":null,"abstract":"","PeriodicalId":141890,"journal":{"name":"Digital Representations of the Real World","volume":"9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131974737","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Dynamic Geometry Reconstruction","authors":"Edmond Boyer, A. Hilton, C. Loscos","doi":"10.1201/b18154-15","DOIUrl":"https://doi.org/10.1201/b18154-15","url":null,"abstract":"","PeriodicalId":141890,"journal":{"name":"Digital Representations of the Real World","volume":"34 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126366841","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}