Shashank Tripathi, Omid Taheri, Christoph Lassner, Michael J. Black, Daniel Holden, Carsten Stoll
{"title":"HUMOS: 以体形为条件的人体运动模型","authors":"Shashank Tripathi, Omid Taheri, Christoph Lassner, Michael J. Black, Daniel Holden, Carsten Stoll","doi":"arxiv-2409.03944","DOIUrl":null,"url":null,"abstract":"Generating realistic human motion is essential for many computer vision and\ngraphics applications. The wide variety of human body shapes and sizes greatly\nimpacts how people move. However, most existing motion models ignore these\ndifferences, relying on a standardized, average body. This leads to uniform\nmotion across different body types, where movements don't match their physical\ncharacteristics, limiting diversity. To solve this, we introduce a new approach\nto develop a generative motion model based on body shape. We show that it's\npossible to train this model using unpaired data by applying cycle consistency,\nintuitive physics, and stability constraints, which capture the relationship\nbetween identity and movement. The resulting model generates diverse,\nphysically plausible, and dynamically stable human motions that are both\nquantitatively and qualitatively more realistic than current state-of-the-art\nmethods. More details are available on our project page\nhttps://CarstenEpic.github.io/humos/.","PeriodicalId":501479,"journal":{"name":"arXiv - CS - Artificial Intelligence","volume":"496 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"HUMOS: Human Motion Model Conditioned on Body Shape\",\"authors\":\"Shashank Tripathi, Omid Taheri, Christoph Lassner, Michael J. Black, Daniel Holden, Carsten Stoll\",\"doi\":\"arxiv-2409.03944\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Generating realistic human motion is essential for many computer vision and\\ngraphics applications. The wide variety of human body shapes and sizes greatly\\nimpacts how people move. However, most existing motion models ignore these\\ndifferences, relying on a standardized, average body. This leads to uniform\\nmotion across different body types, where movements don't match their physical\\ncharacteristics, limiting diversity. To solve this, we introduce a new approach\\nto develop a generative motion model based on body shape. We show that it's\\npossible to train this model using unpaired data by applying cycle consistency,\\nintuitive physics, and stability constraints, which capture the relationship\\nbetween identity and movement. The resulting model generates diverse,\\nphysically plausible, and dynamically stable human motions that are both\\nquantitatively and qualitatively more realistic than current state-of-the-art\\nmethods. More details are available on our project page\\nhttps://CarstenEpic.github.io/humos/.\",\"PeriodicalId\":501479,\"journal\":{\"name\":\"arXiv - CS - Artificial Intelligence\",\"volume\":\"496 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-09-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - CS - Artificial Intelligence\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2409.03944\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Artificial Intelligence","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.03944","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
HUMOS: Human Motion Model Conditioned on Body Shape
Generating realistic human motion is essential for many computer vision and
graphics applications. The wide variety of human body shapes and sizes greatly
impacts how people move. However, most existing motion models ignore these
differences, relying on a standardized, average body. This leads to uniform
motion across different body types, where movements don't match their physical
characteristics, limiting diversity. To solve this, we introduce a new approach
to develop a generative motion model based on body shape. We show that it's
possible to train this model using unpaired data by applying cycle consistency,
intuitive physics, and stability constraints, which capture the relationship
between identity and movement. The resulting model generates diverse,
physically plausible, and dynamically stable human motions that are both
quantitatively and qualitatively more realistic than current state-of-the-art
methods. More details are available on our project page
https://CarstenEpic.github.io/humos/.