SMPL-GPTexture: Scalable, Training-Free SMPL Texture Synthesis With World Knowledge Transfer From GPT via Geometry-Aware Projection

Mingxiao Tu;Shuchang Ye;Hoijoon Jung;Andre Kyme;Jinman Kim
{"title":"SMPL-GPTexture: Scalable, Training-Free SMPL Texture Synthesis With World Knowledge Transfer From GPT via Geometry-Aware Projection","authors":"Mingxiao Tu;Shuchang Ye;Hoijoon Jung;Andre Kyme;Jinman Kim","doi":"10.1109/TAI.2026.3688439","DOIUrl":null,"url":null,"abstract":"Texturing 3-D human avatars from natural-language prompts remains challenging because generated UV texture maps must be both high-quality and semantically consistent with the prompt. Prior work typically retrains generative adversarial or diffusion models on curated datasets, which constrain generalization to clothing, stylistic, and cultural variations present in those datasets. To address these limitations, we present SMPL-GPTexture, a training-free pipeline that leverages the rich world knowledge of a pretrained GPT model to synthesize SMPL human textures. Given a tailored natural-language prompt, GPT-4o generates geometry-consistent front/back views; we fit SMPL to each view, and invert-rasterize colors into canonical UV space with a geometry-aware view-quality weight, and close remaining gaps with diffusion-based inpainting. On a 550-prompt benchmark, SMPL-GPTexture achieves +17.6% CLIP similarity and +22.4% BLIP improvement over state-of-the-art text-to-texture methods while reducing visible seam artifacts. It generalizes to diverse scenarios such as fantasy avatars, stylized body art, and specialized uniforms without domain-specific fine-tuning. This facilitates the generation of high-quality textures that surpass current text-to-texture pipelines for fashion prototyping, AR telepresence, and digital asset generation. We open-source a UV texture map dataset that covers 23 artistic styles, 49 professions, 19 ethnicities, and 67 clothing descriptors, and a set of easily adaptable prompt templates that can be repurposed to generate any desired texture, fostering research on prompt-driven avatar appearance.","PeriodicalId":73305,"journal":{"name":"IEEE transactions on artificial intelligence","volume":"7 10","pages":"5551-5562"},"PeriodicalIF":0.0000,"publicationDate":"2026-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11495526","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE transactions on artificial intelligence","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/11495526/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/4/28 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Texturing 3-D human avatars from natural-language prompts remains challenging because generated UV texture maps must be both high-quality and semantically consistent with the prompt. Prior work typically retrains generative adversarial or diffusion models on curated datasets, which constrain generalization to clothing, stylistic, and cultural variations present in those datasets. To address these limitations, we present SMPL-GPTexture, a training-free pipeline that leverages the rich world knowledge of a pretrained GPT model to synthesize SMPL human textures. Given a tailored natural-language prompt, GPT-4o generates geometry-consistent front/back views; we fit SMPL to each view, and invert-rasterize colors into canonical UV space with a geometry-aware view-quality weight, and close remaining gaps with diffusion-based inpainting. On a 550-prompt benchmark, SMPL-GPTexture achieves +17.6% CLIP similarity and +22.4% BLIP improvement over state-of-the-art text-to-texture methods while reducing visible seam artifacts. It generalizes to diverse scenarios such as fantasy avatars, stylized body art, and specialized uniforms without domain-specific fine-tuning. This facilitates the generation of high-quality textures that surpass current text-to-texture pipelines for fashion prototyping, AR telepresence, and digital asset generation. We open-source a UV texture map dataset that covers 23 artistic styles, 49 professions, 19 ethnicities, and 67 clothing descriptors, and a set of easily adaptable prompt templates that can be repurposed to generate any desired texture, fostering research on prompt-driven avatar appearance.
SMPL- gptexture:基于几何感知投影的GPT世界知识转移的可扩展、免训练的SMPL纹理合成
根据自然语言提示为3-D人物角色制作纹理仍然具有挑战性,因为生成的UV纹理图必须既高质量又与提示在语义上一致。先前的工作通常是在精心策划的数据集上重新训练生成对抗或扩散模型,这些模型将泛化限制在这些数据集中存在的服装、风格和文化差异上。为了解决这些限制,我们提出了SMPL- gptexture,这是一个无需训练的管道,它利用预训练的GPT模型的丰富世界知识来合成SMPL人体纹理。基于定制的自然语言提示,gpt - 40生成几何一致的前/后视图;我们将SMPL拟合到每个视图中,并使用几何感知的视图质量权重将颜色反栅格化到规范的UV空间中,并使用基于扩散的涂漆来关闭剩余的间隙。在550个提示的基准测试中,与最先进的文本到纹理方法相比,SMPL-GPTexture实现了+17.6%的CLIP相似性和+22.4%的BLIP改进,同时减少了可见的接缝伪影。它可以推广到不同的场景,如幻想的化身、风格化的身体艺术和专门的制服,而不需要特定领域的微调。这有助于生成高质量纹理,超越当前用于时尚原型,AR远程呈现和数字资产生成的文本到纹理管道。我们开源了一个UV纹理地图数据集,该数据集涵盖23种艺术风格,49种职业,19个种族和67个服装描述符,以及一组易于适应的提示模板,可以重新用于生成任何所需的纹理,促进对提示驱动的虚拟形象外观的研究。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
7.70
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书