ArXiv.org最新文献

筛选

英文中文

Composing Concepts from Images and Videos via Concept-prompt Binding 通过概念提示绑定从图像和视频组合概念

ArXiv.org Pub Date : 2025-12-10 DOI: 10.48550/arxiv.2512.09824

Xianghao Kong, Zeyu Zhang, Guo, Yuwei, Zhuoran Zhao, Songchun Zhang, A. Rao

{"title":"Composing Concepts from Images and Videos via Concept-prompt Binding","authors":"Xianghao Kong, Zeyu Zhang, Guo, Yuwei, Zhuoran Zhao, Songchun Zhang, A. Rao","doi":"10.48550/arxiv.2512.09824","DOIUrl":"https://doi.org/10.48550/arxiv.2512.09824","url":null,"abstract":"Visual concept composition, which aims to integrate different elements from images and videos into a single, coherent visual output, still falls short in accurately extracting complex concepts from visual inputs and flexibly combining concepts from both images and videos. We introduce Bind & Compose, a one-shot method that enables flexible visual concept composition by binding visual concepts with corresponding prompt tokens and composing the target prompt with bound tokens from various sources. It adopts a hierarchical binder structure for cross-attention conditioning in Diffusion Transformers to encode visual concepts into corresponding prompt tokens for accurate decomposition of complex visual concepts. To improve concept-token binding accuracy, we design a Diversify-and-Absorb Mechanism that uses an extra absorbent token to eliminate the impact of concept-irrelevant details when training with diversified prompts. To enhance the compatibility between image and video concepts, we present a Temporal Disentanglement Strategy that decouples the training process of video concepts into two stages with a dual-branch binder structure for temporal modeling. Evaluations demonstrate that our method achieves superior concept consistency, prompt fidelity, and motion quality over existing approaches, opening up new possibilities for visual creativity.","PeriodicalId":523780,"journal":{"name":"ArXiv.org","volume":"1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2025-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://arxiv.org/pdf/2512.09824","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147921811","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0