IEEE Transactions on Pattern Analysis and Machine Intelligence最新文献

Distilling the Unknown to Unveil Certainty 从未知中提炼出确定性

IF 23.6 1区计算机科学

IEEE Transactions on Pattern Analysis and Machine Intelligence Pub Date : 2025-06-30 DOI: 10.1109/tpami.2025.3584386

Zhilin Zhao, Longbing Cao, Yixuan Zhang, Kun-Yu Lin, Wei-Shi Zheng

引用次数: 0

Reinforcement Learning With LLMs Interaction For Distributed Diffusion Model Services 基于llm交互的分布式扩散模型服务强化学习

IF 23.6 1区计算机科学

IEEE Transactions on Pattern Analysis and Machine Intelligence Pub Date : 2025-06-30 DOI: 10.1109/tpami.2025.3584698

Hongyang Du, Ruichen Zhang, Dusit Niyato, Jiawen Kang, Zehui Xiong, Shuguang Cui, Xuemin Shen, Dong In Kim

引用次数: 0

Self-Supervised Learning of LiDAR 3D Point Clouds Via 2D-3D Neural Calibration 基于2D-3D神经校准的LiDAR 3D点云自监督学习

IF 23.6 1区计算机科学

IEEE Transactions on Pattern Analysis and Machine Intelligence Pub Date : 2025-06-30 DOI: 10.1109/tpami.2025.3584625

Yifan Zhang, Junhui Hou, Siyu Ren, Jinjian Wu, Yixuan Yuan, Guangming Shi

引用次数: 0

Reliable Few-shot Learning under Dual Noises 双噪声下可靠的少次学习

IF 23.6 1区计算机科学

IEEE Transactions on Pattern Analysis and Machine Intelligence Pub Date : 2025-06-30 DOI: 10.1109/tpami.2025.3584051

Ji Zhang, Jingkuan Song, Lianli Gao, Nicu Sebe, Heng Tao Shen

引用次数: 0

From Concrete to Abstract: Multi-view Clustering on Relational Knowledge 从具体到抽象：关系知识的多视图聚类

IF 23.6 1区计算机科学

IEEE Transactions on Pattern Analysis and Machine Intelligence Pub Date : 2025-06-27 DOI: 10.1109/tpami.2025.3582689

Ke Liang, Lingyuan Meng, Hao Li, Jun Wang, Long Lan, Miaomiao Li, Xinwang Liu, Huaimin Wang

引用次数: 0

NICE: Improving Panoptic Narrative Detection and Segmentation With Cascading Collaborative Learning NICE：用级联协作学习改进全景叙事检测和分割

IF 23.6 1区计算机科学

IEEE Transactions on Pattern Analysis and Machine Intelligence Pub Date : 2025-06-27 DOI: 10.1109/tpami.2025.3583795

Haowei Wang, Jiayi Ji, Tianyu Guo, Yilong Yang, Xiaoshuai Sun, Rongrong Ji

引用次数: 0

Systematic Investigation of Sparse Perturbed Sharpness-Aware Minimization Optimizer 稀疏摄动锐度感知最小化优化器的系统研究

IF 23.6 1区计算机科学

IEEE Transactions on Pattern Analysis and Machine Intelligence Pub Date : 2025-06-27 DOI: 10.1109/tpami.2025.3581310

Peng Mi, Li Shen, Tianhe Ren, Yiyi Zhou, Tianshuo Xu, Xiaoshuai Sun, Tongliang Liu, Rongrong Ji, Dacheng Tao

引用次数: 0

V3D: Video Diffusion Models are Effective 3D Generators V3D：视频扩散模型是有效的3D生成器

IF 23.6 1区计算机科学

IEEE Transactions on Pattern Analysis and Machine Intelligence Pub Date : 2025-06-27 DOI: 10.1109/tpami.2025.3581312

Zilong Chen, Yikai Wang, Feng Wang, Zhengyi Wang, Fuchun Sun, Huaping Liu

引用次数: 0

Revisiting Essential and Nonessential Settings of Evidential Deep Learning 重新审视证据深度学习的必要和非必要设置

IF 23.6 1区计算机科学

IEEE Transactions on Pattern Analysis and Machine Intelligence Pub Date : 2025-06-26 DOI: 10.1109/tpami.2025.3583410

Mengyuan Chen, Junyu Gao, Changsheng Xu

引用次数: 0

CAT+: Investigating and Enhancing Audio-visual Understanding in Large Language Models. CAT+：研究和增强大型语言模型中的视听理解。

IF 23.6 1区计算机科学

IEEE Transactions on Pattern Analysis and Machine Intelligence Pub Date : 2025-06-25 DOI: 10.1109/tpami.2025.3582389

Qilang Ye,Zitong Yu,Rui Shao,Yawen Cui,Xiangui Kang,Xin Liu,Philip Torr,Xiaochun Cao

{"title":"CAT+: Investigating and Enhancing Audio-visual Understanding in Large Language Models.","authors":"Qilang Ye,Zitong Yu,Rui Shao,Yawen Cui,Xiangui Kang,Xin Liu,Philip Torr,Xiaochun Cao","doi":"10.1109/tpami.2025.3582389","DOIUrl":"https://doi.org/10.1109/tpami.2025.3582389","url":null,"abstract":"Multimodal Large Language Models (MLLMs) have gained significant attention due to their rich internal implicit knowledge for cross-modal learning. Although advances in bringing audio-visuals into LLMs have resulted in boosts for a variety of Audio-Visual Question Answering (AVQA) tasks, they still face two crucial challenges: 1) audio-visual ambiguity, and 2) audio-visual hallucination. Existing MLLMs can respond to audio-visual content, yet sometimes fail to describe specific objects due to the ambiguity or hallucination of responses. To overcome the two aforementioned issues, we introduce the CAT+, which enhances MLLM to ensure more robust multimodal understanding. We first propose the Sequential Question-guided Module (SQM), which combines tiny transformer layers and cascades Q-Formers to realize a solid audio-visual grounding. After feature alignment and high-quality instruction tuning, we introduce Ambiguity Scoring Direct Preference Optimization (AS-DPO) to correct the problem of CAT+ bias toward ambiguous descriptions. To explore the hallucinatory deficits of MLLMs in dynamic audio-visual scenes, we build a new Audio-visual Hallucination Benchmark, named AVHbench. This benchmark detects the extent of MLLM's hallucinations across three different protocols in the perceptual object, counting, and holistic description tasks. Extensive experiments across video-based understanding, open-ended, and close-ended AVQA demonstrate the superior performance of our method.","PeriodicalId":13426,"journal":{"name":"IEEE Transactions on Pattern Analysis and Machine Intelligence","volume":"26 1","pages":""},"PeriodicalIF":23.6,"publicationDate":"2025-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144488043","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0