DCTracker: Rethinking MOT in soccer events under dual views via cascade association

IF 7.2 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
{"title":"DCTracker: Rethinking MOT in soccer events under dual views via cascade association","authors":"","doi":"10.1016/j.knosys.2024.112528","DOIUrl":null,"url":null,"abstract":"<div><p>Multi-Object Tracking (MOT) holds significant potential for enhancing the analysis of sporting events. Traditional MOT models are primarily designed for pedestrian-centric scenarios with static cameras and linear motion patterns. However, the dynamic environment of sports presents unique challenges: (i) significant camera movements and dynamic focal length adjustments cause abrupt changes in player positions across frames; (ii) player trajectories are nonlinear and influenced by game dynamics, resulting in complex, rapid movements complicated by erratic camera motion; and (iii) issues like image blurring, occlusion, and similar player appearances challenge visual identification robustness. These factors create substantial obstacles for standard tracking algorithms. To address these challenges, we introduce DCTracker, a specialized MOT system for robust performance in soccer matches. Our approach enhances the conventional Kalman filter by integrating a bird’s-eye view via homography and inter-frame registration for the broadcast view, termed the dual-view Kalman filter (DVKF). This method leverages context from both perspectives to enrich the estimation model with multi-state vectors for each object, mitigating the impact of camera motion and nonlinear trajectories. We also introduce the cascade selection module (CSM), which optimizes the strengths of each perspective by dynamically adjusting their influence using spatial topological relationships among players. The CSM creates an adaptive cost matrix that effectively manages visual issues from blurring and occlusion. The efficacy of our method is demonstrated through state-of-the-art performance on the SoccerNet-Tracking test set and the SportsMOT-soccer validation split, highlighting its robustness across diverse venues and challenging player trajectories.</p></div>","PeriodicalId":49939,"journal":{"name":"Knowledge-Based Systems","volume":null,"pages":null},"PeriodicalIF":7.2000,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Knowledge-Based Systems","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0950705124011626","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Multi-Object Tracking (MOT) holds significant potential for enhancing the analysis of sporting events. Traditional MOT models are primarily designed for pedestrian-centric scenarios with static cameras and linear motion patterns. However, the dynamic environment of sports presents unique challenges: (i) significant camera movements and dynamic focal length adjustments cause abrupt changes in player positions across frames; (ii) player trajectories are nonlinear and influenced by game dynamics, resulting in complex, rapid movements complicated by erratic camera motion; and (iii) issues like image blurring, occlusion, and similar player appearances challenge visual identification robustness. These factors create substantial obstacles for standard tracking algorithms. To address these challenges, we introduce DCTracker, a specialized MOT system for robust performance in soccer matches. Our approach enhances the conventional Kalman filter by integrating a bird’s-eye view via homography and inter-frame registration for the broadcast view, termed the dual-view Kalman filter (DVKF). This method leverages context from both perspectives to enrich the estimation model with multi-state vectors for each object, mitigating the impact of camera motion and nonlinear trajectories. We also introduce the cascade selection module (CSM), which optimizes the strengths of each perspective by dynamically adjusting their influence using spatial topological relationships among players. The CSM creates an adaptive cost matrix that effectively manages visual issues from blurring and occlusion. The efficacy of our method is demonstrated through state-of-the-art performance on the SoccerNet-Tracking test set and the SportsMOT-soccer validation split, highlighting its robustness across diverse venues and challenging player trajectories.

DCTracker:通过级联重新思考双重视角下足球赛事中的 MOT
多目标跟踪(MOT)在增强体育赛事分析方面具有巨大潜力。传统的多目标跟踪模型主要是针对以行人为中心的场景设计的,具有静态摄像机和线性运动模式。然而,体育运动的动态环境带来了独特的挑战:(i) 摄像机的大幅移动和动态焦距调整会导致球员位置在帧间发生突然变化;(ii) 球员的运动轨迹是非线性的,并受到比赛动态的影响,导致复杂、快速的运动因摄像机的不稳定运动而变得复杂;(iii) 图像模糊、遮挡和相似的球员外观等问题对视觉识别的鲁棒性提出了挑战。这些因素给标准跟踪算法带来了巨大障碍。为了应对这些挑战,我们推出了 DCTracker,这是一种专门的 MOT 系统,可在足球比赛中实现稳定的性能。我们的方法增强了传统的卡尔曼滤波器,通过同构和帧间注册将鸟瞰视图整合到转播视图中,称为双视角卡尔曼滤波器(DVKF)。这种方法利用了两个视角的上下文,为每个物体丰富了多状态向量的估计模型,减轻了摄像机运动和非线性轨迹的影响。我们还引入了级联选择模块 (CSM),该模块利用参与者之间的空间拓扑关系动态调整每个视角的影响,从而优化每个视角的优势。CSM 创建了一个自适应成本矩阵,可有效处理模糊和遮挡造成的视觉问题。我们的方法通过在 SoccerNet-Tracking 测试集和 SportsMOT-soccer 验证集上的一流表现证明了其功效,突出了它在不同场地和具有挑战性的球员轨迹中的鲁棒性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Knowledge-Based Systems
Knowledge-Based Systems 工程技术-计算机:人工智能
CiteScore
14.80
自引率
12.50%
发文量
1245
审稿时长
7.8 months
期刊介绍: Knowledge-Based Systems, an international and interdisciplinary journal in artificial intelligence, publishes original, innovative, and creative research results in the field. It focuses on knowledge-based and other artificial intelligence techniques-based systems. The journal aims to support human prediction and decision-making through data science and computation techniques, provide a balanced coverage of theory and practical study, and encourage the development and implementation of knowledge-based intelligence models, methods, systems, and software tools. Applications in business, government, education, engineering, and healthcare are emphasized.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信