TY - JOUR
T1 - DCTracker
T2 - Rethinking MOT in soccer events under dual views via cascade association
AU - Hu, Long
AU - Zhang, Junjie
AU - Lv, Weiyi
AU - Gong, Yongshun
AU - Wang, Jingya
AU - Zhang, Jian
AU - Zeng, Dan
N1 - Publisher Copyright:
© 2024 Elsevier B.V.
PY - 2024/11/25
Y1 - 2024/11/25
N2 - Multi-Object Tracking (MOT) holds significant potential for enhancing the analysis of sporting events. Traditional MOT models are primarily designed for pedestrian-centric scenarios with static cameras and linear motion patterns. However, the dynamic environment of sports presents unique challenges: (i) significant camera movements and dynamic focal length adjustments cause abrupt changes in player positions across frames; (ii) player trajectories are nonlinear and influenced by game dynamics, resulting in complex, rapid movements complicated by erratic camera motion; and (iii) issues like image blurring, occlusion, and similar player appearances challenge visual identification robustness. These factors create substantial obstacles for standard tracking algorithms. To address these challenges, we introduce DCTracker, a specialized MOT system for robust performance in soccer matches. Our approach enhances the conventional Kalman filter by integrating a bird's-eye view via homography and inter-frame registration for the broadcast view, termed the dual-view Kalman filter (DVKF). This method leverages context from both perspectives to enrich the estimation model with multi-state vectors for each object, mitigating the impact of camera motion and nonlinear trajectories. We also introduce the cascade selection module (CSM), which optimizes the strengths of each perspective by dynamically adjusting their influence using spatial topological relationships among players. The CSM creates an adaptive cost matrix that effectively manages visual issues from blurring and occlusion. The efficacy of our method is demonstrated through state-of-the-art performance on the SoccerNet-Tracking test set and the SportsMOT-soccer validation split, highlighting its robustness across diverse venues and challenging player trajectories.
AB - Multi-Object Tracking (MOT) holds significant potential for enhancing the analysis of sporting events. Traditional MOT models are primarily designed for pedestrian-centric scenarios with static cameras and linear motion patterns. However, the dynamic environment of sports presents unique challenges: (i) significant camera movements and dynamic focal length adjustments cause abrupt changes in player positions across frames; (ii) player trajectories are nonlinear and influenced by game dynamics, resulting in complex, rapid movements complicated by erratic camera motion; and (iii) issues like image blurring, occlusion, and similar player appearances challenge visual identification robustness. These factors create substantial obstacles for standard tracking algorithms. To address these challenges, we introduce DCTracker, a specialized MOT system for robust performance in soccer matches. Our approach enhances the conventional Kalman filter by integrating a bird's-eye view via homography and inter-frame registration for the broadcast view, termed the dual-view Kalman filter (DVKF). This method leverages context from both perspectives to enrich the estimation model with multi-state vectors for each object, mitigating the impact of camera motion and nonlinear trajectories. We also introduce the cascade selection module (CSM), which optimizes the strengths of each perspective by dynamically adjusting their influence using spatial topological relationships among players. The CSM creates an adaptive cost matrix that effectively manages visual issues from blurring and occlusion. The efficacy of our method is demonstrated through state-of-the-art performance on the SoccerNet-Tracking test set and the SportsMOT-soccer validation split, highlighting its robustness across diverse venues and challenging player trajectories.
KW - Cascade selection
KW - Dual-view Kalman filter
KW - Multi-object tracking
UR - http://www.scopus.com/inward/record.url?scp=85204490516&partnerID=8YFLogxK
U2 - 10.1016/j.knosys.2024.112528
DO - 10.1016/j.knosys.2024.112528
M3 - Article
AN - SCOPUS:85204490516
SN - 0950-7051
VL - 304
JO - Knowledge-Based Systems
JF - Knowledge-Based Systems
M1 - 112528
ER -