arxiv preprint – Tracking Everything Everywhere All at Once

In this episode we discuss Tracking Everything Everywhere All at Once
by Qianqian Wang, Yen-Yu Chang, Ruojin Cai, Zhengqi Li, Bharath Hariharan, Aleksander Holynski, Noah Snavely. The paper introduces a new method called OmniMotion for estimating dense and long-range motion from a video sequence. Traditional approaches like sparse feature tracking and dense optical flow are insufficient in capturing the complete motion. OmniMotion uses a quasi-3D canonical volume and bijections between local and canonical space to accurately estimate motion for every pixel in a video. The method outperforms previous state-of-the-art techniques in terms of accuracy and consistency, as demonstrated through evaluations on benchmark datasets and real-world footage.