Timezone: »
In this paper, we study the challenging problem of tracking the trajectory of a moving object in a video with possibly very complex background. In contrast to most existing trackers which only learn the appearance of the tracked object online, we take a different approach, inspired by recent advances in deep learning architectures, by putting more emphasis on the (unsupervised) feature learning problem. Specifically, by using auxiliary natural images, we train a stacked denoising autoencoder offline to learn generic image features that are more robust against variations. This is then followed by knowledge transfer from offline training to the online tracking process. Online tracking involves a classification neural network which is constructed from the encoder part of the trained autoencoder as a feature extractor and an additional classification layer. Both the feature extractor and the classifier can be further tuned to adapt to appearance changes of the moving object. Comparison with the state-of-the-art trackers on some challenging benchmark video sequences shows that our deep learning tracker is very efficient as well as more accurate.
Author Information
Naiyan Wang (Hong Kong University of Science and Technology)
Dit-Yan Yeung (Hong Kong University of Science and Technology)
More from the Same Authors
-
2022 Poster: Fully Sparse 3D Object Detection »
Lue Fan · Feng Wang · Naiyan Wang · ZHAO-XIANG ZHANG -
2023 Poster: Adaptive Online Replanning with Diffusion Models »
Siyuan Zhou · Yilun Du · Shun Zhang · Mengdi Xu · Yikang Shen · Wei Xiao · Dit-Yan Yeung · Chuang Gan -
2023 Poster: Echoes Beyond Points: Unleashing the Power of Raw Radar Data in Multi-modality Fusion »
Yang Liu · Feng Wang · Naiyan Wang · ZHAO-XIANG ZHANG -
2023 Poster: PreDiff: Precipitation Nowcasting with Latent Diffusion Models »
Zhihan Gao · Xingjian Shi · Boran Han · Hao Wang · Xiaoyong Jin · Danielle Maddix · Yi Zhu · Yuyang (Bernie) Wang · Mu Li · Dit-Yan Yeung -
2022 Spotlight: Improving 3D-aware Image Synthesis with A Geometry-aware Discriminator »
Zifan Shi · Yinghao Xu · Yujun Shen · Deli Zhao · Qifeng Chen · Dit-Yan Yeung -
2022 Spotlight: Lightning Talks 5B-1 »
Devansh Arpit · Xiaojun Xu · Zifan Shi · Ivan Skorokhodov · Shayan Shekarforoush · Zhan Tong · Yiqun Wang · Shichong Peng · Linyi Li · Ivan Skorokhodov · Huan Wang · Yibing Song · David Lindell · Yinghao Xu · Seyed Alireza Moazenipourasil · Sergey Tulyakov · Peter Wonka · Yiqun Wang · Ke Li · David Fleet · Yujun Shen · Yingbo Zhou · Bo Li · Jue Wang · Peter Wonka · Marcus Brubaker · Caiming Xiong · Limin Wang · Deli Zhao · Qifeng Chen · Dit-Yan Yeung -
2022 Spotlight: Lightning Talks 4A-3 »
Zhihan Gao · Yabin Wang · Xingyu Qu · Luziwei Leng · Mingqing Xiao · Bohan Wang · Yu Shen · Zhiwu Huang · Xingjian Shi · Qi Meng · Yupeng Lu · Diyang Li · Qingyan Meng · Kaiwei Che · Yang Li · Hao Wang · Huishuai Zhang · Zongpeng Zhang · Kaixuan Zhang · Xiaopeng Hong · Xiaohan Zhao · Di He · Jianguo Zhang · Yaofeng Tu · Bin Gu · Yi Zhu · Ruoyu Sun · Yuyang (Bernie) Wang · Zhouchen Lin · Qinghu Meng · Wei Chen · Wentao Zhang · Bin CUI · Jie Cheng · Zhi-Ming Ma · Mu Li · Qinghai Guo · Dit-Yan Yeung · Tie-Yan Liu · Jianxing Liao -
2022 Spotlight: Earthformer: Exploring Space-Time Transformers for Earth System Forecasting »
Zhihan Gao · Xingjian Shi · Hao Wang · Yi Zhu · Yuyang (Bernie) Wang · Mu Li · Dit-Yan Yeung -
2022 Poster: Improving 3D-aware Image Synthesis with A Geometry-aware Discriminator »
Zifan Shi · Yinghao Xu · Yujun Shen · Deli Zhao · Qifeng Chen · Dit-Yan Yeung -
2022 Poster: Earthformer: Exploring Space-Time Transformers for Earth System Forecasting »
Zhihan Gao · Xingjian Shi · Hao Wang · Yi Zhu · Yuyang (Bernie) Wang · Mu Li · Dit-Yan Yeung -
2019 Poster: Unsupervised Scale-consistent Depth and Ego-motion Learning from Monocular Video »
Jiawang Bian · Zhichao Li · Naiyan Wang · Huangying Zhan · Chunhua Shen · Ming-Ming Cheng · Ian Reid -
2017 Poster: Deep Learning for Precipitation Nowcasting: A Benchmark and A New Model »
Xingjian Shi · Zhihan Gao · Leonard Lausen · Hao Wang · Dit-Yan Yeung · Wai-kin Wong · Wang-chun WOO -
2017 Spotlight: Deep Learning for Precipitation Nowcasting: A Benchmark and A New Model »
Xingjian Shi · Zhihan Gao · Leonard Lausen · Hao Wang · Dit-Yan Yeung · Wai-kin Wong · Wang-chun WOO -
2016 Poster: Natural-Parameter Networks: A Class of Probabilistic Neural Networks »
Hao Wang · Xingjian SHI · Dit-Yan Yeung -
2016 Poster: Collaborative Recurrent Autoencoder: Recommend while Learning to Fill in the Blanks »
Hao Wang · Xingjian SHI · Dit-Yan Yeung -
2015 Poster: Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting »
Xingjian Shi · Zhourong Chen · Hao Wang · Dit-Yan Yeung · Wai-kin Wong · Wang-chun WOO -
2012 Poster: Co-Regularized Hashing for Multimodal Data »
Yi Zhen · Dit-Yan Yeung -
2010 Poster: Worst-Case Linear Discriminant Analysis »
Yu Zhang · Dit-Yan Yeung -
2010 Poster: Probabilistic Multi-Task Feature Selection »
Yu Zhang · Dit-Yan Yeung · Qian Xu -
2009 Poster: Probabilistic Relational PCA »
Wu-Jun Li · Dit-Yan Yeung · Zhihua Zhang -
2009 Spotlight: Probabilistic Relational PCA »
Wu-Jun Li · Dit-Yan Yeung · Zhihua Zhang -
2008 Poster: Posterior Consistency of the Silverman g-prior in Bayesian Model Choice »
Zhihua Zhang · Michael Jordan · Dit-Yan Yeung -
2008 Spotlight: Posterior Consistency of the Silverman g-prior in Bayesian Model Choice »
Zhihua Zhang · Michael Jordan · Dit-Yan Yeung