Timezone: »
With the goal of making high-resolution forecasts of regional rainfall, precipitation nowcasting has become an important and fundamental technology underlying various public services ranging from rainfall alerts to flight safety. Recently, the convolutional LSTM (ConvLSTM) model has been shown to outperform traditional optical flow based methods for precipitation nowcasting, suggesting that deep learning models have a huge potential for solving the problem. However, the convolutional recurrence structure in ConvLSTM-based models is location-invariant while natural motion and transformation (e.g., rotation) are location-variant in general. Furthermore, since deep-learning-based precipitation nowcasting is a newly emerging area, clear evaluation protocols have not yet been established. To address these problems, we propose both a new model and a benchmark for precipitation nowcasting. Specifically, we go beyond ConvLSTM and propose the Trajectory GRU (TrajGRU) model that can actively learn the location-variant structure for recurrent connections. Besides, we provide a benchmark that includes a real-world large-scale dataset from the Hong Kong Observatory, a new training loss, and a comprehensive evaluation protocol to facilitate future research and gauge the state of the art.
Author Information
Xingjian Shi (HKUST)
Zhihan Gao (HKUST)
Leonard Lausen (HKUST)
Hao Wang (HKUST)
Dit-Yan Yeung (HKUST, Hong Kong)
Wai-kin Wong (HKO)
Wang-chun WOO (HKO)
Related Events (a corresponding poster, oral, or spotlight)
-
2017 Poster: Deep Learning for Precipitation Nowcasting: A Benchmark and A New Model »
Wed Dec 6th 02:30 -- 06:30 AM Room Pacific Ballroom #110
More from the Same Authors
-
2016 Poster: Natural-Parameter Networks: A Class of Probabilistic Neural Networks »
Hao Wang · Xingjian SHI · Dit-Yan Yeung -
2016 Poster: Collaborative Recurrent Autoencoder: Recommend while Learning to Fill in the Blanks »
Hao Wang · Xingjian SHI · Dit-Yan Yeung -
2015 Poster: Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting »
Xingjian Shi · Zhourong Chen · Hao Wang · Dit-Yan Yeung · Wai-kin Wong · Wang-chun WOO -
2013 Poster: Learning a Deep Compact Image Representation for Visual Tracking »
Naiyan Wang · Dit-Yan Yeung -
2012 Poster: Co-Regularized Hashing for Multimodal Data »
Yi Zhen · Dit-Yan Yeung -
2010 Poster: Worst-Case Linear Discriminant Analysis »
Yu Zhang · Dit-Yan Yeung -
2010 Poster: Probabilistic Multi-Task Feature Selection »
Yu Zhang · Dit-Yan Yeung · Qian Xu -
2009 Poster: Probabilistic Relational PCA »
Wu-Jun Li · Dit-Yan Yeung · Zhihua Zhang -
2009 Spotlight: Probabilistic Relational PCA »
Wu-Jun Li · Dit-Yan Yeung · Zhihua Zhang -
2008 Poster: Posterior Consistency of the Silverman g-prior in Bayesian Model Choice »
Zhihua Zhang · Michael Jordan · Dit-Yan Yeung -
2008 Spotlight: Posterior Consistency of the Silverman g-prior in Bayesian Model Choice »
Zhihua Zhang · Michael Jordan · Dit-Yan Yeung