Timezone: »

Deep Explicit Duration Switching Models for Time Series
Abdul Fatir Ansari · Konstantinos Benidis · Richard Kurle · Ali Caner Turkmen · Harold Soh · Alexander J Smola · Bernie Wang · Tim Januschowski

Thu Dec 09 08:30 AM -- 10:00 AM (PST) @ None #None

Many complex time series can be effectively subdivided into distinct regimes that exhibit persistent dynamics. Discovering the switching behavior and the statistical patterns in these regimes is important for understanding the underlying dynamical system. We propose the Recurrent Explicit Duration Switching Dynamical System (RED-SDS), a flexible model that is capable of identifying both state- and time-dependent switching dynamics. State-dependent switching is enabled by a recurrent state-to-switch connection and an explicit duration count variable is used to improve the time-dependent switching behavior. We demonstrate how to perform efficient inference using a hybrid algorithm that approximates the posterior of the continuous states via an inference network and performs exact inference for the discrete switches and counts. The model is trained by maximizing a Monte Carlo lower bound of the marginal log-likelihood that can be computed efficiently as a byproduct of the inference routine. Empirical results on multiple datasets demonstrate that RED-SDS achieves considerable improvement in time series segmentation and competitive forecasting performance against the state of the art.

Author Information

Abdul Fatir Ansari (National University of Singapore)
Konstantinos Benidis (Amazon Research)
Richard Kurle (AWS AI Labs)
Caner Turkmen (Bogazici University)
Harold Soh (National University of Singapore (NUS))
Alexander J Smola (NICTA)
Bernie Wang (AWS AI Labs)
Tim Januschowski (Amazon Research)

More from the Same Authors