Skip to yearly menu bar Skip to main content

Workshop: Workshop on Distribution Shifts: New Frontiers with Foundation Models

HyperNetwork Approximating Future Parameters for Time Series Forecasting under Temporal Drifts

Jaehoon Lee · Chan Kim · Gyumin Lee · Haksoo Lim · Jeongwhan Choi · Kookjin Lee · Dongeun Lee · Sanghyun Hong · Noseong Park

Keywords: [ Temporal drifts ] [ HyperNetwork ] [ Time Series Forecasting ]


Models for time series forecasting require the ability to extrapolate from previous observations. Yet, extrapolation is challenging, especially when the data spanning several periods is under temporal drifts where each period has a different distribution. To address this problem, we propose HyperGPA, a hypernetwork that generates a target model's parameters that are expected to work well (i.e., be an optimal model) for each period. HyperGPA discovers an underlying hidden dynamics which causes temporal drifts over time, and generates the model parameters for a target period, aided by the structures of computational graphs. In comprehensive evaluations, we show that target models whose parameters are generated by HyperGPA are up to 64.1\% more accurate than baselines.

Chat is not available.