Home Artificial Intelligence Time Series Forecasting with TiDE Explore TiDE

Time Series Forecasting with TiDE Explore TiDE

0
Time Series Forecasting with TiDE
Explore TiDE

Explore the architecture of TiDE and apply it in a forecasting project using Python

Towards Data Science
Photo by Boris Smokrovic on Unsplash

In our exploration of the most recent advances in the sector of time series forecasting, we discovered N-HiTS, PatchTST, TimeGPT and in addition TSMixer.

While many efforts have been deployed to use the Transformer architecture for forecasting, it seems that it achieves a mediocre performance considering the computation requirements.

Actually, easy linear models have been shown to outperform the complex Transformer-based models on many benchmark datasets (see Zheng et al., 2022).

Motivated by that, in April 2023, researchers at Google proposed TiDE: a long-term forecasting model with an encoder-decoder architecture built with Multilayer Perceptrons (MLPs).

Of their paper Long-term Forecasting with TiDE: Time-series Dense Encoder, the authors show that the model achieves state-of-the-art results on quite a few datasets compared to other Transformer-based and MLP-based models, like PatchTST and N-HiTS respectively.

In this text, we first explore the architecture and inner workings of TiDE. Then, we apply the model in Python and use it in our own small forecasting experiment.

For more details on TiDE, be certain to read the unique paper.

Learn the most recent time series evaluation techniques with my free time series cheat sheet in Python! Get the implementation of statistical and deep learning techniques, all in Python and TensorFlow!

Let’s start!

TiDE stands for Time-series Dense Encoder. At its base, this model implements the encoder-decoder concept without the eye mechanism in Transformer-based models.

As a substitute, it relies on MLPs to realize faster training and inference times, while achieving good performance.

During training, the model will encode historical data together with covariates. Then, it can decode the learned representation together with known future covariates…

LEAVE A REPLY

Please enter your comment!
Please enter your name here