TimeMixer: Decomposable Multiscale Mixing for Time Series Forecasting
By Shiyu Wang, Haixu Wu, Xiaoming Shi, Tengge Hu, Huakun Luo, Lintao Ma, James Y. Zhang, Jun Zhou. International Conference on Learning Representations, 2024
722 citations recorded by the source corpus.
Time series forecasting is widely used in extensive applications, such as traffic planning and weather forecasting. However, real-world time series usually present intricate temporal variations, making forecasting extremely challenging. Going beyond the mainstream paradigms of plain decomposition and multiperiodicity analysis, we analyze temporal variations in a novel view of multiscale-mixing, which is based on an intuitive but important observation that time series present distinct patterns in different sampling scales. The microscopic and the macroscopic information are reflected in fine and coarse scales respectively, and thereby complex variations can be inherently disentangled. Based on this observation, we propose TimeMixer as a fully MLP-based architecture with Past-Decomposable-Mixing (PDM) and Future-Multipredictor-Mixing (FMM) blocks to take full advantage of disentangled multiscale series in both past extraction and future prediction phases. Concretely, PDM applies the decomposition to multiscale series and further mixes the decomposed seasonal and trend components in fine-to-coarse and coarse-to-fine directions separately, which successively aggregates the microscopic seasonal and macroscopic trend information. FMM further ensembles multiple predictors to utilize complementary forecasting capabilities in multiscale observations. Consequently, TimeMixer is able to achieve consistent state-of-the-art performances in both long-term and short-term forecasting tasks with favorable run-time efficiency.
Subfields: Artificial Intelligence, Economics and Econometrics, Signal Processing
View Paper: https://www.semanticscholar.org/paper/06353b9112ab14c26ce9d3c851c01ebe4b798177
Citations in the corpus
- Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Experts (2024, neutral): “…et al., 2021; Nie et al., 2023; Liu et al., 2024b; Wang et al., 2024c; Chen et al., 2024; Wang et al., 2022) and non-transformer models (Sen et al., 2019; Jin et al., 2022; Wang et al., 2024b; Hu et al., 2024; Qi et al., 2024; Wang, 2024), designed to handle multiple time series simultaneously.”
- TRACE: Grounding Time Series in Context for Multimodal Embedding and Retrieval (2025, unknown): “Frequency-domain and mixing-based approaches aim to model periodicity and multi-scale temporal structures using Fourier transforms or token mixers [31].”