Traffic transformer: Capturing the continuity and periodicity of time series for traffic forecasting
By Ling Cai, Krzysztof Janowicz, Gengchen Mai, Bo Yan, Rui Zhu. Trans. GIS, 2020
372 citations recorded by the source corpus.
Traffic forecasting is a challenging problem due to the complexity of jointly modeling spatio‐temporal dependencies at different scales. Recently, several hybrid deep learning models have been developed to capture such dependencies. These approaches typically utilize convolutional neural networks or graph neural networks (GNNs) to model spatial dependency and leverage recurrent neural networks (RNNs) to learn temporal dependency. However, RNNs are only able to capture sequential information in the time series, while being incapable of modeling their periodicity (e.g., weekly patterns). Moreover, RNNs are difficult to parallelize, making training and prediction less efficient. In this work we propose a novel deep learning architecture called Traffic Transformer to capture the continuity and periodicity of time series and to model spatial dependency. Our work takes inspiration from Google’s Transformer framework for machine translation. We conduct extensive experiments on two real‐world traffic data sets, and the results demonstrate that our model outperforms baseline models by a substantial margin.
Subfields: Building and Construction, Transportation, Signal Processing
View Paper: https://www.semanticscholar.org/paper/1ff858576af755583559fdfcd366bd16002da297
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Building and Construction
In Transportation
In Signal Processing
Citations in the corpus
- Transformers in Time Series: A Survey (2022, methodology): “…that the combination of GNN and Transformers/attentions could bring not only significant performance improvements like in traffic forecasting [Cai et al. , 2020; Xu et al. , 2020] and multi-modal forecasting [Li et al. , 2021], but also better understanding of the spatio-temporal dynamics…”
- Graph Neural Network for Traffic Forecasting: A Survey (2021, background): “Dataset Name Relevant Studies METR-LA [3], [4], [22], [25], [26], [27], [35], [38], [43], [44], [55], [57], [71], [72], [80], [105], [110], [117], [125], [129], [132], [137], [138], [141], [142], [143], [144], [145], [146], [148], [149], [153], [155], [159], [160], [172] PeMS all [28], [147] PeMS-BA”
- Transformers in Time-Series Analysis: A Tutorial (2022, methodology): “15 The Traffic Transformer introduced in [12] is presented.”