Tensor Decompositions for Signal Processing Applications: From two-way to multiway component analysis
By Andrzej S. Cichocki, Danilo P. Mandic, Lieven De Lathauwer, Guoxu Zhou, Qibin Zhao, Cesar Federico Caiafa, Anh Huy Phan. IEEE Signal Processing Magazine, 2014
1,400 citations recorded by the source corpus.
The widespread use of multisensor technology and the emergence of big data sets have highlighted the limitations of standard flat-view matrix models and the necessity to move toward more versatile data analysis tools. We show that higher-order tensors (i.e., multiway arrays) enable such a fundamental paradigm shift toward models that are essentially polynomial, the uniqueness of which, unlike the matrix methods, is guaranteed under very mild and natural conditions. Benefiting from the power of multilinear algebra as their mathematical backbone, data analysis techniques using tensor decompositions are shown to have great flexibility in the choice of constraints which match data properties and extract more general latent components in the data than matrix-based methods.
Subfields: Computational Mathematics, Computer Networks and Communications, Signal Processing
View Paper: https://www.semanticscholar.org/paper/b62e8bdef1af2d4d4dd6b659a49def5b185ab8cd
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Computational Mathematics
- N. Sidiropoulos
- Lieven De Lathauwer
- Christos Faloutsos
- Evangelos E. Papalexakis
- Shuchin Aeron
- Misha Elena Kilmer
- Jean Kossaifi
- T. Adalı
In Computer Networks and Communications
- Lieven De Lathauwer
- Shuchin Aeron
- T. Adalı
- Christian Jutten
- Dana Lahat
- Christos Faloutsos
- Evangelos E. Papalexakis
- N. Sidiropoulos
In Signal Processing
- Lieven De Lathauwer
- N. Sidiropoulos
- Christos Faloutsos
- Dana Lahat
- T. Adalı
- Anima Anandkumar
- Evangelos E. Papalexakis
- Misha Elena Kilmer
Citations in the corpus
- Tensors for Data Mining and Data Fusion (2016, neutral): “Subsequently, more survey papers have been published, some of them focusing on the applications [Acar and Yener 2009] and some on the algorithms [Cichocki et al. 2009; Lu et al. 2011; Grasedyck et al. 2013; Cichocki et al. 2015].”
- TensorLy: Tensor Learning in Python (2016, background): “The interested reader is referred to several surveys in the topic, which focus range from basics of multilinear (tensor) algebra and overview of different established tensor decompositions [17, 29], to algorithmic advances [7, 19, 10, 6, 26] and applications [1].”
- Tensor decomposition of EEG signals: a brief review. (2015, neutral): “2, the Tucker decomposition is in general more flexible than the CPD (Cichocki et al., 2015; Kolda & Bader, 2009), which is validated by results shown in Figures 3 and 4.”
- Tensor-Tensor Products with Invertible Linear Transforms (2015, background): “Due to the ubiquitous nature of multiway data in science and engineering applications, tensor theory and decompositions have crept into recent literature on signal processing [14, 15, 16], Bayesian statistics [17, 18], and even systems biology [19] to name just a few examples.”
- Tensor Networks for Dimensionality Reduction and Large-scale Optimization: Part 1 Low-Rank Tensor Decompositions (2016, neutral): “5 Scope and Objectives Review and tutorial papers [51,59,69,153,177,193,236] and books [53,112,160, 239] dealing with TDs and TNs already exist, however, they typically focus on standard models, with no explicit links to very large-scale data processing topics or connections to a wide class of optim”
- Structured Pruning for Deep Convolutional Neural Networks: A Survey (2023, methodology): “To deal with 4-D tensors, methods or concepts such as Tucker [289], classical prolongation (CP) [290], and tensor networks [291] are”
- Multimodal Data Fusion: An Overview of Methods, Challenges, and Prospects (2015, background): “Generalized linked-mode for multiway data [8] and LMWCA [65] mention explicitly that they can be defined both with “soft” or “hard” links.”
- Tensor Decomposition for Signal Processing and Machine Learning (2016, background): “The recent tutorial [11] offers an accessible introduction, with many figures that help ease the reader into three-way thinking.”
- Model Compression and Hardware Acceleration for Neural Networks: A Comprehensive Survey (2020, methodology): “Hence, CP is typically used for interpreting data components while Tucker is often used for data compression [99].”
- Tensor Regression Networks (2017, background): “One class of broadly useful techniques within tensor methods are tensor decompositions, which have been studied for a variety of applications in signal processing and machine learning (Sidiropoulos et al., 2017; Cichocki et al., 2015), data mining and fusion (Papalexakis et al.”