Tensor Decomposition for Signal Processing and Machine Learning

By N. Sidiropoulos, Lieven De Lathauwer, Xiao Fu, Kejun Huang, Evangelos E. Papalexakis, Christos Faloutsos. IEEE Transactions on Signal Processing, 2016

1,589 citations recorded by the source corpus.

Tensors or <italic>multiway arrays</italic> are functions of three or more indices <inline-formula> <tex-math notation="LaTeX">$(i,j,k,\ldots)$</tex-math></inline-formula>—similar to matrices (two-way arrays), which are functions of two indices <inline-formula><tex-math notation="LaTeX">$(r,c)$</tex-math></inline-formula> for (row, column). Tensors have a rich history, stretching over almost a century, and touching upon numerous disciplines; but they have only recently become ubiquitous in signal and data analytics at the confluence of signal processing, statistics, data mining, and machine learning. This overview article aims to provide a good starting point for researchers and practitioners interested in learning about and working with tensors. As such, it focuses on fundamentals and motivation (using various application examples), aiming to strike an appropriate balance of breadth <italic>and depth</italic> that will enable someone having taken first graduate courses in matrix algebra and probability to get started doing research and/or developing tensor algorithms and software. Some background in applied optimization is useful but not strictly required. The material covered includes tensor rank and rank decomposition; basic tensor factorization models and their relationships and properties (including fairly good coverage of identifiability); broad coverage of algorithms ranging from alternating optimization to stochastic gradient; statistical performance analysis; and applications ranging from source separation to collaborative filtering, mixture and topic modeling, classification, and multilinear subspace learning.

Subfields: Artificial Intelligence, Computational Mathematics, Signal Processing

View Paper: https://www.semanticscholar.org/paper/eed9fa4483cab37eacd59db0fac4b1441431ee85

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Tao Qin
  2. Tie-Yan Liu
  3. Xu Tan
  4. Sheng Zhao
  5. Enhong Chen
  6. Zhou Zhao
  7. Zachary Chase Lipton
  8. Mohit Bansal

In Computational Mathematics

  1. Andrzej S. Cichocki
  2. Anh Huy Phan
  3. Qibin Zhao
  4. Danilo P. Mandic
  5. Ivan V. Oseledets
  6. Namgil Lee
  7. Timothy M. Hospedales
  8. Boris N. Khoromskij

In Signal Processing

  1. Xu Tan
  2. Tao Qin
  3. Tie-Yan Liu
  4. Sheng Zhao
  5. Andrzej S. Cichocki
  6. Anh Huy Phan
  7. Qibin Zhao
  8. Ivan V. Oseledets

Citations in the corpus