Riemannian Optimization on Tensor Products of Grassmann Manifolds: Applications to Generalized Rayleigh-Quotients

By O. Curtef, Gunther Dirr, Uwe Helmke. 2010

9 citations recorded by the source corpus.

We introduce a generalized Rayleigh-quotient $\rho_A$ on the direct product of Grassmannians $\mathrm{Gr}({\bf m},{\bf n})$ enabling a unified approach to well-known optimization tasks from different areas of numerical linear algebra, such as best low-rank approximations of tensors (data compression), geometric measures of entanglement (quantum computing), and subspace clustering (image processing). We compute the Riemannian gradient of $\rho_A$, characterize its critical points, and prove that they are generically nondegenerated. Moreover, we derive an explicit necessary condition for the nondegeneracy of the Hessian. Finally, we present two intrinsic methods for optimizing $\rho_A$—a Newton-like and a conjugated gradient—and compare our algorithms tailored to the above-mentioned applications with established ones from the literature.

Subfields: Computational Mathematics, Computational Mechanics, Numerical Analysis

Citations in the corpus

• A literature survey of low‐rank tensor approximation techniques (2013, neutral): “Examples include nonlinear conjugate gradient or Newton-like methods on manifolds of low-rank matrices [35,191,198,257,258] or low-rank tensors [52,53,131,132,255], see also Section 3.4.”