Article

On the usage of joint diagonalization in multivariate statistics

Klaus Nordhausen, and Anne Ruiz-Gazen

Abstract

Scatter matrices generalize the covariance matrix and are useful in many multivariate data analysis methods, including well-known principal component analysis (PCA), which is based on the diagonalization of the covariance matrix. The simultaneous diagonalization of two or more scatter matrices goes beyond PCA and is used more and more often. In this paper, we offer an overview of many methods that are based on a joint diagonalization. These methods range from the unsupervised context with invariant coordinate selection and blind source separation, which includes independent component analysis, to the supervised context with discriminant analysis and sliced inverse regression. They also encompass methods that handle dependent data such as time series or spatial data.

Keywords

Blind source separation; Dimension reduction; Independent component analysis; Invariant component selection; Scatter matrices; Supervised dimension reduction;

Replaces

Klaus Nordhausen, and Anne Ruiz-Gazen, On the usage of joint diagonalization in multivariate statistics, TSE Working Paper, n. 21-1268, November 2021.

Reference

Klaus Nordhausen, and Anne Ruiz-Gazen, On the usage of joint diagonalization in multivariate statistics, Journal of Multivariate Analysis, vol. 188, n. 104844, March 2022.

Published in

Journal of Multivariate Analysis, vol. 188, n. 104844, March 2022