Papers
Topics
Authors
Recent
Search
2000 character limit reached

K-Tensors: Clustering Positive Semi-Definite Matrices

Published 10 Jun 2023 in cs.LG and stat.ME | (2306.06534v4)

Abstract: This paper introduces $K$-Tensors, a novel self-consistent clustering algorithm designed to cluster positive semi-definite (PSD) matrices by their eigenstructures. Clustering PSD matrices is crucial across various fields, including computer and biomedical sciences. Traditional clustering methods, which often involve matrix vectorization, tend to overlook the inherent PSD characteristics, thereby discarding valuable shape and eigenstructural information. To preserve this essential shape and eigenstructral information, our approach incorporates a unique distance metric that respects the PSD nature of the data. We demonstrate that $K$-Tensors is not only self-consistent but also reliably converges to a local optimum. Through numerical studies, we further validate the algorithm's effectiveness and explore its properties in detail.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (24)
  1. Random projections on manifolds of symmetric positive definite matrices for image classification. IEEE Winter Conference on Applications of Computer Vision, pp.  301–308, 2014.
  2. Clustering with bregman divergences. Journal of machine learning research, 6(10), 2005.
  3. Positive definite matrices: data representation and applications to computer vision. Algorithmic Advances in Riemannian Geometry and Applications: For Machine Learning, Computer Vision, Statistics, and Optimization, pp.  93–114, 2016.
  4. Covariance reducing models: An alternative to spectral modelling of covariance matrices. Biometrika, 95(4):799–812, 2008.
  5. Flury, B. N. Common principal components in k groups. Journal of the American Statistical Association, 79(388):892–898, 1984.
  6. An algorithm for simultaneous orthogonal transformation of several positive definite symmetric matrices to nearly diagonal form. SIAM Journal on Scientific and Statistical Computing, 7(1):169–184, 1986.
  7. Shared subspace models for multi-group covariance estimation. J. Mach. Learn. Res., 20:171–1, 2019.
  8. Efficient r-estimation of principal and common principal components. Journal of the American Statistical Association, 109(507):1071–1083, 2014.
  9. Algorithm as 136: A k-means clustering algorithm. Journal of the royal statistical society. series c (applied statistics), 28(1):100–108, 1979.
  10. Principal curves. Journal of the American Statistical Association, 84(406):502–516, 1989.
  11. Johnstone, I. M. On the distribution of the largest eigenvalue in principal components analysis. The Annals of statistics, 29(2):295–327, 2001.
  12. Multivariate analysis. Probability and mathematical statistics, 1979.
  13. Moakher, M. A differential geometric approach to the geometric mean of symmetric positive-definite matrices. SIAM Journal on Matrix Analysis and Applications, 26(3):735–747, 2005. doi: 10.1137/S0895479803436937. URL https://doi.org/10.1137/S0895479803436937.
  14. Pearson, K. On lines and planes of closest fit to systems of points in space. Lond. Edinb. Dublin Philos. Mag. J. Sci, 2:559–572, 1901.
  15. Covariance clustering on riemannian manifolds for acoustic model compression. 2010 IEEE International Conference on Acoustics, Speech and Signal Processing, pp.  4326–4329, 2010.
  16. Tarpey, T. Self-consistency and principal component analysis. Journal of the American Statistical Association, 94(446):456–467, 1999.
  17. Self–consistency: A fundamental concept in statistics. Statistical Science, 11:229–243, 1996.
  18. Principal points and self-consistent points of elliptical distributions. The Annals of Statistics, pp.  103–112, 1995.
  19. Region covariance: A fast descriptor for detection and classification. Computer Vision–ECCV 2006: 9th European Conference on Computer Vision, Graz, Austria, May 7-13, 2006. Proceedings, Part II 9, pp.  589–600, 2006.
  20. Exploring the brain network: a review on resting-state fmri functional connectivity. European Neuropsychopharmacology, 20(8):519–534, 2010.
  21. Quadratic optimization for simultaneous matrix diagonalization. IEEE Transactions on Signal Processing, 54(9):3270–3278, 2006.
  22. Principal regression for high dimensional covariance matrices. Electronic Journal of Statistics, 15(2):4192–4235, 2021a.
  23. Covariate assisted principal regression for covariance matrix outcomes. Biostatistics, 22(3):629–645, 2021b.
  24. Longitudinal regression of covariance matrix outcomes. arXiv preprint arXiv:2202.04553, 2022.

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up