With a focus on topologically reducing the dimension that data is embedded in, rather than statistically determining the intrinsic dimension of data itself, Geometric Dimensionality Reduction presents a compelling alternate framework to classical compression algorithms.
Abstract
The emergence of AI models developed through computationally intensive training has resulted in a surge of research into dimensionality reduction techniques that spans across numerous mathematical disciplines. In this thesis we establish Geometric Dimensionality Reduction, a non-linear data compression technique that utilizes low dimensional manifolds embedded in dimensional spaces to form composite contraction-and-projection maps. Geometric Dimensionality Reduction is predominantly demonstrated through a novel algorithm entitled LGE (Livschitz-Gu-Eyunni) that utilizes Multicomplex rotation groups and polyspherical coordinates to define a single tuneable logarithmic map from ℝ 2푛 to ℝ 푛+1 with deterministic time complexity, geometric tunability, and semi-reversibility. Significant breakthroughs in the dissertation include deriving a closed form solution to the contraction map from ℝ 4 onto a constrained 푆 3 ; as well as reducing the generalized problem, projecting points embedded in ℝ 2푛 onto a parametrized 푆 2푛−1 , to solving 푛 non-linear equations. Additionally, a set of preconditioning measures have been defined that optimize clustering fidelity through invertible coordinate rotations. Contemporary methods of dimensionality reduction such as UMAP (Uniform Manifold Approximation & Projection) and t-SNE (t-distributed Stochastic Neighbor Embedding) suffer from irreversibility, hyperparameter tuning sensitivity, and computationally costly internal processes. Even LLE (Local Linear Embedding), which is designed to reduce the embedding dimension of intrinsically lower dimensional data, is sensitive to noise & variance due to the reliance on derived weights from the original local neighborhood. With a focus on topologically reducing the dimension that data is embedded in, rather than statistically determining the intrinsic dimension of data itself, Geometric Dimensionality Reduction presents a compelling alternate framework to classical compression algorithms.
A novel probabilistic version of the NHS model (PNHS) is presented for dimensionality reduction of high dimensional manifold-valued data in Riemannian homogeneous spaces and has several advantages over its deterministic counterpart namely, the NHS model.
Xi-Ran Fan, B. Vemuri· Proceedings of machine learn...· 0 citations
An initial study of combinatorial-topological techniques in the dimensionality reduction setting establishes bounds under which an algebraic structure that organizes dynamics can be lifted from the latent space to the original system.
P. Bailon, Marcio Gameiro, Brittany Gelb et al.· 0 citations
We develop theory for nonlinear dimensionality reduction (NLDR). While a large number of NLDR methods have been proposed in the literature, there is limited understanding of how these methods work and how they interrelate. Also, existing theory provides little in the way of leverage for devising new algorithms. We prov...
Daniel Ting, Michael I. Jordan· Science China Information Sc...· 0 citations
Nonlinear-manifold reduced-order models for parametrized finite element problems can achieve substantial compression both in the number of generalized (latent) coordinates and, through sampling-and-weighting hyperreduction, in the number of sampled elements/integration points. Yet current sampling-and-weighting approac...
J. A. Hernández, S. A. de Parga, R. Rossi· 1 citation
If a dataset locally looks like a low-dimensional linear space – a condition testable directly from data and derivable from the empirically supported manifold hypothesis under well-behaved conditions – then an approximating manifold M can be constructed and neural networks can approximate C1 functions uniformly on M, w...
Jakob Konstantin Hecker· Mitteilungen der Deutschen M...· 0 citations
A structural taxonomy for constrained non-convex optimization based on the signature of Lagrange multipliers at KKT stationary points is introduced with provable guarantees on correctness, iteration stabilization, sample complexity, and online tracking under data drift.
S. M. Kazemi, Ali Movaghar, Shaahin Hessabi· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.