Skip to content
Book Open access

Interplay Between Classical Tensor Methods And Foundation Models

Aug 2026 · Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 · 0 citations · 9 references

Abstract

Tensor methods have played a central role in analyzing multi-dimensional data across a wide range of real-world applications. At the same time, these methods provide low-rank representations, which enable trustworthy and parsimonious machine learning systems. However, even though they hold great promise, tensor methods remain relatively underexplored in the context of modern neural architectures and foundation models. This workshop aims to provide a forum for advancing tensor methods and applying them to various applications at the intersection of data mining and modern machine learning. Supported by organizers and keynote speakers with broad expertise across machine learning, signal processing, and data mining, the workshop aims to foster an interactive environment for researchers to exchange ideas and build connections across communities.

Read PDF

Similar papers

Preprint Aug 2026

Tensor Network Kernel Machines: A JAX Framework for Machine Learning and Nonlinear System Identification

Developing nonlinear models that are both expressive and computationally efficient remains a challenge in machine learning and nonlinear system identification. Tensor network kernel machines (TNKM) address this challenge by combining nonlinear feature representations with compact low-rank tensor-network parameterizatio...

Albert Saiapin, Kim Batselier · 0 citations
#artificial intelligence Review Aug 2026

Tensor Methods for Language Models: From Token Representation to Training, Adaptation, Inference, Compression, and Interpretability

This survey provides a structured entry point to tensorized language models and clarifies when parameter savings can plausibly translate into memory efficiency, computational efficiency, or interpretability, and introduces a metric for the compression-realization gap between theoretical memory reduction and measured sy...

M. Tarasov, Salman Ahmadi-Asl, A. D. de Almeida et al. · 1 citation
Open access Aug 2026

STOD: Sparse Tensor Train Optimization via Orthogonal Decomposition for High-Dimensional Learning

This paper proposes a novel Tensor Train (TT)-based tensor-on-tensor regression optimization framework for variable selection based on mode-1 hyperslice sparsity, and designs an alternating iterative algorithm equipped with a preconditioned metric to efficiently solve the proposed model.

Xiao-Yu Li, Zi-Yan Luo · 0 citations
#machine learning Preprint Sep 2026

Tensor-Train Weak SINDy: Identifying High-Dimensional Nonlinear Dynamics

In recent years, weak-form methods have made significant advances in data-driven discovery of dynamical systems. However, in high-dimensional settings, current techniques can prove expensive in both computation and memory. In this work, we introduce TT-WSINDy, which combines techniques of the Multidimensional Approxima...

W. Houser, Vanja Dukic, David M. Bortz · 0 citations
Preprint Aug 2026

Accelerated Learning of High Dimensional Functions with a Tensor-Featured Training Network

This work presents a method to accelerate the optimization of learning high dimensional functions using deep neural network (DNN), and studies the effect of adding features which distill pretrained DNN into TNs using a discretize and decompose strategy.

Karl Pierce, Y. Khoo, Haizhao Yang · 0 citations

A Unified Toolkit for Evaluating Nonlinear Dimensionality Reduction Techniques

This thesis builds on an existing diagnostics toolkit mainly for t-SNE and UMAP and turns it into a more accessible package for interested practitioners, while also extending it with diagnostics tools.

Kasra Amirani, S. Huisman, E. V. van Nieuwenburg · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.