Skip to content
Book Open access

Taming Structured Data Foundation Models with AutoML: A Hands-On Guide

Aug 2026 · Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 · 0 citations · 1 references

Abstract

Structured data drives enterprise decision-making, yet building predictive pipelines for time-series and tabular modalities requires intensive feature engineering, model selection, and other ''tricks of the trade''. AutoGluon, an open source AutoML system, automates this through multi-layer stack ensembling, providing a unified API that reliably achieves state-of-the-art accuracy across time series and tabular data. Concurrently, Foundation Models for Structured Data (FM4SD) have emerged to push the boundaries of predictive performance, enabling both powerful zero-shot inference and efficient fine-tuning. Specifically, Chronos-2 delivers state-of-the-art multivariate forecasting for time series, while a rapidly growing ecosystem of tabular foundation models (e.g., TabPFN, Mitra, TabICL) transforms how practitioners execute classification and regression tasks. This system-focused tutorial teaches attendees how to operationalize FM4SDs using AutoML across temporal and tabular modalities, with an additional highlight on the newly released Chronos-2. We guide participants through a technical progression: establishing AutoGluon as the orchestration framework, detailing the internal mechanics of Chronos-2 and various tabular FMs, and unifying them into production-ready pipelines.

Read PDF

Similar papers

Preprint Jul 2026

Evolutionary Feature Engineering for Structured Data

EFE demonstrates that LLM-based evolution can improve both accuracy and interpretability when automatically tackling structured data, and is found to be particularly effective on classical decision trees.

Ege Onur Taga, Yilin Zhuang, M. E. Ildiz et al. · 0 citations
Open access Aug 2026

An Explainable AutoML Pipeline for Multi-Task Tabular Data Using Optuna and SHAP

This research introduces an Explainable AutoML Pipeline for performing automated data pre-processing, multi-model learning, hyperparameter optimization using Optuna, model selection using a leaderboard, and finally interpreting the results using SHAP.

A. S, R. A, Shanmathi K. et al. · 0 citations
Review Open access Aug 2026

The Current Generation of Tabular Foundation Models: A Critical Review

This review is, to the authors' knowledge, the first organised around the current generation of tabular foundation models, and taxonomises the architectures by pretraining regime, maps the capability space across five axes, isolates the language-model-on-tabular strand for prediction, feature engineering and generation, and summarises openness and deployment.

Sergei O. Kurashkin, V. Tynchenko, Alexey S. Borodulin et al. · 0 citations
Review Open access Jul 2026

Automating Machine Learning Pipeline Design via Metalearning

This thesis introduces the Dynamic Pipeline CASH problem, which extends the CASH formulation to incorporate meta-model-driven search space creation for pipelines, using Metalearning (MtL) to dynamically build task-specific search spaces.

Edesio Alcobaça, A. Carvalho · 0 citations
Preprint Aug 2026

Why Large Language Models Fail at Tabular Prediction

The results show that the LLM's capability dissolves with dimension in a way no noise-corrupted classical learner mimics - which explains why LLMs, so capable elsewhere, keep losing to fifty-year-old baselines on tables, while leaving the mechanism of the prediction as an open question.

M. Garnelo, Wojciech M. Czarnecki · 0 citations
Open access Jul 2026

Bridging Scalability and Interpretability in AutoML Via Feature Engineering

Experimental evaluation on the Madelon dataset indicates that the automated and interpretable pipeline performs comparably to, and in some respects favourably against, baseline feature engineering approaches, demonstrating the practical effectiveness of combining scalable feature generation with interpretable AutoML.

Ms. CH. Vasavi, Ms. SK. Raqeeba · 0 citations