Skip to content

TabFM: A Zero-Shot Foundation Model for Tabular Data

Sep 2026 · 24 citations · ⚡ 4 influential · 46 references
Computer Science

TL;DR

TabFM, a 400M-parameter tabular foundation model that formulates supervised tabular prediction as in-context learning, produces calibrated zero-shot predictions in a single forward pass without task-specific tuning.

Abstract

Tabular machine learning typically relies on per-dataset workflows, fitting tree ensembles or running AutoML searches from scratch for every task. We present TabFM, a 400M-parameter tabular foundation model that formulates supervised tabular prediction as in-context learning. TabFM produces calibrated zero-shot predictions in a single forward pass without task-specific tuning. Trained entirely on synthetic tables generated from structural causal models, TabFM learns general tabular representations that transfer zero-shot to real-world tasks. Across all 51 benchmark datasets in TabArena (38 classification and 13 regression), zero-shot TabFM ranks first among default tabular foundation models and outperforms tuned AutoML pipelines. Two extensions over the same frozen weights improve performance further on both tracks: multi-view feature expansion with ensembling and post-hoc calibration (TabFM+), and LLM-guided, dataset-specific data processing and feature engineering (TabFM-Auto).

View source

Similar papers

Review Open access Aug 2026

The Current Generation of Tabular Foundation Models: A Critical Review

This review is, to the authors' knowledge, the first organised around the current generation of tabular foundation models, and taxonomises the architectures by pretraining regime, maps the capability space across five axes, isolates the language-model-on-tabular strand for prediction, feature engineering and generation...

S. Kurashkin, V. Tynchenko, Alexey S. Borodulin et al. · 1 citation
#artificial intelligence Preprint Sep 2026

Xiaomi-TabLDM: A Tabular Foundation Model Technical Report

We introduce Xiaomi-TabLDM, a tabular large data foundation model for classification and regression via in-context learning, which delivers superior prediction accuracy without requiring task-specific fine-tuning. Pretrained exclusively on synthetic data generated from structural causal models (SCMs), our model enables...

Xiaomi-TabLDM Team Penghui Wang, Wei Liu, Hong Wang et al. · 5 citations · ⚡2
Preprint Sep 2026

Xiaomi-TabLDM: A Tabular Foundation Model Technical Report

We introduce Xiaomi-TabLDM, a tabular large data foundation model for classification and regression via in-context learning, which delivers superior prediction accuracy without requiring task-specific fine-tuning. Pretrained exclusively on synthetic data generated from structural causal models (SCMs), our model enables...

Xiaomi-TabLDM Team Penghui Wang, Wei Liu, Hong Wang et al. · 0 citations
Preprint Aug 2026

EXAONE Tabular 1.0 : Technical Report

These results establish EXAONE Tabular as a state-of-the-art compact tabular foundation model family, combining strong predictive performance across classification, point regression, and probabilistic regression with an efficient model design.

M. Eo, Min-Kook Suh, Hye-Seung Cho et al. · 12 citations · ⚡3
Preprint Aug 2026

Localized TabICLv2: Scaling Tabular In-Context Learning through k-NN

Localized TabICLv2 introduces a method that reduces the inference cost of TabICLv2 by retrieving only the k nearest training neighbours for each test point, measured by similarity in the model's Stage 2 row-representation space, rather than using the full training context.

Beimnet Bekele Guta · 0 citations

Related blog posts

MIT News · Artificial Intelligence Nov 17, 2026

Learning the language of machine learning

By studying the computational foundations of language learning, Associate Professor Jacob Andreas builds intelligent systems that can communicate effectively with humans.

Microsoft Research Blog Nov 16, 2026

TokenEconomizer: Learning from Experience to Make AI Coding Agents More Efficient

AI coding agents are increasingly help developers fix bugs and build features largely on their own, but every interaction with their models consumes tokens. In each session, an agent sends instructions, tool descriptions, and session history to its model. Most efforts to reduce this cost focus on individual tasks. Yet developers return to the same […] The post TokenEconomizer: Learning from Experience to Make AI Coding Agents More Efficient appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.