Linear regression and kernel smoothing offer tractable explanations of in-context learning: in both, the features determine the weight assigned to each context label. However, whether this fixed-weight account describes pretrained tabular foundation models (TFMs) remains unclear. Testing this account using derivatives...
Duong Nguyen, N. Chesneau, Milan Bhan· 0 citations
Tabular foundation models (TFMs) achieve strong predictive performance by conditioning on labeled demonstrations provided in context, without any parameter update. Yet how individual demonstrations shape a given prediction remains poorly understood. This gap matters in practice: the context is often assembled from what...
Yacine Benihaddadene, Milan Bhan, Eliot Dugelay et al.· 0 citations
This work offers the first random generator of synthetic causal benchmarks with coverage guarantees and transparent assumptions operating on the three levels of causal reasoning: observation, intervention, and counterfactual, and demonstrates its utility by evaluating several state-of-the-art methods under diverse cond...
Panayiotis N. Panayiotou, Audrey Poinsot, A. Leite et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.