Skip to content

Identifiability of Relational Queries in Multi-View Pretraining

Jul 2026 · arXiv.org · Vol abs/2607.04735 · 0 citations · 37 references
Computer Science

TL;DR

This work formalizes query identifiability for data integration under interface laws (functional dependencies that hold uniformly across all legal worlds rather than within a single instance) and proves three results.

Abstract

When data sources are integrated through a shared interface, a downstream query may or may not be determined by what the interface exposes: two globally consistent worlds can agree on every shared attribute yet disagree on the query answer. This ambiguity is structural -- a property of the interface design, not the data volume -- and cannot be resolved by collecting more records or training a larger model. We formalize query identifiability for data integration under interface laws (functional dependencies that hold uniformly across all legal worlds rather than within a single instance) and prove three results. (i) A polynomial-time certificate (CheckCert) decides identifiability via attribute closure, and is exact on instances that expose any residual ambiguity (closure-separable). (ii) Non-identifiable queries face an irreducible 1/2 minimax error floor for any estimator using only interface evidence, bounding multi-view pretraining systems from below. (iii) A minimum-augmentation algorithm (Greedy-MinAug) finds the smallest set of interface additions to certify a query, reducing to Set Cover (logarithmic approximation). Experiments on synthetic benchmarks, real integration datasets spanning three domains (scholarly, product, restaurant), and schemas up to 10^3 attributes confirm CheckCert is exact, both algorithms run in single-digit milliseconds, and ML classifiers exhibit the predicted error floor and abrupt capability gains.

View source

Similar papers

#machine learning Preprint Oct 2026

STEER: Reducing Inference Cost in Relational Foundation Models through Semantically Informed Sampling

STEER is proposed, a sampling approach that shrinks the inference context by concentrating it on the tables most relevant to the prediction task at hand, and it is shown that it reduces inference context size by about 40% on average while maintaining, and in some cases improving, prediction accuracy.

A. Mohamed, Ashraf Aboulnaga · 0 citations
Preprint Sep 2026

When is Test-Time Adaptation Identifiable From Unlabeled Evidence?

The result is a practical way to separate two failure modes that are usually mixed together: a weak selector versus an information channel that cannot support the desired decision in the first place.

Kartik Jhawar, Li-Po Wang · 1 citation
#machine learning Preprint Sep 2026

Predictable Failure in Multi-Hop Retrieval: Score-Distributional Confidence Scoring and Abstention

It is proved that no single ANN score feature achieves best predictive performance across all failure regimes; the dominant feature differs between datasets (query length on MuSiQue, hop-1 concentration on HoVer), and a constructive witness pair shows each is necessary in one regime and non-contributory in the other.

Andre Bacellar · 2 citations
#artificial intelligence Preprint Sep 2026

From Parameters to Answers: How LLMs Retrieve and Use Their Internal Knowledge

This work compares country-continent questions with noun, adjective, and code answers while keeping several fitted measurements distinct across Qwen, Llama, and Gemma to separate early readability, natural strength, causal steering, and later content dependence.

Wen-Lin Wei, Yuan Fang, Ren-He Jiang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Cost-Aware Best-LLM Identification using Dueling Feedback

A Track-and-Stop style algorithm for best-arm identification with prescribed confidence is proposed, and it is proved that the algorithm almost surely achieves the asymptotically optimal cost as the error tends to zero.

Sarvesh Gharat, Nikhil Karamchandani, Jayakrishnan Nair · 0 citations
#artificial intelligence Preprint Sep 2026

ALOE: Semantically Addressed Low-Rank Operators for Knowledge Editing

Knowledge editing changes what a model knows by modifying parameters so that a requested fact updates while unrelated behavior is preserved. This is usually treated as a write problem, but editing also involves an address problem: deciding which hidden states should receive the new residual. An update that activates to...

Zeyan Li, Hu Xu, Jian-Feng Xu · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.