Detecting reconciliation discrepancies in tabular data using transformers
Introduction Large organisations maintain heterogeneous datasets in data lakes, where schema variability, inconsistent formats, and semantic ambiguity complicate reconciliation. Achieving a unified view of entities requires methods that capture both structural equality and semantic relationships. Methods We propose a t...