Beyond Model-Centric AI: Embedding Governance as an Architectural Component with Measurable Efficiency

Abstract

Production AI systems typically apply governance—compliance checking, auditing, and explanation—as an external control layer that observes outputs after they are produced. In this paper, embedded governance is proposed: a governance gate that forms part of the system architecture itself, positioned between inference and release, so that no output leaves the system without a measurable governance assessment. For each candidate output, a governance score is computed from three factors that are checked mechanically rather than judged by a model: intent conformance, formulation traceability, and verification. On the basis of this score, each output is released, remediated, or blocked. Governance efficiency η, the ratio of intercepted error cost to governance cost, is further defined, by which the claim that governance pays for itself becomes falsifiable rather than asserted. Weights and thresholds are calibrated by maximizing η on a validation split and reported on held-out data. Evaluation uses the full credit-card fraud detection dataset of 284,807 transactions under a temporal split, so that the evaluation period follows the training period and distribution drift arises naturally. The calibrated gate intercepts 99% (95% CI 94.6–99.8) of severely shifted requests at a mean overhead of 3.74 ms, and η reaches 4.52 when releasing unreliable outputs carries cost, while remaining below break-even under accuracy-only cost models. A severity sweep locates the detection boundary and shows interception falling to 2% under mild shift. An ablation identifies distributional checks as the load-bearing components and reveals that η can be inflated by a gate that governs less, so efficiency must be read alongside coverage. Under identical workload, external monitoring and post-hoc assessment detect the same errors but prevent none, whereas inline placement reduces released error cost by 82.