When Representation Drift Does Not Reflect Functional Contribution: A Regime Analysis of Prompt Tuning
Three similarity metrics, namely CKA, Singular Vector Canonical Correlation Analysis (SVCCA), and Projection-Weighted Canonical Correlation Analysis (PWCCA), agree on drift magnitude across every regime yet cannot distinguish functional from non-functional adaptation.