Jacobian Rank Collapse in Decision-Focused Learning
Decision-focused learning (DFL) trains predictors through downstream objectives, but a different loss need not provide an independent parameter-update direction. We characterize this restriction through the predictor Jacobian, using sparse index tracking to distinguish the covariance entries read by the optimizer from...
Ao-Jie Yuan, Hai-Yu Zhang, Zi-Jian Su
· 0 citations