StructInf, a structure-aware influence estimation framework that addresses the Fidelity Gap from coarse curvature approximations and the I/O bottleneck from materializing per-example gradients, is proposed, suggesting that practical IF for LoRA-tuned LLMs benefits from joint optimization of curvature modeling, memory m...
Mengyi Yan, Yaoshu Wang, Guangyi Zhang et al.· Proceedings of the 32nd ACM...· 0 citations
Influence functions provide a principled framework for tracing model predictions back to training data, yet existing methods remain impractical for large language models due to prohibitive storage and I/O costs. Prior approaches face two critical barriers: the Fidelity Gap from coarse curvature approximations, and the...
Mengyi Yan, Yaoshu Wang, Guangyi Zhang et al.· Proceedings of the 32nd ACM...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.