Differentially private zeroth-order optimization (DP-ZO) enables memory-efficient private fine-tuning of large language models using only forward evaluations. Existing aggregation-based DP-ZO methods reconstruct model updates at a fixed scale, ignoring that the strength of useful signals varies throughout training. Con...
Le-Le Zheng, Wei-Feng Kong, Xinyi Zhang et al.· 0 citations
Growing vulnerability disclosure and widespread software reuse increase security teams'need for reproducible evidence to diagnose vulnerabilities, validate patches, and build regression tests. Producing such evidence at scale requires automated end-to-end CVE reproduction. Existing methods typically process different C...
Ji He, Huang Zhang, Li-Jie Zheng et al.· 0 citations
Federated Low-Rank Adaptation (LoRA) provides an efficient solution for finetuning large language models across distributed and privacy-sensitive data. However, despite avoiding raw data sharing, federated LoRA remains vulnerable to privacy leakage through transmitted model updates. Differential privacy (DP) mitigates...
Le-Le Zheng, Rui Hu, Tao Zhang et al.· 0 citations
FedGSA, a geometry-consistent aggregation framework for differentially private federated LoRA, is proposed and it is proved that FedGSA incurs no additional privacy loss beyond client-side DP training and establishes its convergence under standard assumptions.
Le-Le Zheng, Rui Hu, Tao Zhang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.