Multi-billion-parameter LLMs now run on phones for inference, and training them on the device would personalize them without user data leaving the phone. Prior work has measured individual training steps of such models on phones, but not complete training runs, and not whether adapters trained on the device improve per...
Andrew Geyko, Marius Mosbach, André Brinkmann· 0 citations
LACUNA is introduced: the first unlearning testbed with ground-truth parameter-level localization and shows that when localization is successful, even a simple gradient-based unlearning method achieves strong erasure and robustness to resurfacing attacks, highlighting the importance of precise unlearning.
It is found that LLM belief update understanding lags behind that of humans, especially in more naturally-occurring scenarios, and the first expert-annotated implicature cancellation dataset, ImplicatureX, is created, crowdsourced for human judgements of implicatures and their corresponding cancellations.
C. Piano, Verna Dankers, Marius Mosbach et al.· arXiv.org· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.