TopoTuner is competitive with full fine-tuning while training only 1-2% of the model parameters, and outperforms LoRA in 7 out of 9 model-dataset settings, which can change up to 39.57% of the projection parameters.
Abdulkadir Erol, Yash Mahajan, Vepaul Hariprashad et al.· 0 citations
This study systematically examines the vulnerabilities of open and closed-weight LVLMs, including LLaVA, InstructBLIP, Fuyu, Qwen, DeepSeek, Gemini, GPT, and Grok, using adversarial prompting strategies informed by social theories to simulate real-world social manipulation tactics.
Abdulkadir Erol, Trilok Padhi, Agnik Saha et al.· ACM Transactions on Intellig...· 0 citations