DiDi-Merging is proposed, which jointly allocates low-rank capacity to these components through differentiable rank selection, followed by data-free parameter-space refinement, followed by data-free parameter-space refinement.
CounterCount goes beyond showing that VLMs fall back on knowledge priors, revealing that once a familiar context is recognized, models favor prior knowledge over available visual evidence rather than failing to encode that evidence.
Reem Alzahrani, Bushra Bin Hemid, Hassan Alshanqiti et al.· 0 citations
DRAPE (Dynamic Cross-Modal Prompt Generation), a prompt-learning framework that synthesizes continuous instance-specific soft prompts for MCIT, and achieves state-of-the-art performance among representative prompt-based and LoRA-based continual-learning baselines.
A bottom-up cascaded knowledge distillation (CKD) framework is proposed, inspired by human formal education systems, and introduces one (potentially, more) additional Teacher(s) of intermediate capacity that gradually bring the Student network to the next level, where the next (higher-capacity) Teacher can take over.
Standard LLM-based speech recognition systems process utterances in isolation, limiting their ability to leverage conversational context. Here we study whether multimodal context from prior turns improves LLM-based ASR and how to represent that context efficiently. We find that, after supervised multi-turn training, co...
Shashi Kumar, Esa\'u Villatoro-Tello, Sergio Burdisso et al.· 0 citations
These findings show that lightweight additive forecasting strategies can remain highly competitive for urban air-quality prediction, offering a practical balance between accuracy, interpretability, and computational efficiency.
Moazzam Umer Gondal, Hamad Ul Qudous, Asma Ahmad Farhan et al.· 0 citations
Current alignment evaluation mostly measures whether models encode dangerous concepts and whether they refuse harmful requests. Both miss the layer where alignment often operates: routing from concept detection to behavioral policy. We study political censorship in Chinese-origin language models as a natural experiment...
This work gives semantic and temporal guidance from the keyframes and text onto each intermediate frame through Keyframe-anchored Attention Bias and better enforce frame consistency with Rescaled Temporal RoPE, which allows self-attention to attend to keyframes more faithfully.
Tae Eun Choi, Sumin Shim, Junhyeok Kim et al.· arXiv.org· 3 citations
It is observed that VLMs can clearly distinguish benign inputs from harmful ones in their representation space, and even among harmful inputs, jailbreak samples form a distinct internal state that is separable from refusal samples.
Zhi-Hua Wei, Qiang Li, J. Ruan et al.· arXiv.org· 6 citations
Large Language Models (LLMs) have exhibited remarkable reasoning capabilities, largely enabled by supervised fine-tuning (SFT)- and reinforcement learning (RL)-based post-training on high-quality reasoning data. However, reproducing and extending these capabilities in open and scalable settings is hindered by three dat...
Xinyu Zhu, Yihao Feng, Yanchao Sun et al.· 0 citations
We study Heisenberg antiferromagnets through a graph-theoretic representation of their Hamiltonians. In the computational basis of a fixed-magnetization sector, the Heisenberg Hamiltonian equals a constant minus the weighted Laplacian of a graph whose vertices are spin configurations and whose edges connect configurati...
Mahmud Ashraf Shamim, M. Raj, Mohamed Hibat-Allah et al.· 2 citations
Test-Time Training offers a promising way to improve the reasoning ability of large language models (LLMs) by adapting the model using only the test questions. However, existing methods struggle with difficult reasoning problems for two reasons: raw test questions are often too difficult to yield high-quality pseudo-la...
Chengyi Yang, Zhishang Xiang, Yunbo Tang et al.· 0 citations