It is observed that VLMs can clearly distinguish benign inputs from harmful ones in their representation space, and even among harmful inputs, jailbreak samples form a distinct internal state that is separable from refusal samples.
Zhi-Hua Wei, Qiang Li, J. Ruan et al.· arXiv.org· 6 citations
Large Language Models (LLMs) have exhibited remarkable reasoning capabilities, largely enabled by supervised fine-tuning (SFT)- and reinforcement learning (RL)-based post-training on high-quality reasoning data. However, reproducing and extending these capabilities in open and scalable settings is hindered by three dat...
Xinyu Zhu, Yihao Feng, Yanchao Sun et al.· 0 citations
We study Heisenberg antiferromagnets through a graph-theoretic representation of their Hamiltonians. In the computational basis of a fixed-magnetization sector, the Heisenberg Hamiltonian equals a constant minus the weighted Laplacian of a graph whose vertices are spin configurations and whose edges connect configurati...
Mahmud Ashraf Shamim, M. Raj, Mohamed Hibat-Allah et al.· 2 citations
Test-Time Training offers a promising way to improve the reasoning ability of large language models (LLMs) by adapting the model using only the test questions. However, existing methods struggle with difficult reasoning problems for two reasons: raw test questions are often too difficult to yield high-quality pseudo-la...
Chengyi Yang, Zhishang Xiang, Yunbo Tang et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Many reinforcement learning (RL) problems admit multiple terminal solutions of comparable quality, where the goal is not to identify a single optimum but to represent a diverse set of high-quality outcomes. Nevertheless, policies trained by standard expected return maximization routinely collapse onto a small subset of...
Post-training quantization (PTQ) methods for large language models compress pretrained weights to low bit-widths without retraining by optimizing layer-local proxy objectives. Activation-aware scaling methods such as AWQ protect input channels with large activation norms, whereas second-order error-compensation methods...
This thesis proposes a novel approach that uses Q-Learning on top of LGP, Reinforced Linear Genetic Programming (RLGP) to learn the optimal register-action assignments, and introduces a new framework "linear-gp" written in memory-safe Rust that allows for extensive experimentation for future works.
An accelerator-friendly QP solver is implemented that accumulates one Hessian per weight matrix and solves many small QPs in parallel with a convergence certificate per column, enabling one-shot post-training pruning at scale on a single accelerator without fine-tuning.
Mohammad Mozaffari, Samuel Kushnir, Maryam Mehri Dehnavi et al.· arXiv.org· 2 citations
Unequal representation of demographic groups in training data poses challenges to model generalisation across populations. Standard practice assumes that balancing subgroup representation always optimises performance. However, recent empirical results contradict this assumption: in some cases, imbalanced data distribut...
Anissa Alloula, Charles Jones, Zuzanna Wakefield-Skorniewska et al.· 0 citations
This work proposes AISTRAL, an AI-Native Internet architecture that supplies a native layer for publisher-controlled semantic discovery and retrieval, and proposes a web-native semantic resolver, analogous to DNS but operating over meaning rather than location.
Yi-Xi Chen, Muhammad Bilal, Tie Ma et al.· 1 citation
Hyperspectral image (HSI) classification typically involves large-scale data and computationally intensive training, which limits the practical deployment of deep learning models in real-world remote sensing tasks. This study introduces SpectralTrain, a universal, architecture-agnostic training framework that enhances...
Meihua Zhou, Liping Yu, Xinyu Tong et al.· 0 citations
Edge AI must adapt to new classes and shifting data within a tight power budget, but online continual learning (learning from each sample before the next arrives) is where conventional processors are least efficient: each small update pays a full dispatch at full power. We present CLP-SNN, a spiking architecture that r...
Elvin Hajizada, Danielle Rager, Timothy Shea et al.· 0 citations