A lightweight inference-time correction that estimates and removes a popularity prior from model predictions is proposed, which requires no fine-tuning, is label-free at test time, and adds negligible computational cost.
Abdelrahman Abdallah, Mohammed Ali, Bhawna Piryani et al.· 0 citations
RouteSparse is introduced, which routes each head and prompt segment among a small library of GPU-efficient sparse patterns, andlations confirm that input-conditional routing, hardware profiling, and selective dense fallback each contribute to the quality--latency tradeoff.
Chao Zhang, Yi Ji, Zi-Yan Zhang et al.· 1 citation
This work proposes using Tensor Product Representations (TPRs) as a unifying hypothesis, and shows that TPRs can unify several prior interpretability methods: additive analogies, linear probing, sparse autoencoders, and activation patching.
The results indicate that current MLLMs can process visually clear English and structured numeric content, but reliable native Khmer document understanding remains an open challenge.
TopoCompress is introduced, a training-free and model-agnostic framework that compresses long contexts by selecting coherent semantic spans by selecting coherent semantic spans and achieves performance comparable to the strongest baseline while using a 4x smaller compression budget.
This work compares a ~28M-parameter autoregressive Tiny Recursive Model (TRM-AR) on natural-language-to-Python code generation against parameter-matched and depth-matched controls, tracking fit and generation across 40 epochs and three seeds.
A proof-of-concept Brain-Language-Action (BLA) model for drone control using motor-imagery EEG from the BCI Competition IV 2a dataset is developed, providing an initial demonstration that language conditioning can expand the effective control range of EEG-based robotic interfaces without requiring a corresponding incre...
This work validates the engineering feasibility of running industrial-scale trillion-parameter LLM-driven biomedical computing tasks on consumer hardware, establishing a new low-barrier paradigm for AI-powered early stage drug discovery.
CoMPASS is presented, a retrieval-calibrated framework for small-large model collaboration that retains a graph attention network as the predictive anchor, retrieves locally relevant training molecules, provides attention-grounded evidence to an LLM, and converts its proposal into a bounded correction through an agreem...
Wen-Tao Li, Jiang-Jie Qiu, Yi-Jun Li et al.· 0 citations
It is explained how roleplay can produce compliance despite retained evidence of harm and identify a concrete target for future safeguards: maintaining the connection from harm recognition to refusal.
A dynamic explanation of how data statistics and architecture jointly shape token embeddings in language models is provided, and an implicit bias in the space of data statistics is revealed: training proceeds from simpler, low-order statistical relations toward increasingly complex, context-dependent ones.
Jun-Jie Yao, Liangkai Hang, Zhi-qin John Xu· 0 citations
HalluPrism, a behavioral diagnostic that re-runs an answer after visual degradation, blank-image replacement, and grounding or relation checks is proposed, a behavioral diagnostic that separates failure diagnosis from abstention scoring.
A. Prakash, Sourish Dasgupta, Tanmoy Chakraborty· 1 citation