Probes are routinely paired with an intervention: ablate the direction the probe found, run the model, and read the change in task accuracy, taking a large drop as evidence that the computation depends on what the probe read and a near-zero drop as evidence that it does not. Either inference requires that the ablation...
The Muon optimizer has recently offered a promising alternative to AdamW for large language model training, leveraging matrix orthogonalization to produce geometry-aware updates. However, like all first-order methods, Muon can become trapped in sharp local minima. In this work, we present MONA, an optimizer that bridge...
Jiacheng Li, Jianchao Tan, Hongtao Xu et al.· 0 citations
Comprehensive evaluations on real-world benchmarks demonstrate that LOKI consistently outperforms state-of-the-art multi-modal data discovery approaches, and materializes typed integrated tables with 0.982 macro typed-pair precision while being up to 40 times cheaper in LLM API cost than direct prompting.
Face/Off is introduced, a semantics-preserving identifier-renaming framework, and progressive naming conditions across multiple models and code-comprehension tasks are evaluated, revealing a systematic vulnerability in how current LLMs balance lexical cues against program structure.
Xin-Peng Shen, San-Zhuo Xi, Ya-Li Du et al.· arXiv.org· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Post-training quantization and pruning rely on a small calibration corpus. Whether specialized domains such as finance require domain-matched calibration data remains unsettled. We argue that the answer depends on the task-level damage caused by compression rather than on domain mismatch. If compression preserves the t...
Junyi Ye, Mengjia Yu, Debapriya Hazra et al.· 0 citations
Remote-sensing (RS) multimodal large language models (MLLMs) are trained and evaluated only in English, while text-only instruction data covers over 100 languages. We propose MODL (Mutually Orthogonal Domain-Language composition), a recipe that adds new languages to an English RS MLLM without a single multilingual RS e...
Diffusion Large Language Models (dLLMs) have recently emerged as a promising alternative to conventional Auto-Regressive (AR) Large Language Models (LLMs). By leveraging bidirectional attention and parallel decoding, dLLMs enable more efficient generation. However, they require a carefully designed denoising scheduler...
Zijian Zhao, Dian Jin, Xialiang Tong et al.· 0 citations
MAttr is viewed as a successful formulation of interpretability into a learnable objective that can be tackled with gradient descent, and is encouraged to encourage future work along these lines.
Aryaman Arora, Kirill Acharya, Nathan Hu et al.· 1 citation
Central bank press conferences are not merely information releases --- they are structured narratives. We study whether the shape of sentiment within a statement, not just its average tone, carries policy-relevant signals. Constructing sentiment arcs for ECB and Fed press conferences along three dimensions --- monetary...
Martin Feldkircher, Márton Kardos, K. Nielbo· 0 citations
Numerically equivalent word problems should yield the same canonical answer whether a quantity is written as a decimal, fraction, percentage, number word, scientific notation, or an exactly converted unit, and five open-weight systems are evaluated.
Text classifiers trained on the ISOT/Kaggle "Fake and Real News"corpus routinely report accuracy and F1 above 0.98, which concludes that within-corpus scores here quantify source and topic separability rather than veracity, and is recommended metadata-only, small-sample, and topic-disjoint baselines as inexpensive diag...
Human feedback can vary in cost and informativeness. Strong feedback can reveal severe errors but is costly, so cheaper quality ratings can help decide which items to annotate. We propose MICRO (Multi-Fidelity Impact Clustered Rollout), an active search framework that allocates a shared budget to these feedback types t...
Orlando Leone, Niclas Pokel, P. Moure et al.· 0 citations
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.