Memory enables language model assistants to maintain continuity across sessions and generate personalized responses, but knowing more about a user does not necessarily produce responses they prefer. Existing evaluations assess memory capabilities without directly establishing whether memory use benefits the user. To st...
Yijiang River Dong, Ze-Xue He, Cheng Yu et al.· 0 citations
This paper presents a dataset of 121,536 ground-reasons pairs across 86,464 rulings of the five civil chambers of the French Court of Cassation (2016-2025). An appeal on points of law cannot itself be appealed and often decides a case for good. Understanding how the Court rules is thus crucial and can help lawyers who...
Avrile Floro, Tamara Dhorasoo, Nils Holzenberger et al.· 0 citations
Reward models score responses for preference optimization, filtering and ranking, and pooling scores across prompts needs them to be comparable. Yet pairwise evaluation compares two responses to the same prompt, so any score component shared by a prompt's responses cancels and goes untested. We study this component by...
Mateusz Modrzejewski, Tomasz Radzikowski· 0 citations
Content warning: this paper quotes slurs and hateful statements from published test suites; the racial slur among them is masked.
Automated systems decide at scale which messages are harmful, and they decide unevenly. Classifiers label African American English as offensive up to twice as often as other English, the a...
Gabriel Lars Sabadin, Dr Nicola Harding, Sarah Kingston· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Ophthalmic clinical decision support requires fast, accurate, and privacy-preserving inference, yet autoregressive large language models (LLMs) incur substantial latency and computational overhead for decisions among predefined actions. We therefore investigate a decision-oriented alternative to generative reasoning. S...
Bo Liu, Lian-Yu Wang, Meng Wang et al.· 1 citation
This paper studies the local geometry of semantic meaning in large language models. Current representation analyses ask whether meanings are close in embedding space, or whether linear probes separate semantic classes, but they do not characterize the within-concept local geometry: what is invariant across realizations...
Text embedding and text generation are two of the most useful capabilities of modern large language models, yet they are typically provided by separate specialized models (an embedder and a generator) trained with incompatible objectives and deployed side by side in retrieval-augmented generation and agent systems. Rec...
Yang Liu, Zhi-Qiang Yuan, Shu-Dong Huang et al.· 0 citations
Large language models (LLMs) deployed in mental-health contexts can be evaluated for safety failures, but the resulting judgments are often difficult to inspect or explain. Common approaches to improving safety rely on prompt engineering, LLM-as-a-Judge, and Constitutional AI. In this work, we describe a clinician-led...
Chenhan Lyu, Kit Wislocki, Sarah Elizabeth Stoeckl et al.· 0 citations
Singular-value spectra encode important structure in transformer feed-forward projections, yet their causal role in downstream behavior remains underexplored. We study post-hoc spectral smoothing and spiking interventions on the up_proj and down_proj matrices. Positive perturbation stretches deviations from the geometr...
We present Protegrity-PII, a new PII decision model for structured and unstructured text. Protegrity-PII achieves a typed recall of 0.915 with a precision of 0.907 on a new benchmark we propose, PII-SCOPE. Our model processes text in 0.49 seconds per million characters at \$0.0005 per million characters on a single RTX...
Hardeep Bassi, Hui Ma, Lu\'is Seabra et al.· 0 citations
It is shown that similar aggregate scores can conceal substantial changes in individual verdicts, both when the same setup is repeated and when the instructions change.
Self-Assessment Reinforcement Learning (SARL), a reinforcement learning framework in which models learn to recognize their own search state during training and improve their search behavior accordingly, without requiring additional assessment at test time, outperforms methods built on auxiliary supervision or multi-age...
Taewhoo Lee, Min-Ju Song, Jungwoo Park et al.· 0 citations