Category
3,445 papers
Large language models are often asked which input factors influenced their outputs. For structured inputs, such reports can be checked by counterfactual perturbation, but each factor must be queried multiple times to estimate its effect, so verification is usually budget-limited. We study how this limited-budget settin...
A stylometric approach to 137,293 decisive French-language votes from the July 2026 Compar:IA release is taken, taking a stylometric approach to the raw ranking with rankings adjusted for formatting, length, readability, vocabulary variety, and sentence structure.
Large language models (LLMs) are widely used for claim verification, yet remain brittle for numerical reasoning: even small changes in value can sharply degrade accuracy. We show that this brittleness persists in frontier LLMs, but can be mitigated through adversarial fine-tuning on numerically perturbed examples. Usin...
Bengali secondary education lacks curriculum-grounded benchmarks for STEM question-solving, and general-purpose language models struggle with the precise terminology, unit conventions, and derivations that physics problems demand. We introduce PhysicsMate, a benchmark of 1834 question-answer pairs built from the Nation...
Reach audiences
Advertise in front of researchers, engineers, and readers.
An algorithm is designed that learns to separate representations of content and style from language models' outputs and validate its effectiveness on math questions in a controlled setting, finding that style affects correctness: the probability of solving a problem depends on the style the authors condition on, and di...
Autonomously constructing physically realizable 3D structures remains a significant challenge due to combinatorial action spaces, interchangeable components, equifinal assembly sequences, and strict stability requirements during construction. State-of-the-art methods fine-tune large language models for text-based gener...
Full-parameter fine-tuning of large language models (LLMs) incurs substantial optimizer state memory overhead, limiting the model sizes that fit on modern GPUs. Existing approaches either compress optimizer state, abandon first-order gradients, or change the update geometry while retaining dense state. The recently int...
Ablate a component of a language model, and other components often appear to adjust and compensate. This phenomenon, termed self-repair, has been observed repeatedly, but its mechanism remains unclear. The most systematic study to date concluded that self-repair is noisy and unlikely to have a single explanation. We ar...
Should low-precision transformer inference use stochastic rounding (SR) or round-to-nearest (RN)? The answer depends on where in the network you look. We isolate this effect by holding the numerical format fixed and varying only the rounding rule at individual operation sites. To enable experiments at freely chosen pre...
QLoRA and 4-bit quantization reduce PLM computational requirements, particularly GPU memory usage, and support QLoRA as a first-pass strategy for memory limited adaptation, reserving full fine-tuning for challenging tasks, unstable architectures or low validation recovery.
Mixture-of-Experts (MoE) models enable parameter scaling with limited per-token computation by activating only a small subset of experts for each token, but deploying them still requires loading the complete expert pool into memory. Structured expert pruning can effectively reduce the memory usage by removing experts....
Data selection is critical for training large language models on massive and heterogeneous corpora. Meta-learning for Training-data Selection offers a principled alternative to heuristic scoring by learning data weights from a target validation objective, but existing methods face a trade-off between fine-grained valua...
A Blog post by IBM Granite on Hugging Face
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Gemini 4 Carbon is our strongest model with state-of-the-art cybersecurity and long horizon capabilities.
A Blog post by Liquid AI on Hugging Face
Genie 4: our new world model unlocking unprecedented realism in real-time simulation.
Generative AI
We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.
