We have 4 of 5 papers
We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.
Not the right person? Other researchers publish under this name.
Softmax attention gives every token a nonzero weight, which in trained models concentrates into attention sinks and massive activations that widen the dynamic range low-precision inference must cover. Softpick removes this constraint by rectifying scores, eliminating sinks and lowering hidden-state kurtosis, but its ad...
An audit of SycEval, which reports that objections raised before a model answers (preemptive) cause more caving than those raised after (in-context), and attributes the gap to timing, and builds the missing comparison and tests it on multiple-choice questions and SycEval's own free-form pipeline.
This work proposes a scalable reinforcement-learning-based approach for rewriting existing source texts into instances that are more difficult to translate for MT systems, using a large language model with Group Relative Policy Optimization (GRPO) and fine-tune a large language model with Group Relative Policy Optimiza...
Spherical Soft-Masking (S-SM), a drop-in replacement that aggregates the top-(k) predictions with a Fr'echet mean on the hypersphere and blends this mean with the mask direction using spherical linear interpolation (SLERP), then restores the native mask norm.
We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.
