Skip to content

Author

Viacheslav Sinii

We have 3 of 11 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

ESSA: Evolutionary Strategies for Scalable Alignment

ESSA (Evolutionary Strategies for Scalable Alignment), a gradient-free online alignment stage that follows supervised fine-tuning (SFT) and replaces the gradient loop with inference-only black-box search, is presented.

Daria Korotyshova, B. Shaposhnikov, A. Malakhov et al. · 3 citations

F-GRPO: Don't Let Your Policy Learn the Obvious and Forget the Rare

A difficulty-aware scaling coefficient is proposed, inspired by Focal loss, that down-weights updates on high-success sampled groups and improves average math pass@256 in all three cases, without increasing group size or computational cost.

Daniil Plyusov, Alexey Gorbatovski, B. Shaposhnikov et al. · 9 citations · ⚡1

You Do Not Fully Utilize Transformer's Representation Capacity

Layer-Integrated Memory (LIMe) is introduced, a lightweight extension that leverages existing key-value buffers and learns per-head, per-layer routing weights to integrate representations from previous layers to improve perplexity per FLOP and yield strong gains on synthetic tasks while preserving higher value-vector e...

Gleb Gerasimov, Yaroslav Aksenov, Nikita Balagansky et al. · 4 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.