Skip to content

Author

Ilya Koziev

3 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Sep 2026

Change the Product, Keep the Parameters: Associative Algebra Layers for Transformers

This work constructs a family with quadratic arithmetic in the matrix dimension when the physical block size remains fixed, and derive finite-shape constraints for GPU execution, and treats these results as a feasibility and trainability check for the proposed approach at small scale, leaving further investigation to f...

Ilya Koziev, I. Oseledets · 0 citations
#artificial intelligence Preprint Sep 2026

Zarya: A Hybrid Autoregressive--Masked Diffusion Language Model with Flexible Training and Dual-Mode Inference

Zarya is introduced, a family of hybrid language models that jointly optimizes an autoregressive (AR) objective and a masked-diffusion objective within a single architecture, demonstrating performance on standard benchmarks while offering a principled integration of autoregressive and diffusion paradigms.

Leonid S. Sinev, Ilya Koziev, Vladislav Leshchuk · 0 citations
#artificial intelligence Preprint Sep 2026

Evaluating Losslessness in Speculative Decoding Under Finite-Precision Inference

A gap between algorithmic losslessness and its implementation under finite-precision arithmetic is demonstrated and motivated, to motivate evaluating lossless speculative decoding at the level of exact generation trajectories as well as downstream task performance.

Ilya Koziev, Leonid S. Sinev, I. Oseledets · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.