Author

El Houcine Bergou

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Oct 2026

Binary Cyclic Gradient Coding: Exact Recovery and Robustness to Compression

We introduce binary cyclic gradient coding (BCGC), an exact gradient coding scheme for $n$ workers and up to $s$ stragglers. Its encoding matrix is binary, circulant when $(s+1)\mid n$ and nearly circulant otherwise, and the master decodes by a single summation. Like the fractional repetition coding scheme (FRC) and it...

Hassan Ou-azzou, Imad Kissami, El Houcine Bergou · 0 citations

#machine learning Preprint Oct 2026

TACO: Ternary Absolute-max Column-wise One-sparse Optimizer for LLM Fine-Tuning

Full-parameter fine-tuning of large language models (LLMs) incurs substantial optimizer state memory overhead, limiting the model sizes that fit on modern GPUs. Existing approaches either compress optimizer state, abandon first-order gradients, or change the update geometry while retaining dense state. The recently int...

Ji-Chao Jiang, Cristian McGee, El Houcine Bergou et al. · 0 citations