Skip to content

Author

Abdallah Khemais

We have 2 of 4 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Aug 2026

Cross-Layer Interaction under Weight-Space Ablation: A Closed-Form Attention Jacobian Bound and a Test on a Real Pretrained Model

A companion paper studies when activation patching and weight-space ablation agree, inside an idealized model where a conditional computation is carried additively through a residual stream. For the one composition in that model where two carriers are architecturally dependent, an attention head and its own layer's nor...

Abdallah Khemais · 1 citation
Preprint Aug 2026

A Theory of Conditional Collapse under Low-Rank Weight-Space Ablations: I. The Single-Block Theory and Synthetic Validation

An idealized model where a conditional computation is carried additively through a residual stream, F(x)=F_0(x)+\sum_i\alpha_i(x)v_i$, read out by a linear functional is studied, and three exact results are proved, including an exact first-order interaction formula with a provably second-order remainder.

Abdallah Khemais · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.