Mechanistic Interpretability and Explainable AI (XAI) in Foundation Models: Reverse-Engineering Circuits, Superposition, and Safety Bounds
Abstract—Foundation models, particularly autoregressive Transformer Large Language Models (LLMs) and Vision-Language Models (VLMs), have exhibited unprecedented reasoning and generative capabilities across computer science and engineering. However, their internal representations operate as opaque, high-dimensional 'bla...
Vinay Kumar Patidar, Dr. Vishal Shrivastava, Dr. Akhil Pandey et al.
· Zenodo (CERN European Organi... · 0 citations