Skip to content

Unveiling Biomedical Question Answering Pathways in Large Language Models: An Interpretability Study with Circuit Discovery

· 0 citations · 24 references

TL;DR

This study applies mechanistic interpretability techniques to uncover and analyze computational circuits within LLMs during biomedical question answering, and employs Automatic Circuit Discovery in combination with Edge Attribution Patching to enable scalable circuit extraction beyond toy settings.

View source

Similar papers

Optimizing large language model prompts for biomedical knowledge discovery

This work presents a scalable, reproducible framework for evaluating, optimizing, and interpreting LLMs for biomedical knowledge extraction, with a focus on gene–gene regulatory relation prediction, pathway component recognition, multimodal pathway figure understanding, and automated prompt optimization.

Muhammad Azam · 0 citations
Conference Open access Sep 2026

THGAgents: Traceable Biomedical Hypothesis Generation via Dynamic Causal Reasoning

THGAgents utilizes collaborative and dynamically updating agents to build a Traceable Causal Knowledge Graph, which serves as the foundation for the evidence-based knowledge structure and employs an LLM-driven heuristic search algorithm to traverse the complex network, balancing both novelty and rigor to deduce strict,...

Ming-Jia Yang, Kun-Hua Dong, K. Lim et al. · 0 citations
Preprint Aug 2026

Circuit Discovery Helps Detect LLM Jailbreaking: A Mechanistic Interpretability Study

A mechanistic analysis of the jailbreaking behavior in a large-scale, safety-aligned LLM, focusing on LLaMA-2-7B-chat-hf identifies computational circuits responsible for generating affirmative responses to jailbreak prompts and uncovers key attention heads and MLP pathways that mediate adversarial prompt exploitation.

Paria Mehrbod, Boris Knyazev, Guy Wolf et al. · 0 citations
Review

Let Me Explain!

Text content is the dominant factor in annotation decisions, far outweighing annotator demographics, and that content-focused SHAP explanations are more effective than demographic persona prompting for guiding LLM annotations, showing that explainability methods can improve both the reliability and the transparency of...

Hadi Mohammadi · 0 citations
Open access Aug 2026

Enhancing clinical reasoning and diagnostic precision through scaling laws and multi-stage supervised fine-tuning in open-weight medical large language models

A robust technical framework is established for developing trustworthy, high-efficiency medical AI systems capable of operating entirely within hospital-controlled infrastructure by evaluating the synergistic impact of context window scaling and multi-stage supervised fine-tuning within a localized Retrieval-Augmented...

L. Pawlik, Stanisław Deniziak · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.