Skip to content

Learning Lookahead Lemmas for Neural Network Verification

Jul 2026 · arXiv.org · Vol abs/2607.29051 · 0 citations · 35 references
Computer Science

TL;DR

An inprocessing framework for neural network verification driven by the lookahead procedure is introduced, which derives new lemmas over the phases of unstable ReLUs, which are collected into an implication graph that is used to prune the search space and vivify boolean cuts.

Abstract

State-of-the-art neural network verifiers use the branch-and-bound procedure as their core solving mechanism. We introduce an inprocessing framework for neural network verification driven by the lookahead procedure. Under this framework, lookahead derives new lemmas over the phases of unstable ReLUs, which are collected into an implication graph that is used to prune the search space and vivify boolean cuts. We instantiate the framework in two state-of-the-art verifiers, Marabou and $\alpha$-$\beta$-CROWN, and demonstrate that it improves performance in both, proving up to 34% more instances unsatisfiable.

View source

Similar papers

Conference Jul 2026

Lookahead Branching for Neural Network Verification

This work presents a general recipe to integrate lookahead into any branch-and-bound verifier and demonstrates how one of the current state-of-the-art branching heuristics, FSB, can be viewed as a special instantiation of the lookahead branching strategy.

Liam Davis, Duo Zhou, Huan Zhang et al. · 1 citation
Preprint Aug 2026

Branch and Bound for Relational Verification of Neural Networks

A branch-and-bound framework to mitigate the issue of verifying relational specifications against relational specifications, which iteratively splits the problem until all sub-problems are verified, and devise a relational neuron selection strategy based on the dual formulation of the verification problem.

Kota Fukuda, Zhen-Ya Zhang, Guan-Qin Zhang et al. · 0 citations
Preprint Aug 2026

Uncovering the Limits of Proof Sharing for Neural Networks

This study shows that template subsumption rates can vary widely across scenarios, and presents FastCert, a novel technique for automatically distributing templates across neural network layers to increase performance impact, eschewing templates entirely if they are unlikely to produce a speedup.

Kanak Das, Shubham Ugare, B. E. Chang et al. · 0 citations

A Conflict-Aware Learning Approach to SCA Verification for MAC Architectures

This work designs an SCA-based proof engine that exploits a conflict-aware learning approach that compresses the intermediate polynomial expression and successfully verifies circuits that remained unverifiable using previous approaches.

Jan Kleinekath ̈ofer, Lennart Weingarten, Kamalika Datta et al. · 1 citation
Aug 2026

VeRe: Verification Guided Fault Localization and Repair Synthesis of Deep Neural Networks

VeRe is proposed, a verification-guided repair framework that leverages linear relaxation to precisely and efficiently estimate the repair significance of neurons and synthesizes ideal intervals that provide sound guarantees for correct behaviors, thereby facilitating surgical and targeted adjustments of neuron paramet...

Jia-Nan Ma, Wei Chen, Pengfei Yang et al. · 0 citations
Preprint Aug 2026

PPDL: LLM-Based Flows as Probabilistic Programs

Building reliable applications that leverage large language models (LLMs) remains a significant challenge. While LLMs offer impressive capabilities across diverse tasks, their outputs often lack accuracy and provide no clear measure of confidence. This uncertainty compounds in flows of multiple calls to LLMs and other...

Louis Mandel, Guillaume Baudart, M. Vaziri et al. · 0 citations

Related blog posts

Microsoft Research Blog Jul 13, 2026

Verifying Rust cryptography in SymCrypt, from standards to code

Cryptographic code supports vital protections in modern computing systems. Learn how a new method helps verify code as developers write it while preserving speed and adaptability as it gets implemented and evolves. The post Verifying Rust cryptography in SymCrypt, from standards to code appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.