Skip to content

SGAnalog: An End-to-End Circuit Benchmark from Open-Source Silicon Tapeouts

Oct 2026 · 0 citations · 16 references
Computer Science

TL;DR

A benchmark built from human-designed, open-source circuits associated with Tiny Tapeout manufacturing shuttles is introduced, exposing distinct visual and design capabilities and, in one family, a policy rather than capability limit.

Abstract

Existing analog integrated circuit design benchmarks make two questions hard to answer: whether a model has learned transferable circuit skills rather than recalled familiar examples, and whether its output works under defined process and test conditions. We introduce a benchmark built from human-designed, open-source circuits associated with Tiny Tapeout manufacturing shuttles. The collection contains 273 topologically distinct top-level designs. Every source is retrieved at the revision recorded for its shuttle submission and processed in a fixed containerized environment. The pipeline exports each eligible schematic image and its SPICE netlist from the same source file, giving transcription an exact structural reference. Commit dates support model-specific training-cutoff analysis, while author testbenches provide the simulation context for sizing. The benchmark evaluates schematic-to-netlist transcription and device sizing. Across seven models on a fixed set of 66 transcription tasks, the strongest model reaches 56.1% exact graph isomorphism, and six of seven models drop sharply from the small to the medium tier. For one frontier model, removing author-chosen labels reduces exact matches while preserving aggregate structural F1, suggesting that labels can aid connectivity tracing. On the 17 sizing tasks, the leading model converges on all 17 proposals and reaches 91.2 out of 100 against the human reference, while the two newest Claude models refuse 4 and 11 of the same prompts they transcribe without objection; a proposal without sizes scores zero. The two tasks produce different model rankings, exposing distinct visual and design capabilities and, in one family, a policy rather than capability limit.

View source

Similar papers

#artificial intelligence Preprint Sep 2026

PerfReasoning: How Well Do LLMs Reason on Hardware Performance?

PerfReasoning is introduced, a benchmark that evaluates LLMs both as direct performance reasoners and as generators of analytical performance-model code, exposing the gap between plausible architectural reasoning and reliable performance-model construction.

Da Zhao, K. Sankaralingam, Christos Kozyrakis et al. · 0 citations
#artificial intelligence Preprint Oct 2026

LOADBench: A Large Open Analog Dataset and Benchmark for Machine Learning in IC Design

Machine learning (ML) for analog IC design is constrained by limited open data and the absence of standardized evaluation: results reported in different papers are typically obtained on bespoke, often closed, datasets and with ad-hoc metrics, leaving comparisons across methods unreliable. We address both gaps with a la...

M. Leibl, F. Azevedo, S. Uhlich et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Long-Horizon Analog Design Bench: Benchmarking Agents on Hours-Long Analog and Mixed-Signal Circuit Design Tasks

Coding agents now sustain hours-long, tool-driven loops, yet their ability to carry long-horizon analog and mixed-signal circuits to electrical specification remains unmeasured. We introduce Analog Design Bench, a long-horizon agentic benchmark of 50 transistor-level design tasks contributed by 17 chip designers. Agent...

Analog Design Bench Team · 0 citations
#machine learning Preprint Oct 2026

CircuitGate: Logic-Consistent Circuit-Level Functional Modeling for And-Inverter Graphs

CircuitGate is proposed, a function-aware AIG representation learning framework that advances from gate-level semantics to circuit-level functional modeling, and achieves the best equivalent-gate identification performance, demonstrating strong cross-dataset generalization.

Qi-Fan Zhang, Rui-Jie Li, Fang-Zhou Zhang et al. · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.