This study shows that NeuroSTAR can capture the necessary temporal semantics in 83.9% of the driving law sections, which demonstrates the effectiveness of automata-guided reference-free refinement in formalization.
Abstract
Automated translation of natural language (NL) descriptions into Linear Temporal Logic over finite traces (LTLf) is a prerequisite for automated formal verification of a system's dynamic behavior. Several LLM-based methods have recently shown potential for this task. However, they struggle with the nuance of natural language descriptions, which can lead LLMs to only partially capture the intended meaning. To address this limitation, we propose NeuroSTAR (Automata-guided Neuro-symbolic Specification Formalization), an NL-to-LTLf framework that builds on two insights. First, it leverages multiple generators to obtain diverse LTLf candidates. Second, it uses an automata-theoretic semantic comparison based on DFA traces to identify behavioral disagreements that guide formula refinement. We evaluate NeuroSTAR and show that it improves NL-to-LTLf translation performance by 8-18 percentage points relative to the prior state-of-the-art (SoTA) on unambiguous benchmarks. We further study its applicability to a body of driving law text, a complex, realistic, and reference-free domain critical for autonomous-vehicle specification. This study shows that NeuroSTAR can capture the necessary temporal semantics in 83.9% of the driving law sections, which demonstrates the effectiveness of automata-guided reference-free refinement in formalization.
This paper introduces NEUROTESTGEN, a hybrid approach that integrates symbolic execution with LLM-driven test synthesis to generate test cases targeting on-demand code coverage and incorporates an iterative feedback loop that validates LLM-generated tests and provides corrective guidance until the target line or branch...
Rui-Xin Zhang, Jiho Shin, H. Pham et al.· 0 citations
This paper proposes a neuro-symbolic framework that combines large language model (LLM)-driven task planning with formal symbolic verification and reactive Behavior Tree execution to support high-precision operations in industrial assembly. While Large Language Models (LLMs) demonstrate expertise in interpreting natura...
Dario Antonelli, Xiao-Lin Yang, L. Urbani et al.· Applied Informatics· 0 citations
Authoring OCL constraints manually in Model-Driven Engineering is error-prone. While Large Language Models offer a potential solution for automated synthesis, they suffer from structural and semantic hallucinations. Current LLM-based approaches primarily target statistical translation accuracy, lacking formal guarantee...
Yu Ding, Hao Wu· Proceedings of the ACM/IEEE...· 0 citations
Large language models (LLMs) are increasingly deployed in safety-critical settings, yet their black-box nature makes it difficult to provide formal guaranties about their behavior. Existing verification approaches rely primarily on empirical probing and testing, leaving open the question of how to reason rigorously abo...
Smayan Agarwal, Aslah Ahmad Faizi, Shobhit Singh et al.· 0 citations
A neuro-symbolic framework that cleanly decouples reasoning into two formal dimensions: Symbolic Validity and Semantic Groundedness is proposed, which significantly improves reasoning reliability without the sprawling heuristics of prior frameworks.
Yu-Xin Zi, Cong Xu, Suparna Bhattacharya et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.