Skip to content
Open access

Small Language Models and Spec-Driven Development for High-Accuracy Agentic AI Systems

Jun 2026 · International Journal of Intelligent Systems and Data Science · Vol 1 · 0 citations · 14 references

TL;DR

A hybrid architecture in which a lightweight dispatcher takes in structured tasks, which are routed to specialist LoRA fine-tuned SLMs, suggesting that specialized SLMs with explicit specifications and selective LLM fallback are a practical, scalable, and low-energy foundation for next-gen high-accuracy agentic AI systems.

Abstract

Agentic Artificial Intelligence (AI) systems are often designed with large language models (LLMs) that are assumed to achieve better performance on all tasks as they grow larger. This paper contradicts this belief by showing that small language models (SLMs), when combined with specification-driven development, are more accurate, consistent, and cost-effective than agent design in standard operations. We present a hybrid architecture in which a lightweight dispatcher takes in structured tasks, which are routed to specialist LoRA fine-tuned SLMs. The output generated is fed to a deterministic specification validator for verification. An LLM serves as a fallback for tasks that are out-of-distribution or too complex. This framework was evaluated on four representative agentic tasks: date extraction, JSON formatting, arithmetic reasoning, and schema-constrained tool calling. According to experimental results, the SLM-first consistently outperforms the LLM-only baseline significantly, showing accuracy improvement of 7.8% to 13.2%. Moreover, it achieves 7 times lower inference latency and almost an order of magnitude lower operational cost. Additionally, the proposed approach reports an output consistency of 99.8% as compared to the LLM baseline, which merely achieves 92%. This makes it suitable for production environments that demand predictable and reliable behavior. The findings suggest that specialized SLMs with explicit specifications and selective LLM fallback are a practical, scalable, and low-energy foundation for next-gen high-accuracy agentic AI systems.

Read PDF

Similar papers

Review

A Review on Test-Time Scaling for Agentic Large Language Models

A novel RAIE taxonomy along four scaling dimensions is proposed, which optimizes the entire thought process through search algorithms and self-verification, and introduces a task-oriented guideline for choosing the best TTS strategy.

Jiayu An, Zheng Chen, Yongcheng Jing et al. · 0 citations
Conference Jul 2026

Democratizing Autonomous Deep Research: A Neuro-Symbolic Framework for Small Language Models via Grammar-Constrained Decoding

The Agentic AI model consists of systems that can plan on their own, use tools and perform multi-step tasks. These capabilities have mainly been accomplished by large models, such as GPT-4 or Claude 3, are large language models LLMs have demonstrated skill with multi-step reasoning tasks. they have high computational requirements and increased latency. require considerable data transfer to centralized servers to them unsuitable for private, edge-based use. Open-source Small Models that implement SLMs have less than 13 billion parameters, a possible option for local execution. In agentic situations, however, these predictions are unreliable. However, they do not have a strictly defined syntax for calling tools interfaces, such as JSON schemas. They can also create other functions for long-sighted tasks exist or disappear when leading to meaningful failures.We designed a Neuro-Symbolic architecture for deterministic control layer to improve the frozen, quantized SLMs. Our proach consists of two major components: [1] a recursive "Critic-Planner" feedback loop that filters out noisy retrieval results before they affect the agent’s limited working memory. [2] At inference-time, Grammar-Constrained Decoding (GBNF) focuses on conforming to JSON schema at the logit level, enforcing syntactic correctness of tool interactions.We apply our framework to the quantized Llama-3-8B. Mistral-7B and Phi-3-mini within six domains. including technical analysis to ensure legal compliance. thesis. Our system achieved a 100% syntactic accuracy baseline correctness and completed complex tasks effectively. In contrast, strong industry standards, including LangChain ReAct, failed. to format issues.

Akshay Kumar, Annson D'Souza, Dhanush S. Shet et al. · 0 citations
Review Open access Aug 2026

From Language Models to Agentic AI: A Survey of Autonomous, Action-Enabled, and Collaborative LLM Agents

Large Language Model (LLM)–based agents are rapidly evolving from passive assistants into autonomous, tool-using, and collaborative systems capable of executing complex, long-horizon tasks across web, software, and physical environments. However, the current literature remains fragmented, with inconsistent terminology, ad hoc architectures, and limited evaluation standards, making it difficult to compare systems or deploy them reliably in real-world settings. This paper presents a unified, taxonomy-driven, and deployment-oriented survey of agentic AI systems, synthesizing recent advances through a modular reference architecture and a four-dimensional taxonomy that characterizes agents along the axes of autonomy, tool use, collaboration, and safety–governance. We systematically analyze representative single-agent, tool-augmented, and multi-agent frameworks within this taxonomy, highlighting design trade-offs, capability scaling patterns, and recurring failure modes. Beyond architectural analysis, we review emerging evaluation methodologies that move beyond static benchmarks to assess agent behavior, robustness, grounding, and operational cost in interactive environments. Importantly, the survey emphasizes practical considerations for enterprise and safety-critical deployment, including access control, human-in-the-loop oversight, and policy enforcement. By unifying conceptual foundations with empirical trends and deployment constraints, this work provides a structured roadmap for researchers and practitioners to design, evaluate, and govern next-generation LLM-based agentic systems.

Sparsh Bajoria, Shreyanshu Ranjan, Adhitya M et al. · 0 citations
Open access Sep 2026

Automating Plan Evaluation Using Agentic Large Language Models

Manual plan evaluation faces reliability and scalability challenges. This research benchmarks human evaluations against a large language model (LLM) using a multi-agent approach and/or retrieval-augmented generation (RAG) to automate complex content analysis tasks. We find that LLMs generally perform comparably with humans, with most errors arising from overimplication and limited domain knowledge. The multi-agent approach substantially enhances LLM’s performance, reducing common machine errors by over 50 percent. Integrating such LLM tools with human oversight will likely become the new norm for content analysis, and this study demonstrates how to leverage artificial intelligence’s (AI) efficiency and precision alongside humans’ contextual understanding and domain expertise.

Xinyu Fu, Chaosu Li · 1 citation
Preprint Jul 2026

RF-Agent: A Practical Framework for Building Language Agents for RFIC Design

Large language models (LLMs) have driven rapid progress in electronic design automation (EDA), yet their application to radio-frequency (RF) circuit design remains limited by the scarcity of domain-specific datasets and standardized benchmarks. We present RF-Agent, which addresses this gap through textbook-driven knowledge distillation. A multi-agent Question-Thinking-Solution-Answer (QTSA) pipeline converts a subsection-level corpus from seven canonical RF textbooks into the first-of-its-kind RF-domain reasoning dataset (over 11,000 samples) with a dedicated multiple-choice benchmark. On this benchmark we study two adaptation strategies: supervised fine-tuning (SFT) and three retrieval-augmented generation (RAG) configurations (semantic, keyword, hybrid). Across multiple LLM families, domain-specific SFT significantly improves RF reasoning, especially for small and medium-sized models; among RAG configurations, semantic retrieval performs best, indicating embedding-based context alignment suits RF reasoning better than naive fusion. The dataset and benchmark provide a reusable foundation for future work on LLM-aided RF circuit design.

Yueqi Xing, Houbo He, Jolie Wang et al. · 0 citations