Aug 2026· Zenodo (CERN European Organization for Nuclear Research)
Abstract
This paper analyzes the problem of the low practical efficiency of modern large language models (LLMs). We argue that the limiting factor is not a limit of the technology itself, but the organization of reasoning and the architectural role assigned to the language model. We claim no novelty for the "executor — overseer" scheme: analogous configurations have been described in the literature on multi-agent and self-verifying systems, and the field observation presented here is treated as an empirical illustration of a particular case of a more general hypothesis. The main contribution consists of four parts. (1) Diagnosis: a modern LLM is interpreted as the implementation of predominantly a single functional zone — the speech zone. Mind as a process is amodal and not bound to natural language; language is merely one of the serializers operated by the speech zone. (2) An architectural framework: a zonal-modular architecture with an explicit control circuit and with memory moved out into separate addressable zones — together with an ontogenetic program for its formation: zones and connections are grown in stages, in a sequence reproducing the stages of human cognitive development, with verification gates between stages, an offline consolidation phase ("sleep"), and an upbringing (alignment) stage built into the ontogeny with a graduation gate. (3) Experimental verification of two mechanisms of this program. Experiment 1 (training small transformers from scratch, two synthetic domains, four arms): staged formation with worked solutions and gates outperforms training on a shuffled corpus at an equal budget (+0.11 and +0.17 final-exam accuracy), and the accuracy gap between the training set and the exam falls from ~0.2 to ~0 — the model stores the rule rather than memorized answers. Experiment 2 (an agentic task stream): the cost of linearly accumulated context grows quadratically in the agent's lifetime horizon, while the cost of periodic consolidation grows linearly, at equal answer quality; the break-even point is reached already at short horizons. (4) A motivating field observation on a real engineering task, from which the hypothesis is derived. In this optic, modern LLMs are merely the first, speech zone of the future architecture; a full-fledged artificial mind requires building out the remaining zones operating outside language, a correct memory architecture, a coordinating circuit operating in an amodal medium, and a staged ontogeny with verification gates.
Supporting data, adapters, predictions and code for the article *Low-Cost LoRA Fine-Tuning of Small Language Models for Multi-Step Arithmetic Reasoning* by Jake O'Grady, Asena Isik Gürhan, Chee Fong Ting and Effirul Ramlan (University of Galway). We generated 20,000 GSM8K-derived arithmetic problems with step-by-step s...
O'Grady, Jake, Gürhan, Asena Isik, Chee, Fong Ting et al.· Zenodo (CERN European Organi...· 465 citations
The results are packaged in the Greenfield Startup Model (GSM), which explains the priority of startups to release the product as quickly as possible, and the need to shorten time-to-market, by speeding up the development through low-precision engineering activities.
Carmine Giardino, Nicolò Paternoster, M. Unterkalmsteiner et al.· IEEE Transactions on Softwar...· 178 citations· ⚡14
Software startup companies develop innovative, software-intensive products within limited timeframes and with few resources, searching for sustainable and scalable business models.
M. Unterkalmsteiner, P. Abrahamsson, Xiaofeng Wang et al.· e-Informatica Software Engin...· 157 citations· ⚡17
This study conducts a case survey study based on the secondary data of the major pivots happened in 49 software startups, and demonstrates that customer need pivot is the most common among all pivot types.
Sohaib Shahid Bajwa, Xiaofeng Wang, Anh Nguyen-Duc et al.· Empirical Software Engineeri...· 127 citations· ⚡15
The comparison of adopter and non-adopter sample reveals three potential adoption inhibitor, security, data privacy, and portability, which underlines the importance of the technical and security perspectives for research investigating the adoption of technology.
Nattakarn Phaphoom, Xiaofeng Wang, S. Samuel et al.· Journal of Systems and Softw...· 111 citations· ⚡8
This study investigates how Lean internal startup facilitates software product innovation in large companies and identifies its enablers and inhibitors, and shows the potential of the method-in-action framework to investigate the Lean startup approach in non-startup context.
Henry Edison, Nina M. Smørsgård, Xiaofeng Wang et al.· Journal of Systems and Softw...· 78 citations· ⚡6
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduOct 18, 2026
A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.
Microsoft Research Blog· microsoft.comOct 15, 2026
Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.