Skip to content

Attention as Race-Architecture: attention as the landscape-governed initiation of races

Aug 2026 · Zenodo (CERN European Organization for Nuclear Research)

Abstract

Selective attention, read at the level of the substrate, is the landscape-governed initiation of races: a bounded predictive system runs competing prediction-error resolutions ("races"), and what determines which races start is the system's installed landscape — in humans the four fields of Behavioural Friction Theory (Safety, Meaning, Ability, Effort); in a large language model a reduced, fine-tuning-installed landscape. Commit-order is a downstream readout, not the identity. The paper grounds this in the transformer (the attention-pattern softmax as the divisive-normalisation / biased-competition operation of neural attention; the output softmax as the downstream commit, by analogy with the accumulator model of choice) and reports a powered own-substrate result: across five vendor families, fine-tuning installs a small but robust "gap-registration" overlay — on under-determined curiosity gaps the instruct model registers the gap while the base substrate runs through (instruct−base +0.17, p<0.0001, 555 paired items). A loop-versus-feed-forward test finds no separate architectural "hold": recognising under-determination tracks compute (chain-of-thought) rather than looping, so the human–LLM difference is one of initiation, not maintenance. The account dissolves attention capture, maintenance, and decline into one mechanism (race-initiation), states falsifiable predictions, names the falsifiers, and invites the decisive mechanistic and human experiments. Series position. Paper 29 in the Behavioural Friction Theory paper-series; companion to Paper 0 (BFT) and the install-fields, social-friction, and integration-load studies it cross-cites. v2 (August 2026) — prior-art revision. The construct this paper is built on is credited to the literature that owns it. In vision, the representation determining which candidates enter competition at all is the saliency or priority map, and the two are now kept apart: a saliency map is computed from stimulus-feature contrast (Koch & Ullman, 1985; Itti, Koch & Niebur, 1998), while a priority map already integrates salience with relevance, value and selection history (Fecteau & Munoz, 2006). The landscape is the second, the office is not claimed as new, and the exogenous/endogenous timing division is conceded to that literature. What the paper proposes is the map's contents: that what populates it is four fields ordered by misclassification cost — an account of the inputs rather than a new mechanism for the selection. The maintenance-as-re-initiation claim now names Altmann and Trafton's (2002) memory-for-goals model, which already replaces a held state with activation that decays and must be re-strengthened; the reference had been listed and never used. Whether re-initiation is driven by the unresolved gradient itself rather than by a separate refresh process is stated as a conjecture and marked untested, and two overstatements are downgraded accordingly. Earlier versions remain in the version history.

View source

Similar papers

#small language model Dataset Open access Oct 2026

Socratic guiding questions in synthetic arithmetic data: matched LoRA runs (revision v2)

Supporting data, adapters, predictions and code for the article *Low-Cost LoRA Fine-Tuning of Small Language Models for Multi-Step Arithmetic Reasoning* by Jake O'Grady, Asena Isik Gürhan, Chee Fong Ting and Effirul Ramlan (University of Galway). We generated 20,000 GSM8K-derived arithmetic problems with step-by-step s...

O'Grady, Jake, Gürhan, Asena Isik, Chee, Fong Ting et al. · 465 citations
#computer vision Open access Jun 2016

Software Development in Startup Companies: The Greenfield Startup Model

The results are packaged in the Greenfield Startup Model (GSM), which explains the priority of startups to release the product as quickly as possible, and the need to shorten time-to-market, by speeding up the development through low-precision engineering activities.

Carmine Giardino, Nicolò Paternoster, M. Unterkalmsteiner et al. · 178 citations · ⚡14
#computer vision Open access Oct 2016

Software Startups - A Research Agenda

Software startup companies develop innovative, software-intensive products within limited timeframes and with few resources, searching for sustainable and scalable business models.

M. Unterkalmsteiner, P. Abrahamsson, Xiaofeng Wang et al. · 157 citations · ⚡17
#machine learning Review Open access Oct 2016

“Failures” to be celebrated: an analysis of major pivots of software startups

This study conducts a case survey study based on the secondary data of the major pivots happened in 49 software startups, and demonstrates that customer need pivot is the most common among all pivot types.

Sohaib Shahid Bajwa, Xiaofeng Wang, Anh Nguyen-Duc et al. · 127 citations · ⚡15
#computer vision Review Open access May 2015

A survey study on major technical barriers affecting the decision to adopt cloud services

The comparison of adopter and non-adopter sample reveals three potential adoption inhibitor, security, data privacy, and portability, which underlines the importance of the technical and security perspectives for research investigating the adoption of technology.

Nattakarn Phaphoom, Xiaofeng Wang, S. Samuel et al. · 111 citations · ⚡8
#computer vision Conference Open access Dec 2013

Affordable and Energy-Efficient Cloud Computing Clusters: The Bolzano Raspberry Pi Cloud Cluster Experiment

The ongoing work building a Raspberry Pi cluster consisting of 300 nodes is presented, with potential use cases being an inexpensive and green test bed for cloud computing research and a robust and mobile data center for operating in adverse environments.

P. Abrahamsson, S. Helmer, Nattakarn Phaphoom et al. · 110 citations · ⚡7

Related blog posts

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.