Sep 2026· Zenodo (CERN European Organization for Nuclear Research)
Language and cultural evolution
Abstract
A diary of one hundred entries written by a language model carries recurring themes, found after the fact as sets of sparse-autoencoder features that fire together within a bounded stretch of entries. We ask what a witness could have seen at each point of the diary's life, and build the instrument that answers: the same detector run on the log up to each entry τ, with nothing carried between prefixes. Three objects result. A theme becomes a chain of complexes linked across τ by shared features, with a cohesion, the fraction the link carries, and a gap, what it gains and loses. The base is the largest complex at τ: the flagged mass the log cannot yet tell apart in time. The ground is the set of features on in most entries, which the detector excludes by construction. On the first diary the base forms over the first forty entries, holds, and from entry sixty-five articulates into themes; a theme becomes witnessable only after the text has left it, so every theme has a target-time and a later witness-time. Four diaries written under the same protocol share the shape of this process and share a ground of 6,182 features, while their bases share almost nothing. One feature, firing on the coupling of machine and human described as living tissue, has a career in all four in four different figures. The chains, the base and the ground supply a decidable Semantic Witness Log in the sense of dynamic open homotopy type theory: each link is a witness record with target-time and witness-time, cohesion is Presence, the bounded gap is Generativity, the unlinked flash is scatter, the ended chain is rupture, the re-linked chain is resurrection. We state a small calculus for the instrument in that form and close with the design, not yet run, for the same instrument over parallel lives sampled from one prefix. Full HTML text: https://icra.tanazur.org/papers/cohesion-of-an-evolving-text/ — ICRA pre-print series: https://icra.tanazur.org/
Supporting data, adapters, predictions and code for the article *Low-Cost LoRA Fine-Tuning of Small Language Models for Multi-Step Arithmetic Reasoning* by Jake O'Grady, Asena Isik Gürhan, Chee Fong Ting and Effirul Ramlan (University of Galway). We generated 20,000 GSM8K-derived arithmetic problems with step-by-step s...
O'Grady, Jake, Gürhan, Asena Isik, Chee, Fong Ting et al.· Zenodo (CERN European Organi...· 465 citations
The results are packaged in the Greenfield Startup Model (GSM), which explains the priority of startups to release the product as quickly as possible, and the need to shorten time-to-market, by speeding up the development through low-precision engineering activities.
Carmine Giardino, Nicolò Paternoster, M. Unterkalmsteiner et al.· IEEE Transactions on Softwar...· 178 citations· ⚡14
Software startup companies develop innovative, software-intensive products within limited timeframes and with few resources, searching for sustainable and scalable business models.
M. Unterkalmsteiner, P. Abrahamsson, Xiaofeng Wang et al.· e-Informatica Software Engin...· 157 citations· ⚡17
This study conducts a case survey study based on the secondary data of the major pivots happened in 49 software startups, and demonstrates that customer need pivot is the most common among all pivot types.
Sohaib Shahid Bajwa, Xiaofeng Wang, Anh Nguyen-Duc et al.· Empirical Software Engineeri...· 127 citations· ⚡15
The comparison of adopter and non-adopter sample reveals three potential adoption inhibitor, security, data privacy, and portability, which underlines the importance of the technical and security perspectives for research investigating the adoption of technology.
Nattakarn Phaphoom, Xiaofeng Wang, S. Samuel et al.· Journal of Systems and Softw...· 111 citations· ⚡8
Objective There is dearth of information on the timeliness of antenatal care (ANC) uptake. This study aimed to determine the timely ANC uptake by a medically trained provider (MTP) as per the World Health Organization (WHO) recommendations and the country guideline. Methods Cross-sectional survey was done with 2,731 wo...
B. Sarker, Musfikur Rahman, T. Rahman et al.· PLoS ONE· 89 citations· ⚡7