Skip to content
Preprint

MaSRead: Content-Addressed Reading of Replicated Latent Stores

Jul 2026 · 0 citations · 42 references
Computer Science

TL;DR

A replicated latent store becomes selectively readable for later queries when the needed fragments connect to the query through content, and a replicated latent store becomes selectively readable for later queries when the needed fragments connect to the query through content.

Abstract

Independent agents that reason in latent space can share computed state as key-value cache fragments rather than text. Merged by a conflict-free replicated data type, these fragments form a store that converges under any delivery order or duplication. Yet a later query, unknown at encode time, cannot reliably read the merged cache: colocated fragments interfere, so colocation is not addressability. MaSRead addresses the read to content. It routes through opaque keyed tag sets derived from fragment words and decodes each selected fragment under a hard attention mask that hides the rest. Under lexical connectivity, a graph walk reaches the fragments required by a multi-hop query. Across chain, pipeline, symmetric, hub, and natural-language stores, MaSRead recovers visited fragments in isolation, remains effective as unrelated fragments accumulate, and transfers to another model family. After routing, materialized decoding depends on fragment length rather than total store size; end-to-end work still includes store-dependent routing and one read per visited fragment. The limits are explicit: lexical routing can miss disconnected evidence, and answer composition remains bounded by the frozen reader. Thus a replicated latent store becomes selectively readable for later queries when the needed fragments connect to the query through content.

View source

Similar papers

#artificial intelligence Preprint Sep 2026

TAGGRAPH: Tag-Augmented Graphs for Graph Retrieval of Agent Persistent Histories

Long-term memory lets LLM agents recall past interactions and remain consistent across sessions, but memory systems are hard to compare because they often vary in representation, indexing, retrieval, and evaluation. We present a controlled evaluation framework based on shared 5W-style conversational memories. Localized...

Yu-Shu Chen, Yuxuan Liang, Peng-Tao Xie · 0 citations
#natural language process... Preprint Sep 2026

PARSER: Read in Parallel, Reason in Depth for Long-Context LLM Agents

PARSER, which decouples reading from reasoning, is introduced, which is robust to perturbations in evidence position, order, and distance, conditions that cause large accuracy swings in sequential methods, while reducing inference latency by up to 11x.

Kun Li, Ze-Xuan Qiu, Tian-Hua Zhang et al. · 0 citations
#natural language process... Preprint Sep 2026

ATTUNER: Recomputation-Free KV Cache Reuse via Query-Side Adaptation

Large language model (LLM) agents repeatedly load reusable content, such as skills, documents, and memory entries, into the current context. Re-encoding this content for every request wastes computation. Position-independent caching (PIC) alleviates this by encoding each artifact independently and reusing its key-value...

Xing-Hao Chen, Jun-Nan Dong, Cai Ke et al. · 0 citations
#machine learning Preprint Sep 2026

REVA: Reusable Evidence View Aggregation for Context-Efficient RAG Serving

This work revisits RAG compression from a data-mining perspective by aggregating historical query--document--model interactions into reusable evidence views and proposes Reusable Evidence View Aggregation (REVA), a framework that mines the target generator's historical attention traces into a document-keyed, budget-agn...

T. Nguyen, Qi-Ran Hu, Ban-Ruo Liu et al. · 0 citations
#machine learning Preprint Sep 2026

CommunityKV: Efficient Long-Context Decoding via Graph Partitioning

Scaling Transformers to long contexts is constrained by the quadratic cost of self-attention and the linear growth of key-value cache memory transfer. Sparse attention mitigates this by retrieving only relevant tokens, but current approaches either require large-scale training or, within the training-free regime, rely...

Joe McKenna, Anastasios Alexandridis, Nathan Susanj et al. · 0 citations
Preprint Aug 2026

Dual-Cache Latent Space Communication between Heterogeneous Language Models

XKV is introduced, which lifts all three restrictions on multi-agent LLM answering: learned-query attention pools both caches; self-attention over receiver-aligned layer tokens, with a learned layer map reconciling different depths, mixes the pooled summaries into a compact joint memory.

Ji-Yao Liu, Qi Zhang, Yaoyi Jia et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.