Aug 2026· ACM Transactions on Embedded Computing Systems· 0 citations· 9 references
TL;DR
This paper introduces a job-level dynamic cache allocation strategy for multicore systems in which critical real-time tasks execute on a dedicated core while sharing the LLC with best-effort workloads executing on the remaining cores.
Abstract
Efficient management of shared cache resources is a key challenge in multicore real-time systems. Mechanisms such as Intel’s Cache Allocation Technology (CAT) enable software control over last-level cache (LLC) partitions, providing opportunities to reduce interference and tighten worst-case execution time (WCET) bounds. Existing approaches typically rely on static cache allocation, which can lead to over-provisioning and inefficient cache usage. This paper introduces a job-level dynamic cache allocation strategy for multicore systems in which critical real-time tasks execute on a dedicated core while sharing the LLC with best-effort workloads executing on the remaining cores. We formulate the allocation problem as a constraint-based optimization model that simultaneously enforces schedulability constraints, cache capacity limits, and preemption-induced concurrency. By allocating and releasing cache partitions at job boundaries, our approach adapts to temporal variations in job activity, minimizing the cache dedicated to critical tasks while preserving their schedulability. Through evaluation on synthetic task sets, we show that job-level dynamic allocation improves schedulability and systematically increases the cache available to non-critical tasks compared to task-level static or dynamic strategies. Moreover, it often requires fewer allocation operations, indicating that increased flexibility does not entail higher runtime overhead. These results demonstrate that job-level cache allocation is a promising direction for efficient and predictable resource management in multicore real-time systems.
The results show that soft SLO limits reduce corrective rescheduling actions by 49% compared to hard-limit approaches while maintaining acceptable performance guarantees, and resource-aware scheduling decreases node-level congestion and further mitigates SLO violations, demonstrating the effectiveness of incorporating...
Oliver Larsson, Thijs Metsch, Cristian Klein et al.· 0 citations
This paper presents an optimal approach for multi-resource systems that allow any given task to use up to two resources, including support for nested critical sections, achieved by extending analysis to multiple resources and constructing a Quadratically-Constrained Integer Program to determine critical sections.
Catherine E. Nemitz, Tanya Amert, Jonad Pulaj· Euromicro Conference on Real...· 0 citations
Experimental results on SPEC CPU benchmarks show that MPORA delivers accurate predictions under unseen inputs and distribution shifts with low overhead, while improving schedulability and response times over existing methods.
Abby Eisenklam, G. CarlosA.Montenegro, Xian Wang et al.· Euromicro Conference on Real...· 0 citations
CacheFlow is presented, a framework that formulates total CRPD as a maximum-flow problem, and an iterative max-flow formulation is described to more efficiently integrate the max-flow solving in the context of standard fixed-priority response-time analysis.
Tiancheng He, Bryan C. Ward· Euromicro Conference on Real...· 0 citations
The lack of determinism restricts the integration of safety-critical applications into Edge–Fog–Cloud (EFC) architectures. Existing EFC schedulers are typically designed for dynamic, best-effort operation based on unmanaged resource allocation and elastic virtualization. This paradigm introduces unbounded queueing, res...
Omar Hekal, Josepaul Paulachan, Daniel Onwuchekwa et al.· Future Internet· 0 citations
Multi-agent applications increasingly rely on shared large language model backends in the public cloud, where bursty workloads cause requests from different agents to contend for the same LLM instances, leading to long queues, memory imbalance, and severe tail-latency inflation. Existing approaches typically prioritize...
Ali Zafar Sadiq, Hai-Ying Shen· International Conference on...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.