An analytical framework coupling communication limits, a roofline GPU service model, stochastic latency, and utilization-aware cost across three model classes, three offloading strategies, and three communication generations is applied to New York City.
Abstract
Frontier autonomous-driving models -- especially vision-language-action (VLA) models, whose forward pass approaches $\sim$60~TFLOPs -- are outgrowing economical onboard deployment, since peak hardware sits idle most of the day. Cloud inference can instead share GPUs across active vehicles, but the vehicle must upload through a capacity-limited uplink, reach a GPU without queueing, and return a decision within the closed-loop budget. This paper asks: can the cloud drive? We answer with an analytical framework coupling communication limits, a roofline GPU service model, stochastic latency, and utilization-aware cost across three model classes, three offloading strategies, and three communication generations, applied to New York City. Separating a reactive 100~ms budget from a 300~ms deliberative tier (presuming an onboard reactive fallback), we find three \emph{nested} binding regimes. Communication binds first in dense cells: 5G fails early, 5G-Advanced is the practical threshold for feature-level offloading, and 6G adds headroom. Compute binds next under the reactive budget: near-term VLA is latency-infeasible regardless of bandwidth, because autoregressive FP16 decode is memory-bandwidth-bound (~114 ms on 2025 hardware). Its floor clears 100 ms around 2027; 6G then admits feature-level VLA by ~2028, 5G-Advanced only at light loading and not the dense corridor, and the deliberative tier from 2026. Cost binds last: once admissible, utilization-pooled cloud GPUs undercut onboard hardware for VLA, whose baseline (up to \$8,500 per vehicle-year) is expensive and idle; feature-level offloading (S2) is where the VLA cost crossover concentrates. Latency decides which model is admissible in which year; cost decides whether it is economical.
This work presents a predictive quality-of-service (QoS) framework that jointly forecasts latency and packet delivery rate using dual-output recurrent neural networks, enabling proactive RAT selection across 5G NR, C-V2X, and DSRC.
Lucas Bréhon–Grataloup, Rahim Kacimi· International Conference on...· 0 citations
A risk-adaptive edge-cloud architecture in which onboard traffic assessment determines when cloud reasoning is requested is presented, in which onboard traffic assessment served as a practical trigger for selective VLM inference in these experiments.
Meng Ma, Shu-Yang Li, Nai-Gang Wang et al.· 0 citations
The comparisons of performance metrics be-tween cloud-aided and edge-only models provide a demonstration of advantages offered by a Cloud-Aided framework, particularly in regards to RNN performance which changed from 0% autonomy to 90% autonomy, outperforming convolutional neural networks when the domain shifted.
A Timeliness-Aware Large-Small VLM Collaboration (TALSC) framework that first model the Age of Information (AoI) evolution for VLM inference and characterize the coupling among AoI, token length, and task performance to formulate a general timeliness metric and proposes the TALSC online scheduling algorithm.
Mengmeng Zhu, Yuxuan Sun, Wei Chen et al.· 0 citations
The integration of 5G/6G networks with the Internet of Vehicles (IoV) requires efficient computational offloading for data-intensive applications such as autonomous driving and augmented reality. Although Unmanned Aerial Vehicles (UAVs) offer agile mobile edge computing (MEC) capabilities, their operational efficiency...
Fitzgerald Quincy Clarke, J. Odoom, Ruth S. Kubvoruno et al.· International Conference on...· 0 citations
Integrated sensing and communications (ISAC) is moving from proof-of-concept demonstrations to system-level deployment in sixth-generation (6G) networks. Because sensing and communication share hardware, spectrum, and waveform resources, ISAC design now involves many tightly coupled choices, including waveform selectio...
Lijie Zheng, Xudong Zhong, Baoquan Ren et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.