Skip to content
Preprint

Tokenized Joint Source-Network Coding for Loss-Resilient Video Streaming

Oct 2026 · 0 citations · 36 references
Engineering Computer Science

TL;DR

TokJSNC establishes a practical pathway for repurposing modern generative video tokenizers for loss-resilient streaming, while providing a fundamental framework for video token communications.

Abstract

For decades, conventional video streaming systems have relied on packet-level forward error correction (FEC) codes and retransmissions to ensure reliable video delivery. However, in real-time communications, FEC is inherently inefficient under unknown and time-varying packet-loss conditions, while retransmission can incur excessive latency and fail to meet stringent playout deadlines. Emerging deep joint source-channel coding (DeepJSCC) provides an alternative by learning channel-noise-resilient representations, yet its tight coupling with the physical layer makes it difficult to integrate into today's layered network architectures and protocols. In this paper, we propose TokJSNC, a simple-but-effective tokenized joint source-network coding paradigm for packet-loss-resilient video streaming. Rather than first compressing video into a compact bitstream and then protecting it with packet-level FEC, TokJSNC directly encodes video into variable-length discrete token-stream, whose transmission rate is jointly adapted to video content complexity and network conditions. By exploiting the spatiotemporal correlations among learned video tokens, TokJSNC enables robust video reconstruction over a wide range of packet-loss rates without explicit FEC or retransmissions. Consequently, TokJSNC brings the JSCC-like graceful degradation property to the network layer while remaining compatible with existing network architectures and transport protocols. Experimental results show that TokJSNC maintains an average playback frame rate above 22 fps even at a 70% packet-loss rate, whereas the best-performing baseline drops below 12 fps. Overall, TokJSNC establishes a practical pathway for repurposing modern generative video tokenizers for loss-resilient streaming, while providing a fundamental framework for video token communications.

View source

Similar papers

Semantic-Aware Neural Video Codec for Error-Resilient Low-Latency Transmission

Emerging physical AI systems require low-latency, task-oriented video communication over unreliable channels. We propose a semantic-aware multi-level neural video coding method for robust low-latency video transmission over unreliable channels that are abstracted as multi-level packet erasure channels. Built upon the r...

Matin Mortaheb, Homa Esfahanizadeh, Jin-Feng Du et al. · 2 citations
Conference Open access Sep 2026

Paired Decoder-Output Responses Under Burst H.264 Network Abstraction Layer Unit Loss

Burst-erasure multimedia communication has a measurement gap: bitstream-level loss counts cannot distinguish missing decoder outputs from degraded surviving frames. We pair decoder-output availability with survivor fidelity and recover source display positions through content-identity hashing of compressed payloads. Ac...

Zhi-Hong Huang, Wei-Zhang Xu · 0 citations
Open access Jul 2026

Frame-Wise Streaming for Efficient Learned Speech Compression

Speech compression is increasingly important in scenarios such as real-time and satellite communication. Neural codecs have shown superior Rate-Distortion (RD) performance over traditional signal-processing codecs. Models with long-range dependency encoders/decoders and entropy models outperform convolution-based struc...

Yu-Han Liu, Jun Xu, Feng-Xi Zhang et al. · 0 citations
Preprint Oct 2026

Neural Video Coding under Limited Delay: Theoretical Optimality and System Design

Traditional neural video compression (NVC) methods predominantly follow strictly causal predictive-coding paradigm, treating zero-frame delay as a fixed constraint rather than delay as an explicit design parameter. From an information-theoretic perspective, allowing limited frame delay enables a codec to exploit correl...

Li-Kun Cai, Jun Chen, Ashish J. Khisti · 0 citations
#artificial intelligence Preprint Oct 2026

Neural Network Verification for Deep Joint Source-Channel Coding

Deep joint source-channel coding (DeepJSCC) transmits data end-to-end over wireless channels using a neural encoder-decoder, but reconstruction quality can degrade sharply under adversarial perturbations and channel disturbances; no method formally bounds this degradation for DeepJSCC. We present the first bound-propag...

Thanh Le, Hai Duong, Takeshi Matsumura et al. · 0 citations

Semantic-Aware Joint Source-Channel Optimization for Encoder-Agnostic Digital Video Communication

Video semantic communication has attracted increasing attention as a promising approach to improving video transmission efficiency. However, most existing approaches rely on computationally intensive deep learning-based video encoders and decoders, which hinders their deployment in resource-constrained scenarios. To ad...

Xiang-Ben Zhu, Cai-Li Guo, Yang Yang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.