Decentralized Topology Robustness Optimization for IoT via Multi-Agent Graph Reinforcement Learning

Abstract

The robustness of Internet of Things (IoT) communication topologies against internal failures and external perturbations is a fundamental prerequisite for maintaining system stability. This paper studies IoT topology robustness from two perspectives: robustness metric and optimization. Existing robustness metrics, primarily based on the maximum connected subgraph, neglect contributions from other connected subgraphs, thereby inadequately capturing dynamic topological changes. To address this issue, we propose a robustness metric based on topology data reachability, which sensitively reflects the data transmission capability of an IoT topology under arbitrary perturbations. Regarding robustness optimization, most existing methods adopt centralized strategies that rely on global information, resulting in inefficiencies and limited adaptability in decentralized IoT environments. We propose DecTRO, a Decentralized Topology Robustness Optimization method for IoT via multi-agent graph reinforcement learning. To mitigate partial observability, DecTRO employs a scalable graph attention network enhanced with multi-modal sampling, which aggregates cross-agent information and captures spatiotemporal correlations. Furthermore, a topology robustness-oriented node sampling method is introduced to reduce action-space complexity and accelerate convergence, while a decentralized heuristic reward function enables efficient online decentralized learning. Experimental results show that DecTRO achieves up to two orders of magnitude (5–125×) greater improvement in robustness per unit time compared with state-of-the-art baselines, striking a favorable balance between robustness enhancement and computational efficiency.