This paper proposes CHAIN (long-Context History-supervised Anomaly detectIoN), a novel framework that explicitly captures long-term historical contexts under anomaly simulation and supervises current-window anomaly detection via masked cross-attention fusion.
Abstract
Anomaly detection for multivariate time series is a critical task with broad applications in industrial monitoring, IT operations, and healthcare. Recent deep learning methods—including reconstruction-based, forecasting-based, and representation-learning approaches—have substantially improved detection accuracy by modeling complex temporal dependencies and inter-variable correlations within a fixed observation window. However, these methods have largely overlooked the historical context preceding the window-of-interest, referred to as the current window. Since time series anomalies are inherently contextual, modeling only the current window while neglecting long-term historical patterns inevitably leads to a high false alarm rate. In this paper, we propose CHAIN (long-Context History-supervised Anomaly detectIoN), a novel framework that explicitly captures long-term historical contexts under anomaly simulation and supervises current-window anomaly detection via masked cross-attention fusion. CHAIN adopts a history–current encoder–decoder design comprising three modules: a history context encoder based on the structured state space sequence model (S4) for efficient long-range modeling; a current context encoder based on a decoder-only Transformer for autoregressive forecasting; and a fused context decoder employing cascaded cross-attention layers that suppress simulated anomalous history via a learned mask. We jointly optimize autoregressive forecasting and a mask-prediction self-supervised auxiliary task in an end-to-end manner. Extensive experiments on three real-world benchmarks (SWaT, WADI, and SMD) demonstrate that CHAIN achieves competitive detection performance against fifteen state-of-the-art baselines. Ablation studies further verify the effectiveness of each proposed component.
Robust anomaly detection in time series remains challenging because sparse abnormal observations, noise contamination, nonlinear dynamics, and long-range temporal dependencies can obscure deviation patterns. This paper proposes the SALK anomaly detection model, which integrates an attention-enhanced long short-term mem...
Transformer with Variational AutoEncoder is presented, a framework that combines a dual-embedding representation pipeline, a Transformer encoder for long-range dependency modeling, and VAE-based latent regularization of encoded features to provide an effective and robust solution for long-term time-series anomaly detec...
Xian-Kun Shi, Yibo Li, Ziqi Wang et al.· CAAI Artificial Intelligence...· 0 citations
Unsupervised multivariate time-series anomaly detection seeks to detect rare abnormal events in correlated sensor streams when dense anomaly labels are unavailable. Although Transformer-based methods have strengthened long-range representation learning, many still depend on fixed patch construction or costly attention...
Jun Long, Xu-Zhuang Yan, Jun-Kun Hong et al.· Journal of King Saud Univers...· 0 citations
Effectively modeling the complex and evolving dependencies among multiple variables is a key challenge in multivariate time series anomaly detection (MTSAD). Existing methods typically model channel dependencies in discrete time steps, either window-wise or point-wise. However, they face a granularity dilemma: window-w...
Lijun Sun, Shuai Zhang, Xin Xue et al.· Proceedings of the 32nd ACM...· 0 citations
Multivariate time series anomaly detection (MTAD) is important for ensuring reliable operation and improving service quality in industrial systems. Forecasting-based methods have been a primary approach for MTAD, detecting anomalies by assuming that anomalous data points produce higher forecasting errors than normal on...
W. Koo, Heeyoung Kim· IISE Annual Conference &...· 0 citations