TAC-Time is proposed, a unified framework that transforms textual information into additional temporal channels that preserves temporal continuity and periodic structures while remaining efficient and scalable and identifies predictive textual signals whose correlation-aware alignment yields partial forecasting improvements.
Abstract
Most existing time series forecasting methods rely solely on numerical observations, overlooking rich contextual information from auxiliary texts. Recent multimodal approaches attempt to incorporate textual signals, but they often treat text as static features or use large language models as forecasting backbones, limiting their ability to capture temporal dynamics and increasing computational cost. To address these challenges, we propose TAC-Time, a unified framework that transforms textual information into additional temporal channels. By modeling text features jointly with numerical sequences in a shared temporal backbone, TAC-Time preserves temporal continuity and periodic structures while remaining efficient and scalable. This formulation also enables systematic interpretability analyses. We show strong cross-modal dependencies through attention and frequency-domain analyses, and identify predictive textual signals whose correlation-aware alignment yields partial forecasting improvements. Extensive experiments on real-world multimodal benchmarks demonstrate that TAC-Time outperforms prior methods.
This work defines cross-modal attention as a selection process, where semantic prompts are employed to induce a sparse temporal attribution distribution over temporal positions and employs low-entropy regularization alongside global cross-modal consistency constraints to regulate the selection behavior.
Xue-Yun Luo, Qiang Lu, Sangui Jian et al.· Proceedings of the Thirty-Fi...· 0 citations
It is concluded that, on this benchmark and within this family of frozen-encoder architectures, text content is not the operative signal behind the reported gains and the perturbation protocol and evaluation harness are released as a reusable diagnostic toolkit.
K. Sridhar, Atharva Gupta, Nishant Pradhan et al.· 1 citation
Real-world time-series applications increasingly require models that can handle time series forecasting, context-conditioned prediction, and language-based temporal reasoning. Yet current time-series foundation models remain fragmented across these capabilities: numerical specialists often provide the strongest forecas...
Tony Chen, Timo Stoffregen, Maxwell A. Xu et al.· 0 citations
Experiments on the Time-MMD benchmark show that SCENARIODIFF is especially effective in event-driven domains, demonstrating the value of explicit hierarchical scenario guidance for multimodal time series forecasting.
Tuan-Binh Tran, Dat Nguyen Cong, Duc-Trong Le et al.· 0 citations
This work proposes SAGE (Seeing and Augmenting with Grounded Encoding), an end-to-end CLIP-based framework that jointly models temporal, cross-variable, textual, and visual information and achieves state-of-the-art accuracy.
A unified benchmark for multimodal time series forecasting with heterogeneous context, MUSE-Bench enables systematic evaluation of how forecasting models utilize context and provides a foundation for future multimodal forecasting research.
Peng Chen, Zhi-Hao Zhuang, Hong-Zhou Chen et al.· 3 citations
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduOct 13, 2026
Machine-learning networks can learn without detailed instructions from a designer. Those that do may offer insight into how the brain reorganizes itself during learning.
MIT News · Artificial Intelligence· news.mit.eduSep 29, 2026
Professor Sherry Turkle’s new book, “Artificial Intimacy,” offers a withering critique of chatbots and the antisocial dynamics she believes they encourage.