PAC-LLM is proposed, a phase-space-aware adaptive fusion framework for long-term chaotic time series forecasting powered by LLMs that leverages learned phase-space features and textual information to fully enable LLM's time series forecasting capacity.
Abstract
Chaotic time series forecasting is a challenging task due to its sensitivity to initial conditions and long-term unpredictability. Traditional methods typically rely on sufficient temporal trajectories to learn long-term dynamics, which limits their applicability when only short-term observations are available. While recent Large Language Models (LLMs) have shown great potential for time series forecasting, their temporal representations are not explicitly tailored to the phase-space structure and nonlinear evolution of chaotic systems. To address these issues, we propose PAC-LLM, a phase-space-aware adaptive fusion framework for long-term chaotic time series forecasting powered by LLMs. PAC-LLM leverages learned phase-space features and textual information to fully enable LLM's time series forecasting capacity. In particular, we design an auxiliary feature module and a gated weighting mechanism for multivariate coupling information fusion and selection. Extensive experiments on representative chaotic systems demonstrate that our method outperforms existing fine-tuned and zero-shot baselines in both short-term and long-term predictions. Our ablation study further confirms the effectiveness of each key component in PAC-LLM.
SCALER is a coarse-to-fine forecasting framework that first employs a lightweight Transformer tailored to long-term shape modeling to predict a coarse representation of future dynamics, and reduces reliance on long description prompts, and its fixed-step refinement avoids costly reward-model-based selection, further lo...
Xuan-May Le, Minh-Tuan Tran, Ling Luo et al.· Proceedings of the 32nd ACM...· 0 citations
Deep learning surrogates have become powerful tools for simulating and forecasting complex dynamical systems, yet their utility remains limited by catastrophic error accumulation during long-term autoregressive rollouts. This behavior is partly tied to the nature of the underlying systems: chaotic spatiotemporal system...
TS-MTM is proposed, a Temporal-Spectral Masked Time-series Modeling framework that formalizes pretraining within a joint representation space and introduces two synergistic mechanisms: Axial-Period Cross Masking to capture temporal dependencies across phases, and Structure-aware Spectral Magnitude Masking to reconstruc...
Pengcheng Zhang, Xiao-Cao Ouyang, Xin Li et al.· Proceedings of the 32nd ACM...· 0 citations
A novel pattern-guided mixture-of-experts that expands model capacity through sparse activation and uses shallow patch similarities to constrain deep-layer routing, guiding expert specialization across heterogeneous time series and an implicit quantile network head that predicts arbitrary quantiles to characterize pred...
Xingjian Wu, Chen-Juan Guo, Xiangfei Qiu et al.· 0 citations
SETTer is introduced, a transformer-based model that addresses challenges of long-term multivariate time series forecasting by incorporating novel techniques for decoupled self-attention and hybrid masking and outperforms state-of-the-art models in 88% of the scenarios.
Abraham Ezema, C. Eze, F. Ponci et al.· 0 citations
In order to make well-informed decisions, long-term time series forecasting is crucial for a number of applications in finance, energy, and environmental science. While traditional transformer models have demonstrated a strong ability to capture temporal dependencies, they frequently struggle to handle the lengthy sequ...
YongKyung Oh, Alex A. T. Bui· IISE Annual Conference &...· 0 citations
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduNov 6, 2026
A machine-learning approach called CheMeleon provides a practical way to develop new drugs or other molecules with much less detailed, expensive experimentation.
Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.
Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.