Skip to content
Preprint

Shift Aware Transfer Learning with Adaptive Dual-Encoder Fusion for PM Forecasting in Data-Limited Environments

Aug 2026 · 0 citations
Computer Science

TL;DR

A shift-aware dual-encoder transfer framework that combines source-domain knowledge with target-specific representation learning is developed and suggests that source-domain knowledge is most effective when target-specific information is preserved and the transferred representation is allowed to adapt under target supervision.

Abstract

Short-horizon forecasting of fine particulate matter (PM2.5) remains difficult when observations from the target domain are limited and the statistical properties of the source and target domains differ. In these settings, models trained only on local data may not capture complex temporal dynamics, while direct transfer learning can result in negative transfer. This study develops a shift-aware dual-encoder transfer framework that combines source-domain knowledge with target-specific representation learning. The source encoder was pretrained using hourly observations from 10 U.S. monitoring locations. The framework was then adapted and evaluated using two years of hourly observations from 77 stations in Taiwan under a chronological train-validation-test protocol. Among the four principal baselines, the frozen-source dual-encoder model achieved the best performance, with MSE = 21.8960, MAE = 3.1597, and R^2 = 0.8725. This corresponds to an MSE reduction of approximately 7.1% relative to TL-v1 and 4.1% relative to TL-v2. The ablation analysis showed that removing the Taiwan-specific branch caused the largest decline in performance. Allowing the source encoder to adapt produced the best overall result, with MSE = 21.6575, MAE = 3.1383, and R^2 = 0.8739. SHAP analysis indicated that predictions were driven mainly by recent PM2.5 observations and meteorological variables related to pollutant transport and dispersion. These results suggest that source-domain knowledge is most effective when target-specific information is preserved and the transferred representation is allowed to adapt under target supervision.

View source

Similar papers

Open access Aug 2026

An Applied Assessment of Multi-Source Data Fusion by Machine Learning for PM2.5 Daily Concentration Prediction

This study evaluates a machine learning data fusion approach that integrates daily federal regulatory observations, daily low-cost community sensor measurements, and monthly satellite-derived aerosol products to improve PM2.5 prediction across under-monitored environments.

Suhrudh Chivukula, Adrian J. Cortes Santos, R. Delgado et al. · 0 citations
Aug 2026

Hybrid Deep Learning with Attention-Based Interpretability for PM2.5 Forecasting in Delhi Urban Environments.

The novelty of CORTA-Net lies in combining explicit CorrXGBoost-Rank feature screening, transfer-learning-based temporal encoding, MODIS fire-activity integration, and multi-head attention-based model-behavior analysis in a single reproducible PM2.5 forecasting pipeline.

Mahasiva Saravagna Sai Lakshmi, Gollapudi SVSSVN Rithvik, C. V. V. Ramana et al. · 0 citations
Open access Aug 2026

A Hybrid Transfer Learning Approach for Ambient PM2.5 Exposure Modeling in LMIC Contexts: A Case Study from Lima, Peru

This work developed a hybrid and transfer learning approach in Lima, Peru that integrates multiple geospatial technologies and machine learning to mitigate sampling bias and improve PM2.5 predictions, and provides a scalable solution to support robust epidemiological research and public health planning across data-scar...

Qiang Pu, Qing-Yang Zhu, Elvis Medina et al. · 0 citations
Open access Oct 2026

Hybrid multi-task deep learning framework for joint forecasting of solar and wind power

This study presents the adaptive three-expert ensemble (A3E), a reproducible framework for joint one-hour-ahead solar and wind power forecasting. A3E combines temporal, physically informed, and high-generation Extra Trees experts through a causal local-error gate and is evaluated under a strictly chronological, leakage...

A. Tynykulova, R. Moldasheva, Э. Э. Эльдарова et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Distributed JEPA: A Self-Supervised Framework for Energy Forecasting

A distributed Joint Embedding Predictive Architecture for self-supervised learning from heterogeneous energy time-series that predicts latent representations of masked temporal segments while integrating temporal observations and contextual information within a shared embedding space to prevent representation collapse.

Liana Toderean, T. Cioara, Vasilis Michalakopoulos et al. · 0 citations
Open access Sep 2026

UDA-MTVIB: An unsupervised domain-adaptive multi-site temporal variational information bottleneck for generalizable wind power forecasting

Distributional shifts across wind farms and non-stationary dynamics pose significant challenges to accurate and generalizable wind power forecasting. This paper proposes UDA-MTVIB, an unsupervised domain-adaptive multi-site temporal variational information bottleneck framework. The model integrates a dynamic-gated LSTM...

Xin-Biao Lu, Ze-Qing Zhu, Yuan-Hang Li et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.