Forecasting Multivariate Time Series: A Comparison of Machine Learning, Statistical and Deep Learning Models

Abstract

This study develops a rigorous, leakage-free forecasting framework for monthly Robusta coffee prices using historical observations from January 1975 to December 2025. A comprehensive set of explanatory variables is constructed from lagged coffee prices, moving averages, logarithmic returns, rolling volatility, and exogenous variables such as the Oceanic Niño Index (ONI), the U.S. Dollar Index, and Brent crude oil prices. To ensure methodological fairness, all predictors are generated exclusively from information available at the forecast origin, and all competing models are evaluated under a unified expanding-window walk-forward validation framework. Seven forecasting models are compared: Naïve, Exponential Smoothing (ETS), ARIMA, ARIMAX, Extreme Gradient Boosting (XGBoost), Long Short-Term Memory (LSTM), and Gated Recurrent Unit (GRU). Forecasting performance is evaluated using R2, RMSE, MAE, and MAPE, while Taylor diagrams and the Diebold–Mariano test are employed to assess model agreement and differences in predictive accuracy. The results show that XGBoost achieves the highest forecasting accuracy (R2 = 0.956, RMSE = 0.264), followed closely by the Naïve (R2 = 0.954, RMSE = 0.271) and ARIMA (R2 = 0.954, RMSE = 0.270) benchmarks, whereas ARIMAX and ETS provide comparable performance and the deep learning models (LSTM and GRU) produce substantially larger prediction errors. Feature importance analysis further indicates that the first lag of coffee price is the dominant predictor, accounting for approximately 94% of the predictive gain in XGBoost. Overall, the findings demonstrate that rigorous leakage-free validation is essential for reliable forecasting research and that, for monthly Robusta coffee prices, increased model complexity does not necessarily yield superior predictive performance.