Ruo-Han Ning

Attention and residual adaptation analysis of node-token GPT2 for traffic flow forecasting

A node-tokenized GPT-2 framework is proposed and attention adaptation and residual prediction mechanisms for traffic flow forecasting are investigated, indicating that residual prediction improves forecasting accuracy, whereas simply modifying the attention structure does not necessarily lead to reliable modeling of tr...