Generative recommendation (GR) is moving industrial recommender systems (RecSys) from scoring candidate items to autoregressively generating item identifiers. This shift promises higher recommendation quality, but makes serving substantially harder: each request executes a short sequence of dependent decoding steps tha...
Xiang-Rui Yang, Yun-Feng Zhao, Jia-Wei Yang et al.· 0 citations
This work presents OneLA, a linear-attention decoding framework that exploits the shared prompt and short divergent suffixes of GR workloads, and represents all beam states using a single shared prompt-derived state and compact, append-only records of their divergent transitions.
Xiang-Rui Yang, Cheng Peng, Yun-Feng Zhao et al.· 1 citation
Experiments on three public sequential-recommendation benchmarks show that SID Routing improves its corresponding direct-generation, and indicate that structure-grounded reasoning is most useful when prefix matching is insufficient but learnable SID-space transitions remain available, whereas long or weakly supported r...
Xiang Liu, Jingsong Su, Shuqing Zhao et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.