STAR: Staged Training with Aligned Reinforcement Learning and Multi-Faceted Distillation for Interpretable E-commerce Relevance

Abstract

E-commerce search relevance modeling faces a critical dilemma: traditional models falter with complex queries, while Large Language Models (LLMs), despite their superior reasoning, suffer from the prohibitive latency of auto-regressive Chain-of-Thought (CoT) generation, rendering them infeasible for production. Knowledge distillation offers a promising solution, yet current methods force an undesirable trade-off: sacrificing the very interpretability that makes LLMs powerful, or relying on expensive, unscalable human-annotated rationales. To address this, we propose STAR—Staged Training with Aligned Reinforcement Learning and Multi-Faceted Distillation, a progressive framework that follows a reasoning, ranking, and transfer pipeline to imbue dense models with both high performance and interpretability. First, STAR aligns a teacher LLM's reasoning with task objectives using a novel multi-granularity reward in Group Relative Policy Optimization (GRPO), leveraging only binary labels. Next, it refines the teacher's ability for calibrated scoring via token-level supervision, enabling efficient ranking through a single forward pass without any additional layers. Finally, this ''white-box'' knowledge is transferred to a compact student via multi-faceted distillation that preserves both reasoning logic and ranking behavior. Offline experiments demonstrate that our 0.6B student model rivals the performance of a strong 8B baseline, making it highly efficient and fully deployable. Real-world effectiveness is validated by significant online A/B test gains, including a +0.93% GoodRate lift and a +1.04% increase in GMV. STAR has been fully deployed to 100% of main search traffic on 1688.com.