PailitaoMMSearch is presented, which directly generates product Semantic IDs from a raw query image and free-form instruction and scales along three dimensions, and is deployed in multimodal search applications on Taobao Pailitao.
Xiao-Han Ye, Zi-Han Gong, Jing-Qian Zhao et al.· 0 citations
Large Language Models (LLMs) have recently shown strong potential for producing context-rich text embeddings for retrieval. Most existing methods either treat embedding learning as passive feature extraction or exploit LLM reasoning through instruction following for better embedding optimization. However, specializatio...
Zi-Han Gong, Xiao-Han Ye, Jiang-Chao Yao et al.· arXiv.org· 0 citations
Pailitao-MMSearch is presented, one native e-commerce multimodal search foundation model designed to bridge this gap, and introduces three key innovations:HybSID (Hybrid Semantic ID);(2)a two-stage continual pre-training strategy; and (3)a hybrid reasoning post-training pipeline.
Xiaohan Ye, Xu Chen, Zi-Han Gong et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.