Yifan Zhao

PaMG: adaptive part-based motion generation and editing from text

The First EgoCross Challenge at EgoVis 2026: Cross-Domain Egocentric Video Question Answering

EgoCross is a cross-domain egocentric video question answering benchmark designed to evaluate whether multimodal large language models can generalize beyond common daily-life scenarios. The first EgoCross Challenge was hosted at the Third EgoVis Workshop at CVPR 2026 and evaluated models on first-person videos from four target domains: surgery, industrial assembly, extreme sports, and animal perspectives. Each test example consists of an egocentric video clip, a question, and four candidate answers, from which the model must select the correct option. This technical report introduces the challenge task, benchmark resources, and two official Codabench tracks. The Source-Limited Track restricts participants to the official baseline model and a small support set, whereas the Open-Source Track permits broader choices of models and training data under rules that prohibit the manual construction of target-domain training data. In total, the challenge received more than 1,500 submissions from over 130 participants, with 19 teams participating in the Open-Source Track and 38 teams in the Source-Limited Track. We further present the official leaderboard results and summarize the winning solutions from both tracks. We hope that this report will serve as a useful technical reference for advancing cross-domain egocentric video understanding. All resources, including the challenge data, baseline implementation, and code released by the winning teams, are made publicly available.

Generation in Generation: Fluid Co-Speech Gesture Synthesis With Generative Continuous Quantization

Motion quantization codebooks have been widely adopted to facilitate co-speech motion generation. However, the conventional quantization-based generation paradigm—which relies on probabilistic token sampling from limited discrete codebooks—suffers from two major limitations: crude, unreasonable motion representations and fixed, homogenized motion token sequences. To overcome these issues, we propose a novel explicit generation paradigm based on generative continuous quantization. Specifically, we first introduce a continuous quantization method to derive a set of generative motion units. This approach enables smoother and more accurate representation of human motion compared to classical methods. Building on these generative units, we further propose a compositional weight generation paradigm that replaces probabilistic sampling with deterministic, explicit motion synthesis. Moreover, as generalization capability is crucial for real-world deployment, we design a fully audio-aware encoder to extract style features that are decoupled from content. These features are integrated into the motion decoder via Adaptive Instance Normalization to enhance cross-speaker facial style generalization. Our method achieves state-of-the-art performance on two public datasets. Notably, owing to its concise and efficient architecture, our model attains an inference speed exceeding 4000 fps on the SHOW dataset, demonstrating strong potential for practical real-time applications.