Skip to content

SeMoCo: A Semantic-First Motion Codec for Motion Language Modeling

Aug 2026 · 0 citations · 35 references
Computer Science

Abstract

Discrete motion representations have substantially advanced autoregressive text-to-motion generation. However, most motion tokenizers are optimized for reconstruction and do not explicitly allocate capacity according to semantic role. Action-level meaning and fine-grained kinematic detail must therefore be encoded through the same reconstruction-driven hierarchy. We introduce SeMoCo, a semantic-first motion codec, together with a dual-axis motion generator for language-conditioned motion generation. Each motion token contains one semantic token and a residual sequence of kinematic tokens. The generator models semantic progression across time and autoregressively refines the residual entries. We also construct $\Omega$-MotionVerse, a large-scale, multi-source human-motion dataset unified under the SOMA representation. Across the reported comparisons, SeMoCo achieves the best reconstruction accuracy among the compared codecs, while strong text-to-motion results demonstrate the effectiveness of its motion tokens for downstream generation.

View source

Similar papers

Spikformer V2: Join the High Accuracy Club on ImageNet with an SNN Ticket

This work introduces a pioneering exploration of Self-Supervised Learning (SSL) within the SNN, and proposes a novel Spiking Self-Attention (SSA) and Spiking Transformer (Spikformer) that achieves 80+% accuracy on ImageNet.

Zhaokun Zhou, Kaiwei Che, Wei Fang et al. · 69 citations · ⚡10

Jailbreaking in the Haystack

NINJA (short for Needle-in-haystack jailbreak attack), a method that jailbreaks aligned LMs by appending benign, model-generated content to harmful user goals to reveal fundamental vulnerabilities in modern LMs.

R. Shah, C. Wu, Shashwat Saxena et al. · 4 citations

Convergent Evolution: How Different Language Models Learn Similar Number Representations

This paper identifies two different routes through which models can acquire geometrically separable features: they can learn them from complementary co-occurrence signals in general language data, including text-number co-occurrence and cross-number interaction, or from multi-token addition problems.

Deqing Fu, Tianyi Zhou, Mikhail Belkin et al. · 3 citations
#artificial intelligence Open access Feb 2025

Iterative Flow Matching - Path Correction and Gradual Refinement for Enhanced Generative Modeling

This work explores image generation using flow matching using flow matching and proposes an iterative process that can be integrated into virtually any generative modeling technique, thereby enhancing the performance and robustness of image synthesis systems.

Eldad Haber, Shadab Ahamed, Md Shahriar Rahim Siddiqui et al. · 3 citations

SimulRAG: Simulator-based RAG for Grounding LLMs in Long-form Scientific QA

SimulRAG, a simulator-based RAG framework with a generalized retrieval interface that translates between text and simulator parameters/outputs, is proposed, which improves informativeness and factuality over the strongest adapted RAG baselines, while UE+SBA enhances claim-level efficiency and quality.

Haozhou Xu, D. Wu, M. Chinazzi et al. · 3 citations
#artificial intelligence Preprint Aug 2026

Evaluating and Explaining Prompt Sensitivity of LLMs Using Interactions

Interactions are introduced as a fine-grained tool to analyze prompt sensitivity of LLMs and it is discovered that subtle changes to prompts can trigger severe instability in interactions, even when the outputs of the LLM remain the same.

Ruiyang Qin, Qingzhuo Wang, Tianhao Wang et al. · 2 citations · ⚡1

Related blog posts

MIT News · Artificial Intelligence Jun 3, 2026

MIT researchers teach AI models to interpret charts

The new ChartNet training dataset could improve the accuracy of vision-language models that help analyze business trends or interpret scientific figures.