Video prediction requires models to capture complex spatiotemporal dependencies and to retain relevant information over long sequences. PredRNN and its successor PredRNN-V2 address this challenge with spatiotemporal Long Short-Term Memory (ST-LSTM) units that maintain two separate memory states, at the cost of a relati...
Augusta van Haren, Hanna Hoogen, Luca Pattavina et al.· 0 citations
The development of a digital twin brings together many stakeholders and technical components. We have previously investigated the reporting of the conceptual architecture for these digital twins as an artifact for discussion. However, we find that the activity of modeling the digital twin for visualization and consensu...
Recent studies investigate the weight geometry through its spectral structure, which characterizes how the weights transform different input directions. Within this view, supervised fine-tuning (SFT) is shown to induce dense updates that perturb the spectral geometry of pre-SFT weights along their principal directions,...
Jian-Zhu Bao, Jia-Chen Gu, Qing-Yuan Liu et al.· 0 citations
Relying on manipulable characteristics to target the allocation of resources is fraught with difficulties. Naively optimal rules lead to falsification and allocative inefficiency. Optimizing the rule for allocative efficiency while accounting for falsification typically induces falsification, at a heavy cost to the age...
Searching text-rich knowledge graphs requires following relations while examining textual evidence. Predefined graph interfaces constrain what evidence agents can access, even when they write code to combine tool calls or process retrieved subgraphs. We propose direct knowledge graph interaction (DKGI), a harness in wh...
Self-distillation is an emerging approach that trains a model to imitate its own predictions when conditioned on privileged information, such as correct answers or environmental feedback. Recent methods have reported better sample efficiency and generalization than reinforcement learning (RL), but it remains unclear wh...
J. Adhinarta, Raina Wu, Ashutosh Sharma et al.· 0 citations
JevProbe is presented, the first automated framework to evaluate JPDH by tracing adversarial influence from reachable context surfaces through program-consumed decisions to downstream security consequences in real-world Jev applications, and further construct JevProbeBench to support systematic evaluation of JPDH in re...
Yang Luo, Tian-Tian Ji, Zi-Feng Kang et al.· 0 citations
Comparing five typed decision models and seven generative baselines on 11,117 English text questions from nine ToM benchmarks across six capability groups suggests that Jev could reduce the cost and waiting time of repeated ToM selection.
Ka-Po Chung, Chunkit Chan, Yuxuan Liu et al.· 2 citations
Direct Preference Optimization (DPO) has become a widely adopted approach for aligning vision-language models (VLMs), yet the security of multimodal preference data remains largely unexplored. Existing preference poisoning attacks either corrupt explicit supervision signals or require visible triggers, making them dete...
3D part assembly aims to reconstruct a complete shape from a set of unassembled parts by predicting a rigid SE(3) transformation for each part. Because the placement of a part is rarely determined by its own geometry, the task demands reasoning over the entire part set, and existing methods, which rely on pairwise rela...
Zhouhan Zhong, Qiuhong Shen, Xingyi Yang et al.· 0 citations
Multimodal LLMs are typically trained by first aligning a vision encoder with a language model via projector training on large image-caption datasets, followed by joint training of the full multimodal model. Despite its widespread use, the role of the projector training stage remains poorly understood. We find that (i)...
Fabian Gr\"oger, Na\"el Ouerghemi, Shuo Wen et al.· 0 citations
Physical properties provide intuitive controls for sounds made by interacting objects. The challenge is to make a generative model respond predictably to these controls, both individually and in combination. We present \method\ (PXS), trained on simulated contact sounds with 15 material, geometry and contact parameters...
Peiwei Chang, Yongqiang Chen, Yuelan Cheng et al.· 0 citations