Aug 2026· Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2· pp. 3691-3702· 0 citations· 22 references
TL;DR
Low-Rank Prior-Induced Consistency Flow Matching (LOFT) is proposed for efficient and effective distribution modeling under highly sparse data, and introduces an uncertainty-aware rectification mechanism to enable efficient inference by linearizing generative trajectories.
Abstract
Generative models like diffusion and flow matching excel in traffic imputation but suffer from high inference latency, as the learned vector fields typically induce curved generative trajectories requiring multi-step numerical integration. Furthermore, learning the transformation from non-informative priors introduces redundant computational overhead. To address these issues, we propose Low-Rank Prior-Induced Consistency Flow Matching (LOFT) for efficient and effective distribution modeling under highly sparse data. First, we construct a low-rank prior from sparse observations to recover inherent spatiotemporal correlations. Initializing the flow with this informative prior reduces the mapping complexity, allowing the model to focus on fine-grained variations. Second, to enable efficient inference by linearizing generative trajectories, we introduce an uncertainty-aware rectification mechanism. This mechanism resolves the gradient conflict between improving accuracy and trajectory linearization by dynamically arbitrating the optimization trade-off based on the training progress and data uncertainty. Experimental results demonstrate that LOFT surpasses state-of-the-art baselines using an NFE (Number of Function Evaluations) of 2, whereas competing methods typically require 20 to 50 NFE, achieving over a 10× improvement in inference efficiency. The code is available at https://github.com/maoxiaowei97/LOFT.
This work introduces a novel framework, Gaussian Bridge Consistency (GBC), to address challenges of semi-supervised learning by constructing semantic interpolation paths between unlabeled samples and high-quality class anchors, and proposes BridgeMix, a confidence-aware feature mixing strategy that interpolates both sa...
Hong-Yang He, Xin-Yuan Song, Yan Zhong et al.· 1 citation
This work introduces a flow-matching framework with a linear interpolation path between paired view representations, that replaces diffusion with probability flows between observed and missing views, and provides a formal analysis showing that deterministic ODE flows are inherently better aligned with clustering object...
Yiteng Yuan, Junyan Wang, Zheyuan Liu et al.· arXiv.org· 0 citations
The decomposition provides a theoretical basis for adapting likelihood-based LLM methods to flow matching, while distinguishing exact substitutions from controlled surrogates, while distinguishing exact substitutions from controlled surrogates.
High-fidelity image generation faces a trade-off between speed and quality. Diffusion models produce strong visuals but require costly iterative sampling. Existing efficient methods mainly distill pretrained models into few-step samplers, a challenging process that depends heavily on teacher-model quality. In this pape...
This work empirically demonstrates that the uncertainty over the value of each token is closely related to the density of available context in its neighborhood, and proposes a simple modification to the underlying continuous-time Markov chain (CTMC) that incorporates local context information.
D. Cherniavskii, Daniel Severo, Karen Ullrich· arXiv.org· 0 citations
Progressive Seed Pruning consistently improves reward-guided selection and achieves higher GenEval scores (automated) and better human evaluation on prompt-alignment than best-of-$N$, importance-sampling, and tree-search baselines at matched compute.
Rogério Guimarães, Pietro Perona· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.