Diffusion Policy Improvement with Proposal-Conditioned Refinement Flows
This work forms a KL-regularized objective whose optimum induces a Gibbs policy over final actions under a Gaussian-smoothed behavior prior, and introduces Proposal-Conditioned Refinement Flows (PReFlow), a policy extraction method combining critic-based proposal selection with a conditional refinement flow.