SOL: Measuring Gaps between Text Distributions by Double Sliced Wasserstein Metrics
Evaluating text generation requires measuring how well the generated distribution matches the data distribution. For autoregressive models, this is done by the perplexity. Diffusion and flow-based language models can only provide a likelihood bound, whose tightness differs between model families. Sample-based substitut...
Gregor Kornhardt, Moritz Piening, J. Chemseddine et al.
· 0 citations