Restricted Boltzmann Machines, Bernoulli Mixtures and Sum-Product Networks: A Matched-Capacity Comparison on Binarized Image Data
Generative probabilistic models differ in a fundamental way that is rarely measured directly: some permit exact inference, while others are more expressive but require their likelihood to be estimated. This study compares three model families on binarized Fashion-MNIST and MNIST under identical preprocessing, identical...