Learning to Infer

Joseph Marino, Yisong Yue, Stephan Mandt
2018 International Conference on Learning Representations  
Inference models, which replace an optimization-based inference procedure with a learned model, have been fundamental in advancing Bayesian deep learning, the most notable example being variational auto-encoders (VAEs). In this paper, we propose iterative inference models, which learn how to optimize a variational lower bound through repeatedly encoding gradients. Our approach generalizes VAEs under certain conditions, and by viewing VAEs in the context of iterative inference, we provide
more » ... insight into several recent empirical findings. We demonstrate the inference optimization capabilities of iterative inference models, explore unique aspects of these models, and show that they outperform standard inference models on typical benchmark data sets.
dblp:conf/iclr/MarinoYM18 fatcat:zvvre3cfljf43kcn6zngiikhge