Exploiting Data-Independence for Fast Belief-Propagation

Julian J. McAuley, Tibério S. Caetano
2010 International Conference on Machine Learning  
Maximum a posteriori (MAP) inference in graphical models requires that we maximize the sum of two terms: a data-dependent term, encoding the conditional likelihood of a certain labeling given an observation, and a data-independent term, encoding some prior on labelings. Often, data-dependent factors contain fewer latent variables than dataindependent factors -for instance, many grid and tree-structured models contain only firstorder conditionals despite having pairwise priors. In this paper, we
more » ... note that MAPinference in such models can be made substantially faster by appropriately preprocessing their data-independent terms. Our main result is to show that message-passing in any such pairwise model has an expected-case exponent of only 1.5 on the number of states per node, leading to significant improvements over existing quadratic-time solutions.
dblp:conf/icml/McAuleyC10 fatcat:uris3xb3x5bc5e4usjmzjuiliu