Incremental Bayesian networks for structure prediction

Ivan Titov, James Henderson
2007 Proceedings of the 24th international conference on Machine learning - ICML '07  
We propose a class of graphical models appropriate for structure prediction problems where the model structure is a function of the output structure. Incremental Sigmoid Belief Networks (ISBNs) avoid the need to sum over the possible model structures by using directed arcs and incrementally specifying the model structure. Exact inference in such directed models is not tractable, but we derive two efficient approximations based on mean field methods, which prove effective in artificial
more » ... s. We then demonstrate their effectiveness on a benchmark natural language parsing task, where they achieve state-of-the-art accuracy. Also, the model which is a closer approximation to an ISBN has better parsing accuracy, suggesting that ISBNs are an appropriate abstract model of structure prediction tasks.
doi:10.1145/1273496.1273608 dblp:conf/icml/TitovH07 fatcat:bvqxmwsl5rafbaylaob2y7f2ua