Efficient Online Inference for Bayesian Nonparametric Relational Models

Dae Il Kim, Prem Gopalan, David M. Blei, Erik B. Sudderth
2013 Neural Information Processing Systems  
Stochastic block models characterize observed network relationships via latent community memberships. In large social networks, we expect entities to participate in multiple communities, and the number of communities to grow with the network size. We introduce a new model for these phenomena, the hierarchical Dirichlet process relational model, which allows nodes to have mixed membership in an unbounded set of communities. To allow scalable learning, we derive an online stochastic variational
more » ... ference algorithm. Focusing on assortative models of undirected networks, we also propose an efficient structured mean field variational bound, and online methods for automatically pruning unused communities. Compared to state-of-the-art online learning methods for parametric relational models, we show significantly improved perplexity and link prediction accuracy for sparse networks with tens of thousands of nodes. We also showcase an analysis of Little-Sis, a large network of who-knows-who at the heights of business and government.
dblp:conf/nips/KimGBS13 fatcat:psk4chejvrgbnk7kp5pstxpymi