Bayesian inference in hierarchical models by combining independent posteriors [article]

Ritabrata Dutta and Paul Blomstedt and Samuel Kaski
<span title="2016-04-13">2016</span> <i > arXiv </i> &nbsp; <span class="release-stage" >pre-print</span>
Hierarchical models are versatile tools for joint modeling of data sets arising from different, but related, sources. Fully Bayesian inference may, however, become computationally prohibitive if the source-specific data models are complex, or if the number of sources is very large. To facilitate computation, we propose an approach, where inference is first made independently for the parameters of each data set, whereupon the obtained posterior samples are used as observed data in a substitute
more &raquo; ... erarchical model, based on a scaled likelihood function. Compared to direct inference in a full hierarchical model, the approach has the advantage of being able to speed up convergence by breaking down the initial large inference problem into smaller individual subproblems with better convergence properties. Moreover it enables parallel processing of the possibly complex inferences of the source-specific parameters, which may otherwise create a computational bottleneck if processed jointly as part of a hierarchical model. The approach is illustrated with both simulated and real data.
<span class="external-identifiers"> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1603.09272v2">arXiv:1603.09272v2</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/zpky44sqqjccbn3ig7fx6ftsti">fatcat:zpky44sqqjccbn3ig7fx6ftsti</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20200905162005/https://arxiv.org/pdf/1603.09272v2.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/11/3f/113f73829a1e242b8c7d6d49ffdbab8d8f779151.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1603.09272v2" title="arxiv.org access"> <button class="ui compact blue labeled icon button serp-button"> <i class="file alternate outline icon"></i> arxiv.org </button> </a>