Monte Carlo Algorithms for the Partition Function and Information Rates of Two-Dimensional Channels

Mehdi Molkaraie, Hans-Andrea Loeliger
2013 IEEE Transactions on Information Theory  
The paper proposes Monte Carlo algorithms for the computation of the information rate of two-dimensional source / channel models. The focus of the paper is on binary-input channels with constraints on the allowed input configurations. The problem of numerically computing the information rate, and even the noiseless capacity, of such channels has so far remained largely unsolved. Both problems can be reduced to computing a Monte Carlo estimate of a partition function. The proposed algorithms use
more » ... tree-based Gibbs sampling and multilayer (multitemperature) importance sampling. The viability of the proposed algorithms is demonstrated by simulation results.
doi:10.1109/tit.2012.2212413 fatcat:eb5kvbcrinhg5ies5abhknt5zy