Prediction and generation of binary Markov processes: Can a finite-state fox catch a Markov mouse?

Joshua B. Ruebeck, Ryan G. James, John R. Mahoney, James P. Crutchfield
2018 Chaos  
Understanding the generative mechanism of a natural system is a vital component of the scientific method. Here, we investigate one of the fundamental steps toward this goal by presenting the minimal generator of an arbitrary binary Markov process. This is a class of processes whose predictive model is well known. Surprisingly, the generative model requires three distinct topologies for different regions of parameter space. We show that a previously proposed generator for a particular set of
more » ... ry Markov processes is, in fact, not minimal. Our results shed the first quantitative light on the relative (minimal) costs of prediction and generation. We find, for instance, that the difference between prediction and generation is maximized when the process is approximately independently, identically distributed.
doi:10.1063/1.5003041 pmid:29390624 fatcat:vgwkyy4z6jb37pbkighycoslbu