Monte Carlo Computation of the Fisher Information Matrix in Nonstandard Settings

James C Spall
<span title="">2005</span> <i title="Informa UK Limited"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/uuo44cjltzg2flanabrks3a5fi" style="color: black;">Journal of Computational And Graphical Statistics</a> </i> &nbsp;
The Fisher information matrix summarizes the amount of information in the data relative to the quantities of interest. There are many applications of the information matrix in modeling, systems analysis, and estimation, including confidence region calculation, input design, prediction bounds, and "noninformative" priors for Bayesian analysis. This article reviews some basic principles associated with the information matrix, presents a resamplingbased method for computing the information matrix
more &raquo; ... ogether with some new theory related to efficient implementation, and presents some numerical results. The resampling-based method relies on an efficient technique for estimating the Hessian matrix, introduced as part of the adaptive ("second-order") form of the simultaneous perturbation stochastic approximation (SPSA) optimization algorithm.
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1198/106186005x78800">doi:10.1198/106186005x78800</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/do6tcuxjujdfxhhd73inwjx2bq">fatcat:do6tcuxjujdfxhhd73inwjx2bq</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20180721163807/http://www.jhuapl.edu/SPSA/PDF-SPSA/Spall_JCGS05_000.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/f9/d0/f9d0784c7d49ce281d1b8f93159cf1048bd54080.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1198/106186005x78800"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> Publisher / doi.org </button> </a>