Inference for dynamic and latent variable models via iterated, perturbed Bayes maps

Edward L. Ionides, Dao NguyenYves AtchadéStilian Stoev, and Aaron A. King

PNAS

January 7, 2015

Abstract

Iterated filtering algorithms are stochastic optimization procedures for latent variable models that recursively combine parameter perturbations with latent variable reconstruction. Previously, theoretical support for these algorithms has been based on the use of conditional moments of perturbed parameters to approximate derivatives of the log likelihood function. Here, a theoretical approach is introduced based on the convergence of an iterated Bayes map. An algorithm supported by this theory displays substantial numerical improvement on the computational challenge of inferring parameters of a partially observed Markov process.