About the event

Department of Mathematics & Statistics Colloquium

Dr. Eric Chi

Associate Professor, Department of Statistics, Rice University

MCMC Importance Sampling via Moreau-Yosida Envelopes

Abstract: Markov chain Monte Carlo (MCMC) is the workhorse computational algorithm employed for inference in Bayesian statistics. Gradient-based MCMC algorithms are known to yield faster converging Markov chains. In modern parsimonious models, the use of non-differentiable priors is fairly standard, yielding non-differentiable posteriors. Without differentiability, gradient-based MCMC algorithms cannot be employed effectively. Recently proposed proximal MCMC approaches, however, can partially remedy this limitation. These approaches employ the Moreau-Yosida (MY) envelope to smooth the nondifferentiable prior enabling sampling from an approximation to the target posterior. In this work, we leverage properties of the MY envelope to construct an importance sampling paradigm to correct for this approximation error. We establish asymptotic normality of the importance sampling estimators with an explicit expression for the asymptotic variance which we use to derive a practical metric of sampling efficiency. Numerical studies show that the proposed scheme can yield lower variance estimators compared to existing proximal MCMC alternatives.

Speaker Bio: Dr. Eric Chi is an associate professor in the Department of Statistics at Rice University. Dr. Chi is a recipient of the NSF Career Award and has an M.S. in Electrical Engineering. His current research interests are in statistical learning and numerical optimization, and their application to analyzing large and complicated modern data in biological science and engineering applications.