A new episode of our mostly Monte Carlo seminar, very soon coming near you (if in Paris):
On Friday 13/02/26, from 3-5pm at PariSanté Campus
15h00: Pierre Del Moral (INRIA, Bordeaux)
On the Kantorovich contraction of Markov semigroup
We present a novel operator theoretic framework to study the contraction properties of Markov semigroups with respect to a general class of Kantorovich semi-distances, which notably includes Wasserstein distances. This rather simple contraction cost framework combines standard Lyapunov techniques with local contraction conditions. Our results can be applied to both discrete time and continuous time Markov semigroups, and we illustrate their wide applicability in the context of (i) Markov transitions on models with boundary states, including bounded domains with entrance boundaries, (ii) operator products of a Markov kernel and its adjoint, including two-block-type Gibbs samplers, (iii) iterated random functions and (iv) diffusion models, including overdampted Langevin diffusion with convex at infinity potentials.
16h00: Bob Carpenter (Flatiron Institute, New York)
GIST, WALNUTS, and Continuous Nutpie: mass-matrix and step-size adaptation for Hamiltonian Monte Carlo
I will introduce Gibbs self tuning (GIST), our new technique for coupling tuning parameters and conditionally Gibbs-sampling them per iteration in Hamiltonian Monte Carlo. Then I will turn to the within-orbit adaptive NUTS (WALNUTS) sampler, which adapts the step size every leapfrog step in order to conserve the Hamiltonian. Empirical evaluations on varying multi-scale target distributions, including Neal’s funnel and the Stock-Watson stochastic volatility time-series model, demonstrate that WALNUTS achieves substantial improvements in sampling efficiency and robustness. I will review the Nutpie mass-matrix adaptation scheme, which is designed to minimize Fisher divergence by estimating the mass matrix as the geometric midpoint (aka barycenter) between the inverse covariance of the draws and the covariance of the scores of the draws. Then I will describe a continuously adapting version that adapts per iteration by continuously discounting the past rather than updating in fixed blocks. I will also show how the Adam optimizer outperforms dual averaging for step-size adaptation. I will conclude by considering a lock-free multi-threading implementation that automatically monitors adaptation and sampling for convergence for automatic stopping.
![\mathbb E[y|X=x] = \mathbb E\left[y\frac{f_{XY}(x,y)}{f_X(x)f_Y(y)}|X=x\right] = \frac{\mathbb E\left[y\frac{f_{XY}(x,y)}{f_Y(y)}|X=x\right]}{f_X(x)}](https://s0.wp.com/latex.php?latex=%5Cmathbb+E%5By%7CX%3Dx%5D+%3D+%5Cmathbb+E%5Cleft%5By%5Cfrac%7Bf_%7BXY%7D%28x%2Cy%29%7D%7Bf_X%28x%29f_Y%28y%29%7D%7CX%3Dx%5Cright%5D+%3D+%5Cfrac%7B%5Cmathbb+E%5Cleft%5By%5Cfrac%7Bf_%7BXY%7D%28x%2Cy%29%7D%7Bf_Y%28y%29%7D%7CX%3Dx%5Cright%5D%7D%7Bf_X%28x%29%7D&bg=000000&fg=B0B0B0&s=0&c=20201002)
I had missed the séminaire parisien de statistique for most of the Fall semester, hence was determined to attend the first session of the year 2023, the more because the talks were close to my interest. To wit, 
Last but not least!, my friend Randal talked about his 
The third and final day of the workshop was shortened for me as I had to catch an early flight back to Paris (and as I got overly conservative in my estimation for returning to JFK, catching a train with no delay at Penn Station and thus finding myself with two hours free before boarding, hence reviewing remaining Biometrika submission at the airport while waiting). As a result I missed the afternoon talks.
The morning was mostly about using scores for simulation (a topic of which I was mostly unaware), with 
