Archive for University of Edinburgh

mostly Monte Carlo [09/10, PSC]

Posted in Statistics, University life with tags , , , , , , , , , , , , on October 4, 2026 by xi'an

The next episode of our mostly Monte Carlo seminar is next Friday (9 October) at PariSanté Campus (room #8) with speakers

15:00 – Víctor Elvira, University of Edinburgh

16:00 – Edoardo Bandoni, Université Paris Dauphine-PSL

Víctor Elvira, “Rethinking self-normalized importance sampling”

Self-normalized importance sampling (SNIS) is one of the most widely used Monte Carlo techniques for inference with unnormalized target distributions. Despite its usefulness, SNIS is often viewed simply as a normalized version of ordinary importance sampling, and many of its methodological questions remain largely unexplored. In this talk, we revisit SNIS from a unified perspective. We first introduce a generalized formulation of self-normalized importance sampling based on coupled proposals, showing that the classical SNIS estimator is only one member of a broader family of Monte Carlo estimators with new opportunities for variance reduction. We then consider the classical SNIS estimator and present adaptive algorithms that learn proposals tailored to its optimal proposal distribution, together with theoretical guarantees including consistency, asymptotic normality, and convergence of the proposal. Together, these developments suggest that self-normalized importance sampling should be regarded as a distinct Monte Carlo methodology, with its own theory, optimality principles, and algorithmic design.

Edoardo Bandoni, “Rate-Optimal Randomised Kernel Quadrature”

Kernel quadrature is widely used to approximate integrals of smooth functions, with the worst-case error typically decaying at the minimax rate n-α/d for smoothness α in dimension d. Existing rate-optimal methods often depend on deterministic point sets tailored to a specific kernel, making them sensitive to misspecification and less robust in practice. In this work, we study randomised quadrature methods with a focus on robustness rather than kernel-specific optimality. By minimising a tractable upper bound on the worst-case error, we obtain an explicit sampling distribution p*∝ πg with g=2d/(2α+d), which depends on the integration density π and on a but not on the kernel beyond its Sobolev order. Under a weak doubling condition on the design measure, independent samples from p* attain the minimax rate n-α/d. These assumptions cover a broad class of targets on compact and unbounded domains; we verify them explicitly for Beta-type densities, Gaussian measures, and Student-t distributions, the last of which yields the minimax rate n-min(α,(n+d/2)/d. This kernel-agnostic design improves robustness while maintaining optimal rates, and it applies beyond compact domains. The results provide both theoretical guarantees and a practical recipe for robust, rate-optimal randomised quadrature.

Scottish June

Posted in Mountains, pictures, University life with tags , , , , , , , , , , , , , , , on October 23, 2025 by xi'an

I just found out that three almost consecutive events of academic interest are taking place in Scotland next Spring: first, our very own Approximately Bayes ICMS workshop (on the Isle of Skye, rather than at the Bayes Centre in Edinburgh, where we held ABC in Edinburgh), on 17-22 May

the SIAM Conference on Optimization (OP26) in Edinburgh on 2-5 June

and the Monte Carlo + quasi Monte Carlo (MCqMC 2026) conference in Edinburgh on 8-11 June

While I cannot realistically (!) attend all of these events, this accumulation of meetings is a perfect opportunity to enjoy the Athens of the North (aka Dùn Èideann, from which Dunnedin in New Zealand originates!). And the surrounding mountains.

6th Workshop on Sequential Monte Carlo Methods (#2)

Posted in Mountains, pictures, Running, Statistics, Travel, University life with tags , , , , , , , , , , , , , , , , , , , , , , , on June 5, 2024 by xi'an

Managed to get back from the Pentland hills in time for the Wednesday afternoon session, which proved most interesting as close to my research interests!

Nicola Branchini presented his work with Victor Elvira (a close friend and coauthor, incidentally one of the organisers of the workshop!) on improving self normalised importance sampling by interpreting it as a ratio of estimators based on two samples (which may be the same) and attempting to optimise the joint distribution of said sample. The starting assumption is having (good) marginal importance functions, which means the goal here is in optimising a copula distribution targeting the ratio as quantity of interest. Optimality is however defined in terms of the approximate asymptotic variance of the ratio, which remains an approximation. The idea is nonetheless quite interesting and shows potential for connecting with bridge sampling and… AMIS! As an aside, the talk considered cases when the margins are multivariate, which requires a généralisation of Sklar’s theorem. Simo Särkä then demonstrated how highly parallel processors like GPUs can accommodate Bayesian filters and smoothers in state space models not requiring simulation, gaining a reduction in complexity from O(T) to O(log T). I had not really thought of parallel processing in the recent years, hence was quite pleased at hearing this resolution based on so-called associative scans, and see that implementations were already available in Julia/CUDA.

This was followed by a highly enjoyable poster session, including chats about ABC-SMC for discovery rates, infinite dimensional diffusions, Pareto smoothed importance samplings, &tc with posters by Hugo Marival (coauthor of our importance Monte Carlo recent paper) and Shreya Roy (a student at U of Warwick). With sunny views of Arthur’s Seat (and plenty of people at the top), contrary to the above! Followed by a private party dinner occupying half of a nearby and novel South Indian restaurant that proved quite tasty, local and definitely enjoyable.

For my last morning in town, albeit it was unrelated to the posted abstract, Pierre Del Moral spoke about noisy versions of the ensemble Kalman filter on linear diffusions that allowed for stable solutions under strong enough conditions, encompassing an impressive corpus of work over the past ten years. Alex Beskos presented antithetic multilevel methods for diffusions, which allow to improve the error in the discretisation, even though I did not fully get the whole idea (partly due to dozing out from time to time, a consequence of my last early rounds of Arthur’s Seat in the very early morn).

Daniel Paulin presented a novel unbiased method based on kinetic Langevin dynamics that combines advanced splitting methods with enhanced gradients, avoiding Metropolis correction by coupling and multilevel Monte Carlo approach, achieving unbiasedness by telescoping, but involving an avalanche of acronyms in the leapfrog/Gibbs steps.  And Adam Johansen (U of Warwick) on several recent papers of their divide-and-conquer filtering methods, introduced in a 2017 JCGS paper, following a decomposition of the state variable into low-dimensional components like branches and leaves of a tree.

off to Edinburgh [and SMC 2024]

Posted in Books, Mountains, pictures, Statistics, Travel, University life with tags , , , , , , , on May 12, 2024 by xi'an

IMG_9351Today I am off to Edinburgh for the SMC 2024 workshop run by the ICMS. Looking forward meeting with long time friends and new ones, and learning about novel directions in the field. And returning to Edinburgh I last visited in 2019 for the opening of the Bayes Centre. Hoping to enjoy the nearby Arthur’s Seat volcano and maybe farther away Munroes, depending on the program, train schedules, and…weather forecasts!

Mike’s obituary in the IMS Bulletin

Posted in Statistics with tags , , , , , , , , , on August 17, 2023 by xi'an