Archive for generalised Bayesian inference

OWABI⁷, 29 January 2026: Sequential Neural Score Estimation (11am UK time)

Posted in Books, Statistics, University life with tags , , , , , , , , , , on January 21, 2026 by xi'an

Speaker: Louis Sharrock (University College London)

Title: Sequential Neural Score Estimation: Likelihood-free inference with conditional score base diffusion models
Abstract: We introduce Sequential Neural Posterior Score Estimation (SNPSE), a score-based method for Bayesian inference in simulator-based models. Our method, inspired by the remarkable success of score-based methods in generative modelling, leverages conditional score-based diffusion models to generate samples from the posterior distribution of interest. The model is trained using an objective function which directly estimates the score of the posterior. We embed the model into a sequential training procedure, which guides simulations using the current approximation of the posterior at the observation of interest, thereby reducing the simulation cost. We also introduce several alternative sequential approaches, and discuss their relative merits. We then validate our method, as well as its amortised, non-sequential, variant on several numerical examples, demonstrating comparable or superior performance to existing state-of-the-art methods such as Sequential Neural Posterior Estimation (SNPE).
Keywords: diffusion models, simulation based inference, sequential methods.
Reference: L. Sharrock, J. Simons, S. Liu, M. Beaumont, Sequential Neural Score Estimation: Likelihood-Free Inference with Conditional Score Based Diffusion Models. PLMR, 235, 44565-44602, 2024.

a (sunny, crisp) day at ICSDS 2025

Posted in pictures, Running, Statistics, Travel, University life with tags , , , , , , , , , , , , , , , , , , , , , , , , , , , , on December 19, 2025 by xi'an

While my first day at ICSDS 2025 was somewhat hectic, having realised late the night before that I was giving a talk!—I had forgotten I had submitted a title at registration time and never received any communication from the organisers, including (or excluding) a request for an abstract. I thus hastily updated my November talk in Sevilla for my December talk in Sevilla! but paid less attention than needed to the sessions I attended—, Wednesday was more peaceful—esp. after a 16K run along the Guadalquivir—and I engaged into two great Bayesian learning sessions, one that seemed designed for me!, involving my (40y long friend) Ed George on his latest result on proper prior minimaxity and shrinkage, with our late friend Bill Strawderman as a co-author since they worked on the problem prior to Bill’s demise, Charles Margossian on variational inference preserving some symmetries in the target and hence keeping the same statistics, with elliptically symmetric families, and Fletcher Christensen on DIC for some mixed models, with references to our “DIC’s eights” paper (but still picking one version of DIC in the end!)

The second session was on prediction learning!—with me as the chair, as I realized one minute before! AI !—with (my friend) Veronika Rockova using AI predictions as a prior predictive and connecting them with Bayesian nonparametrics, Kenyon Ng (who visited me last Spring) on a similar approach using pretrained transformers like TabPFN and martingale posterior inference, Lorenzo Cappello in a generalisation of martingale prediction and Andrea Ghiglietti on the mathematics of an involved urn system.


The afternoon session was a plenary talk by Daniela Witten in the magnificent building of the Real Fabrica de Tabacos, but the room was unfortunately too small for the audience and I could not enter. Hopefully her talk will have a significant intersection with the CRiSM colloquium she delivers in Warwick late January. I thus walked around the old town till the following poster session, held in the Real Fabrica courtyard, under the sun. As I got involved into a deep discussion of the relevance of mirror meetings (which I defend!) versus the dangers on principal (parent) conferences (which can be mitigated by the mirror conference participants registering, to some extent, for the principle one)—more to come on the ‘Og and in the ISBA Bulletin!—, I did not peruse the available posters, sorry…

And, by the way, the conference organisers also revealed the location of ICSDS 2026 which is Croatia, my first bet! In the city of Split we visited in 2023.

prequential posteriors

Posted in Books, Statistics, University life with tags , , , , , , , , , , , , , on December 15, 2025 by xi'an

Data assimilation is a fundamental task in updating forecasting models upon observing new data, with applications ranging from weather prediction to online reinforcement learning. Deep generative forecasting models (DGFMs) have shown excellent performance in these areas, but assimilating data into such models is challenging due to their intractable likelihood functions. This limitation restricts the use of standard Bayesian data assimilation methodologies for DGFMs. To overcome this, we introduce prequential posteriors, based upon a predictive-sequential (prequential) loss function; an approach naturally suited for temporally dependent data which is the focus of forecasting tasks. Since the true data-generating process often lies outside the assumed model class, we adopt an alternative notion of consistency and prove that, under mild conditions, both the prequential loss minimizer and the prequential posterior concentrate around parameters with optimal predictive performance. For scalable inference, we employ easily parallelizable wastefree sequential Monte Carlo (SMC) samplers with preconditioned gradient-based kernels, enabling efficient exploration of high-dimensional parameter spaces such as those in DGFMs. We validate our method on both a synthetic multi-dimensional time series and a real-world meteorological dataset; highlighting its practical utility for data assimilation for complex dynamical systems.

post-Bayes workshop at UCL [15 & 16 May 2025]

Posted in pictures, Statistics, Travel, University life with tags , , , , , , , , , , , , , , , , , on April 4, 2025 by xi'an

University College London (UCL) is organising a workshop on post-Bayes inference  and asked to post the announcement (despite my feeling that we have not entered the post-Bayes era!). So here it is:

Over the course of two days, they will host eight invited talks from leaders across the post-Bayesian landscape, spanning from PAC Bayes and generalised Bayes to predictive resampling and martingale posteriors. Alongside these, they will host six contributed talks, and a poster session to ignite discussion and innovation in our growing community. The workshop will complement the post-Bayesian seminar series.

Registration is now open, and they are actively accepting talk and poster submissions! (Deadline for submissions: April 11th, 2025.) Travel support for early career researchers will be available and announced closer to the date. See the website for more information. The workshop will take place in Bentham House, UCL, London.

[As a personal aside, we just learned that our proposal for an approximate(ly) Bayes workshop supported by ICMS (Edinburgh) and set on the magical Isle of Skye had been accepted! To be held in Spring 2026!]

OWAB [season] I

Posted in Statistics, University life with tags , , , , , , , , , , , , on November 23, 2024 by xi'an

Our “new” seminar series, the One World Approximate Bayesian Inference (OWABI) Seminar, will see its second OWABI talk given on Thursday 28 November at 11am UK time. The speaker is Jeremias Knoblauch (University College London), who will talk about

Post-Bayesian machine learning

Abstract: In this talk, I provide my perspective on the machine learning community’s efforts to develop inference procedures with Bayesian characteristics that go beyond Bayes’ Rule as an epistemological principle. I will explain why these efforts are needed, as well as the forms which they take. Focusing on some of my own contributions to the field, I will trace out some of the community’s most important milestones, as well as the challenges that lie ahead. Throughout, I will provide success stories of the field, and emphasise the new opportunities that open themselves up to us once we dare to go beyond orthodox Bayesian procedures.

Keywords: Generalised Bayes; robustness; Bayesian machine learning.