Archive for Kenilworth

likelihood-free posterior density learning at OWABI [30 April, 1pm GMT+1, 2pm CEST, 8am EST]

Posted in pictures, Running, Statistics, Travel, University life with tags , , , , , , , , , , , , , , , , on April 17, 2026 by xi'an

The next OWABI webinar will take place on 30 April, at 1pm Coventry time (2pm in Paris, 8am in Columbus, Ohio) and will feature

Oksana A. Chkrebtii (Ohio State University)

Likelihood-free Posterior Density Learning for Uncertainty Quantification in Inference Problems
Generative models and those with computationally intractable likelihoods are widely used to describe complex systems in the natural sciences, social sciences, and engineering. Fitting these models to data requires likelihood-free inference methods that explore the parameter space without explicit likelihood evaluations, relying instead on sequential simulation, which comes at the cost of computational efficiency and extensive tuning. We develop an alternative framework called kernel-adaptive synthetic posterior estimation (KASPE) that uses deep learning to directly reconstruct the mapping between the observed data and a finite-dimensional parametric representation of the posterior distribution, trained on a large number of simulated datasets. We provide theoretical justification for KASPE and a formal connection to the likelihood-based approach of expectation propagation. Simulation experiments demonstrate KASPE’s flexibility and performance relative to existing likelihood-free methods including approximate Bayesian computation in challenging inferential settings involving posteriors with heavy tails, multiple local modes, and over the parameters of a nonlinear dynamical system.

coupling-based approach to f-divergences diagnostics for MCMC

Posted in Books, Statistics, Travel, University life with tags , , , , , , , , , , , , , , , , , on October 27, 2025 by xi'an

Adrien Corenflos (University of Warwick) and Hai-Dang Dau (NUS) just arXived their paper on MCMC diagnostics that Adrien told me about last month, while in Warwick.

“This [f-divergence] bound is clearly suboptimal since it does not vary in t and does not take into account the mixing of the Markov chain. We present a scheme where the weights are ‘harmonized’ as the Markov chain progresses, reflecting its mixing through the notion of coupling.”

They start by opposing the classical ergodic average and embarrassingly parallel estimates obtained by N parallel chains culled of their B initial values, to couplings used in standard diagnoses. Opting for the parallel perspective, maybe rekindling the diagnostic war of the early 1990s! The evaluation tool in the paper is based on f-divergences, like the χ² divergence which naturally relates to the effective sample size when considering weighted atomic measures. When consistent, these weighted approximations produce upper bounds on the f-divergence, with exact convergence in case of independence.

In my opinion the most exciting part of the paper stands with the ability to modify these weights along MCMC iterations, since the naïve sequential importance sampling argument I also use in class keeps them constant! The trick is to (be able to) couple randomly chosen parallel chains, with the weights being averaged at each coupling event. The resulting algorithm preserves expectation (in the importance sampling sense) and consistency (in the particle sense). Furthermore, the f-divergence bound based on the weights can only decrease between iterations, which reminds me of interleaving. And exponential convergence of the weights to uniform ones (under the strong assumption of a uniformly lower bounded probability of coupling). The paper concludes with interesting remarks on perfect sampling, Rao-Blackwellisation, control variates, and backward sampling.

A long-standing gap exists between the theoretical analysis of Markov chain Monte Carlo convergence, which is often based on statistical divergences, and the diagnostics used in practice. We introduce the first general convergence diagnostics for Markov chain Monte Carlo based on any f χ² -divergence, allowing users to directly monitor, among others, the Kullback–Leibler and the divergences as well as the Hellinger and the total variation distances. Our first key contribution is a coupling-based ‘weight harmonization’ scheme that produces a direct, computable, and consistent weighting of interacting Markov chains with respect to their target distribution. The second key contribution is to show how such consistent weightings of empirical measures can be used to provide upper bounds to f -divergences in general. We prove that these bounds are guaranteed to tighten over time and converge to zero as the chains approach stationarity, providing a concrete diagnostic.

psyclepaths….

Posted in Running, Travel with tags , , , , , , , , , , , , , , , , , on August 31, 2024 by xi'an

“In the six days since a law to prosecute dangerous cyclists was announced, somewhere close to 30 people will have been killed on UK roads, none of them struck by bikes. About 500 more will have suffered serious, potentially life-changing injuries, with pretty much all connected to motor vehicles. Again, going on the statistical averages, over those same six days, slightly more than 1,600 people across the UK will have died due to illnesses associated with physical inactivity. Riding a bike cuts your likelihood of developing such conditions by about half.” Peter Walker, Bike blog, The Guardian, 21 May 2024

Indeed, the UK Government is creating a new offence of “causing death or serious injury by dangerous, careless or inconsiderate cycling”! Where dangerous remains to be properly defined and assessed. (As most cyclists have no speedometer, and the remaining ones may prove more dangerous checking their speed on their Garmin watch! As I am when going downhill to Porte de Versailles around 40km/h…, if not 52mph as hilariously denounced by the predictably cyclophobic Daily Mail!) Another illustration of overreaction, cheap fear-mongering, and electoralist populism based on a single horrific deadly accident, and mostly missing the elephant in the room, that is, the lack of proper uninterrupted bike lanes and other infrastructures that should not be shared with pedestrians, cars, or buses. And the intentionally hidden disproportion between car-caused and cycle-caused deaths. (Of course, I am totally biased towards cycling, while some will consider my running managing red lights wanton and furious! But I stand by the fact that cycling usually gets the worst of car and pedestrian regulations.)

As an aside, the pun in the title first came to me as a joke told by Tony O’Hagan, presumably told at a Valencia meeting decades ago. Apparently it is popular enough to be adopted by cycling enthusiasts.

connection between tempering & entropic mirror descent

Posted in Books, pictures, Running, Statistics, Travel, University life with tags , , , , , , , , , , , , , , , , , , , , , , on April 30, 2024 by xi'an

The next One World ABC webinar is this  Thursday,  the 2nd May, at 9am UK time, with Francesca Crucinio (King’s College London, formerly CREST and even more formerly Warwick) presenting

“A connection between Tempering and Entropic Mirror Descent”.

a joint work with Nicolas Chopin and Anna Korba (both from CREST) whose abstract follows:

This work explores the connections between tempering (for Sequential Monte Carlo; SMC) and entropic mirror descent to sample from a target probability distribution whose unnormalized density is known. We establish that tempering SMC corresponds to entropic mirror descent applied to the reverse Kullback-Leibler (KL) divergence and obtain convergence rates for the tempering iterates. Our result motivates the tempering iterates from an optimization point of view, showing that tempering can be seen as a descent scheme of the KL divergence with respect to the Fisher-Rao geometry, in contrast to Langevin dynamics that perform descent of the KL with respect to the Wasserstein-2 geometry. We exploit the connection between tempering and mirror descent iterates to justify common practices in SMC and derive adaptive tempering rules that improve over other alternative benchmarks in the literature.

a mere £1,500 dinner

Posted in Travel, Wines with tags , , , , , , , , , , , , , , , , , on February 5, 2024 by xi'an

As a one-time patron of the X on Kenilworth, I received an invitation to join the fundraising Bocuse d’Or UK gala diner, at a mere £1,500 each (with the helpful addition that 10 tickets would cost £10,500!]. Despite being partial to foie gras, buckwheat, scallops, Jerusalem artichokes, and vin jaune, methinks I will pass the offer since the wine list is not included…

Bocuse d’Or UK Fundraising Gala Menu

Canapés
Smoked duck doughnut, celeriac, Perigord [sic] black truffle
Cured trout aged in beeswax, timut pepper, pickled Potimarron, dashi jelly
Mushroom tuile, wild mushroom parfait, Douglas pine (vegan)
Seaweed tartelette, oyster and Coco bean sphere, Petrossian caviar
Cracker with Duperier [sic] foie gras, Gewürztraminer jelly, sancho pepper
Marco Zampese, Hélène Darroze at The Connaught

Shetland mussel bavaroise scented with turmeric
Lemon gel with fresh coriander and buckwheat grains
Daniel Stucki, The Lecture Room & Library at sketch

Hand-dived scallop, citrus beurre blanc and Petrossian caviar
Jean-Philippe Blondet, Alain Ducasse at The Dorchester

Megrim sole filled with truffle flavoured mousse baked in puff pastry
Vin jaune and langoustine sauce
Alain Roux, The Waterside Inn

Grass fed, 60-day dry aged beef
Jerusalem artichoke, crones, black garlic
Matt Abé, Restaurant Gordon Ramsay

‘Core apple’
Clare Smyth, CORE by Clare Smyth

“Anvil”
Caramel mousse with our miso, apple and spruce
Simon Rogan, L’Enclume

“Like a kid in a sweet shop”
Edward Cooke, The Fat Duck