I am quite excited about the paper James Baillie, Joshua Bon, Judith Rousseau, and myself just arXived! A novel framework for measuring privacy we have been working on for at least the past year, partly through the previous Les Houches privacy workshops. In the spirit of these workshops and the larger scale ERC Synergy grant OCEAN, we develop therein a rather generic Bayesian game-theoretic perspective on achieving statistical privacy. It involves a Sender (observing the original data and delivering a limited output) and a Receiver (with potential adversarial intentions). The paper mostly focus on setting a theoretical framework, including the creation of new, purpose-driven privacy definitions that are rigorously justified, while also allowing for the assessment of existing privacy guarantees through game theory. While this was not our original intent, we show that pure and probabilistic differential privacy notions, in the Dwork et al. (2006) sense, are special cases of our framework. This setting provides new interpretations of the post-processing inequality. Furthermore, and somewhat more importantly, we also prove that our privacy guarantees can be established for deterministic algorithms, which are outside current privacy standards. Hopefully, we’ll make further progress at the incoming privacy workshop next month, to be held in Venice (again).
Archive for arXiv
persuasive (and Oceanic) privacy
Posted in Books, Mountains, pictures, Statistics, Travel, University life with tags #ERCSyG, adversarial strategy, arXiv, Bayesian decision theory, Bayesian privacy, decision-making agents, differential privacy, ERC, ERC Synergy Grant, fairness, French Alps, game theory, Les Houches, Ocean, uncertainty quantification, Università Ca' Foscari Venezia, Université Paris Dauphine, Venice, workshop on February 3, 2026 by xi'anprequential posteriors
Posted in Books, Statistics, University life with tags arXiv, Bayesian deep learning, data generating process, generalised Bayesian inference, ICSDS 2025, IMS, intractable likelihood, PhD students, prequential loss, probabilistic forecasting, Sevilla, SMC, Student Award, University of Warwick on December 15, 2025 by xi'an
Data assimilation is a fundamental task in updating forecasting models upon observing new data, with applications ranging from weather prediction to online reinforcement learning. Deep generative forecasting models (DGFMs) have shown excellent performance in these areas, but assimilating data into such models is challenging due to their intractable likelihood functions. This limitation restricts the use of standard Bayesian data assimilation methodologies for DGFMs. To overcome this, we introduce prequential posteriors, based upon a predictive-sequential (prequential) loss function; an approach naturally suited for temporally dependent data which is the focus of forecasting tasks. Since the true data-generating process often lies outside the assumed model class, we adopt an alternative notion of consistency and prove that, under mild conditions, both the prequential loss minimizer and the prequential posterior concentrate around parameters with optimal predictive performance. For scalable inference, we employ easily parallelizable wastefree sequential Monte Carlo (SMC) samplers with preconditioned gradient-based kernels, enabling efficient exploration of high-dimensional parameter spaces such as those in DGFMs. We validate our method on both a synthetic multi-dimensional time series and a real-world meteorological dataset; highlighting its practical utility for data assimilation for complex dynamical systems.
coupling-based approach to f-divergences diagnostics for MCMC
Posted in Books, Statistics, Travel, University life with tags arXiv, backward sampling, control variates, convergence diagnostics, effective sample size, embarrassingly parallel MCMC, f-divergence, importance sampling, χ² divergence, Kenilworth, Markov chain Monte Carlo algorithm, MCMC, National University Singapore, NUS, Rao-Blackwellisation, sampling, unbiased MCMC, Warwickshire on October 27, 2025 by xi'an
Adrien Corenflos (University of Warwick) and Hai-Dang Dau (NUS) just arXived their paper on MCMC diagnostics that Adrien told me about last month, while in Warwick.
“This [f-divergence] bound is clearly suboptimal since it does not vary in t and does not take into account the mixing of the Markov chain. We present a scheme where the weights are ‘harmonized’ as the Markov chain progresses, reflecting its mixing through the notion of coupling.”
They start by opposing the classical ergodic average and embarrassingly parallel estimates obtained by N parallel chains culled of their B initial values, to couplings used in standard diagnoses. Opting for the parallel perspective, maybe rekindling the diagnostic war of the early 1990s! The evaluation tool in the paper is based on f-divergences, like the χ² divergence which naturally relates to the effective sample size when considering weighted atomic measures. When consistent, these weighted approximations produce upper bounds on the f-divergence, with exact convergence in case of independence.
In my opinion the most exciting part of the paper stands with the ability to modify these weights along MCMC iterations, since the naïve sequential importance sampling argument I also use in class keeps them constant! The trick is to (be able to) couple randomly chosen parallel chains, with the weights being averaged at each coupling event. The resulting algorithm preserves expectation (in the importance sampling sense) and consistency (in the particle sense). Furthermore, the f-divergence bound based on the weights can only decrease between iterations, which reminds me of interleaving. And exponential convergence of the weights to uniform ones (under the strong assumption of a uniformly lower bounded probability of coupling). The paper concludes with interesting remarks on perfect sampling, Rao-Blackwellisation, control variates, and backward sampling.
A long-standing gap exists between the theoretical analysis of Markov chain Monte Carlo convergence, which is often based on statistical divergences, and the diagnostics used in practice. We introduce the first general convergence diagnostics for Markov chain Monte Carlo based on any f χ² -divergence, allowing users to directly monitor, among others, the Kullback–Leibler and the divergences as well as the Hellinger and the total variation distances. Our first key contribution is a coupling-based ‘weight harmonization’ scheme that produces a direct, computable, and consistent weighting of interacting Markov chains with respect to their target distribution. The second key contribution is to show how such consistent weightings of empirical measures can be used to provide upper bounds to f -divergences in general. We prove that these bounds are guaranteed to tighten over time and converge to zero as the chains approach stationarity, providing a concrete diagnostic.
integral priors for model comparison [2.0]
Posted in Books, Statistics, University life with tags arXiv, Bayesian inference, Bayesian model choice, Bayesian statistics, ergodicity, imaginary training sample, integral priors, Juan Antonio Cano, Markov chain, MCMC, Murcia, nested models, noninformative priors, reference priors, Spain, Universidad de Murcia on May 2, 2025 by xi'an
PCI – Statistics and machine learning
Posted in Books, Statistics, University life with tags academic journals, arXiv, Computo, machine learning, PCI, PCI Comput Stats, PCI Statistics and Machine Learning, PLoS ONE, preprint, submission on April 17, 2025 by xi'an
