Archive for IHP

repulsive sampling

Posted in Books, Statistics, University life with tags , , , , , , , , , , , , , , , on January 31, 2024 by xi'an

After a long absence from the monthly Séminaire Parisien de Statistique I attended one today at IHP, including a talk by Diala Hawat on repelled point processes for numerical integration by Hawat et al. The goal is to get (and prove) a universal variance improvement for numerical integration by applying a form of determinantal processes to initial simulations, as eg iid (Poisson process) sampling (without accounting for the O(N²) cost in moving these points). The repelled points are obtain by a single (why single?) move based on a force function (as shown in the slide below), inspired by a Coulomb potential (in the sense that said move appears as one gradient step along the potential). Which reminded me of the pinball sampler, even though the inverse norm was just there to create infinite repulsion near each point. A surprising feature of this repelling step is that it even modifies a (QMC) Sobol process with also an (empirical) improvement in the variance. I wonder if one could construct an MCMC algorithm that would target a joint distribution, maybe via a copula representation, maybe via an equivalent version of HMC.


As an aside, the Bakhvalov results on the existence of a worst case integrand for any deterministic or random sequence (see top slide) made me wonder what the shape of this worst case function is, esp. for a QMC sequence (eg, Sobol). And whether or not they are of any relevance as a counterfactor to the optimal importance functions.

inhomogeneous random systems [Institut Henri Poincaré, 23-24 Jan 2024]

Posted in Statistics, Travel, University life with tags , , , , , , , , , , , on January 15, 2024 by xi'an

sweet 60’s

Posted in Kids, pictures, Statistics, University life with tags , , , , , , , , , , , , , , , , , on October 9, 2023 by xi'an


The traditional group picture at the end of Eric Moulines’ 60th anniversary celebration, at IHP, Paris. Some of the participants had already left (and I am carefully hidding in the background). Among the celebrating talks reflecting the huge thematic diversity of EM’s carreer, Patrick Flandrin gave a great historical account of a certain Édouard-Léon Scott de Martinville and his invention of a sound recording device that did not meet with the same success as the later phonograph by Edison. A song he had registered in 1860 was retrieved in 2008 by a team of the Lawrence Berkeley National Laboratory, making it the earliest known intelligible voice recording in existence! Jean-François Cardoso explained how the team at Institut d’Astrophysique de Paris produced a near optimal estimate of the Cosmic Microwave Background (CMB) by linear projections preserving normality. Sara Filippi exposed a variational Bayes approach to selecting groups of variables in a GLM. Gareth Roberts illustrated retrospective sampling with his recent foray with Jeff Rosenthal in the lack of uniformity in the FIFA World Cup draws. Anatoli Iouditski spoke about a recent work on polyhedral estimation in statistical linear inverse problems. And Elisabeth Gassiat strolled through recent works on inference for hidden Markov models, including one at NeurIPS 2021 with Aapo Hyvärinen and others on nonlinear ICA. This was quite a fun meeting, with plenty of anecdotes and a few older pictures (even though I could not find any prior to 2005, which may have been the year I bought my first digital camera!)

Éric turns 60

Posted in Books, Mountains, Statistics, Travel, University life with tags , , , , , , , , , , , , , on July 14, 2023 by xi'an

Conférence en l’honneur d’Eric Moulines

13-14 sept. 2023 IHP Paris (France)

There will be a conference / Festschrift held for the 60th birthday of Eric Moulines [longtime friend, coauthor, ERC Synergy co-PI, whom I almost killed when missing a catch on Dent Parrachée!] at Institut Henri Poincaré, Paris, on 13 and 14 September 2023. Registration is free, but compulsory.

These two days will celebrate the variety of the research topics covered by Eric Moulines over thirty years and the broad and thorough impact he had on many different scientific communities. In particular, through more than 100 papers published in highly selective journals, he has made essential contributions in as many fields as statistical signal processing, time series analysis, inference in partially observed models, non-linear filtering, computational statistics, Markov Chain Monte Carlo, stochastic optimization methods, as well as hot topics related to artificial intelligence like generative models, variational inference or Bayesian machine learning.

séminaire parisien de statistique [09/01/23]

Posted in Books, pictures, Statistics, University life with tags , , , , , , , , , , , , , , , , on January 22, 2023 by xi'an

I had missed the séminaire parisien de statistique for most of the Fall semester, hence was determined to attend the first session of the year 2023, the more because the talks were close to my interest. To wit, Chiara Amorino spoke about particle systems for McKean-Vlasov SDEs, when those are parameterised by several parameters, when observing repeatedly discretised versions, hereby establishing the consistence of a contrast estimator of these estimators. I was initially confused by the mention of interacting particles, since the work is not at all about related with simulation. Just wondering whether this contrast could prove useful for a likelihood-free approach in building a Gibbs distribution?

Valentin de Bortoli then spoke on diffusion Schrödinger bridges for generative models, which allowed me to better my understanding of this idea presented by Arnaud at the Flatiron workshop last November. The presentation here was quite different, using a forward versus backward explanation via a sequence of transforms that end up approximately Gaussian, once more reminiscent of sequential Monte Carlo. The transforms are themselves approximate Gaussian versions relying on adiscretised Ornstein-Ulhenbeck process, with a missing score term since said score involves a marginal density at each step of the sequence. It can be represented [as below] as an expectation conditional on the (observed) variate at time zero (with a connection with Hyvärinen’s NCE / score matching!) Practical implementation is done via neural networks.

Last but not least!, my friend Randal talked about his Kick-Kac formula, which connects with the one we considered in our 2004 paper with Jim Hobert. While I had heard earlier version, this talk was mostly on probability aspects and highly enjoyable as he included some short proofs. The formula is expressing the stationary probability measure π of the original Markov chain in terms of explorations between two visits to an accessible set C, more general than a small set. With at first an annoying remaining term due to the set not being Harris recurrent but which eventually cancels out. Memoryless transportation can be implemented because C is free for the picking, for instance the set where the target is bounded by a manageable density, allowing for an accept-reject step. The resulting chain is non-reversible. However, due to the difficulty to simulate from the target restricted to C, a second and parallel Markov chain is instead created. Performances, unsurprisingly, depend on the choice of C, but it can be adapted to the target on the go.