Archive for high dimensions

simulation based composite likelihood

Posted in Statistics with tags , , , , , on December 29, 2023 by xi'an

Lorenzo Rimella, Chris Jewell, and Paul Fearnhead have recently arXived a paper entitled Simulation Based Composite Likelihood, where they consider a composite likelihood approximation for running inference on HMM parameters under the specific scenario of HMMs on finite, high-dimension N, state spaces X with huge cost of order card (Χ)2N when computing the likelihood  by the forward algorithm:

“Inference for high-dimensional hidden Markov models is challenging due to the exponential-in-dimension computational cost of the forward algorithm.”

The authors make an assumption (2) of total factorisation across dimensions for both current hidden and current observed terms, given the previous hidden states, which is very very strong, if not resulting in a complete separation into independent component-wise HMMs. This helps however in deriving a Monte Carlo approximation of the likelihood of one component of the HMM sequence, the full likelihood being then approximated in a composite (likelihood) manner by the product of these component marginals.  The remaining difficulty of computing the marginals of the component-wise observed (pseudo-) Markov chains is attenuated

“by fixing the state of all but one component n of the latent process, [since] we can leverage the factorisation and calculate probabilities related to the time-trajectory of the remaining [latent] state”

but it requires simulation of the hidden chain, overall of order  O(PTN²card (X)²) when P is the number of MCMC simulations, which can be improved by a factor N by removing a feedback step through a further marginal likelihood approximation. Interestingly falling into a prediction-correction pattern usual in sequential simulations. All this demonstrates craftsmanship of a high order, even though the issue of using an approximate composite likelihood does not seem to be addressed.

 

Big Bayes postdoctoral position in Oxford [UK]

Posted in Statistics with tags , , , , , , , , , , , on March 3, 2022 by xi'an

Forwarding a call for postdoctoral applications from Prof Judith Rousseau, with deadline 30 March:

Seeking a Postdoctoral Research Assistant, to join our group at the Department of Statistics. The Postdoctoral Research Assistant will be carrying out research for the ERC project General Theory for Big Bayes, reporting to Professor Judith Rousseau. They will provide guidance to junior members of the research group such as PhD students, and/or project volunteers.

The aim of this project is to develop a general theory for the analysis of Bayesian methods in complex and high (or infinite) dimensional models which will cover not only fine understanding of the posterior distributions but also an analysis of the output of the algorithms used to implement the approaches. The main objectives of the project are (briefly): 1) Asymptotic analysis of the posterior distribution of complex high dimensional models 2) Interactions between the asymptotic theory of high dimensional posterior distributions and computational complexity. We will also enrich these theoretical developments by 3) strongly related domains of applications, namely neuroscience, terrorism and crimes, and ecology.

The postholder will hold or be close to completion of a PhD/DPhil in statistics together with relevant experience. They will have the ability to manage own academic research and associated activities and have previous experience of contributing to publications/presentations. They will contribute ideas for new research projects and research income generation. Ideally, the postholder will also have experience in theoretical properties of Bayesian procedures and/or approximate Bayesian methods.

data assimilation and reduced modelling for high-D problems [CIRM]

Posted in Books, Kids, Mountains, pictures, Running, Statistics, University life with tags , , , , , , , , , , , , , , , , , on February 8, 2021 by xi'an

Next summer, from 19 July till 27 August, there will be a six week program at CIRM on the above theme, bringing together scientists from both the academic and industrial communities. The program includes a one-week summer school followed by 5 weeks of research sessions on projects proposed by academic and industrial partners.

Confirmed speakers of the summer school (Jul 19-23) are:

  • Albert Cohen (Sorbonne University)
  • Masoumeh Dashti (University of Sussex)
  • Eric Moulines (Ecole Polytechnique)
  • Anthony Nouy (Ecole Centrale de Nantes)
  • Claudia Schillings (Mannheim University)

Junior participants may apply for fellowships to cover part or the whole stay. Registration and application to fellowships will be open soon.

end-to-end Bayesian learning [CIRM]

Posted in Books, Kids, Mountains, pictures, Running, Statistics, University life with tags , , , , , , , , , , , , , , , , , on February 1, 2021 by xi'an

Next Fall, there will be a workshop at CIRM, Luminy, Marseilles, on Bayesian learning. It takes place 22-29 October 2021 on this wonderful campus at the border with the beautiful Parc National des Calanques, in a wonderfully renovated CIRM building and involves friends and colleagues of mine as organisers and plenary speakers. (I am not involved!, but plan to organise a scalable MCMC workshop there the year after!) The conference is well-supported and the housing fees will be minimal since the centre is also subsidized by CNRS. The deadline for contributed talks and posters is 22 March, while it is 15 June for registration. Hopefully by this time the horizon will have cleared up enough to consider traveling and meeting again. Hopefully. (In which case I will miss this wonderful conference due to other meeting and teaching commitments in the Fall.)

Gabriel’s talk at Warwick on optimal transport

Posted in Statistics with tags , , , , , , on March 4, 2020 by xi'an