Archive for Scotland
Pìobaireachd Nan Eun [Brìghde Chaimbeul]
Posted in Mountains, Travel with tags bagpipes, Brìghde Chaimbeul, folklore, Gaelic, Gaelic singing, Scotland, Scottish Gaelic, Scottish Highlands, Skye, smallpipes, uilleann pipes, Western Isles, youtube on August 11, 2025 by xi'an
Seminal ideas and controversies in Statistics [book review]
Posted in Books, Mountains, pictures, Statistics, Travel, University life with tags ABC model choice, ACEMS, Adelaide, anti-vaccine, ASA, ASC 2012, Australia, autism, Bayesian bootstrap, Bayesian lasso, Biometrika, blonde, book cover, bootstrap, Bruce Lindsay, Calyampudi Radhakrishna Rao, Census, CHANCE, classics, controversies, CRC Press, Cuillin ridge, David Blackwell, econometrics, EDA, EM algorithm, estimating equations, FDR, finite mixtures, Gibbs sampling, Glasgow, Grace Wabha, Heinz, history of statistics, hypothesis testing, ICMS, International Prize in Statistics, James-Stein estimator, JASA, Jerzy Neyman, John Tukey, JRSS, machine learning, mathematical statistics, MCMC, Neyman-Pearson tests, pickles, posterior predictive check, Rashomon, replicability, ridge regression, Roderick Little, Ronald Fisher, Ryûnosuke Akutagawa, sabbatical, Scotland, shrinkage estimation, Skye, Stein's paradox, Steve Fienberg, the inaccessible pinacle, The Likelihood Principle, toothbrush moustache, Université Paris Dauphine, World Fertility Survey on May 24, 2025 by xi'an
CRC Press sent CHANCE this book for review. Since the topic was of clear interest to me, with an author who significantly contributed to the field—my only recollection meeting Roderick Little was during the Australian Statistical Conference in Adelaïde, in 2012, at the start of my Oz 2012 Tour!—, I took the opportunity of the nearest weekend to browse through Seminal ideas and controversies in Statistics. I like very much the idea of selecting a dozen key papers in the history of Statistics and of discussing why. In fact, this reminded me of my classics seminar, which lasted the few years I was 100% in charge of the Master program in Dauphine (and which I hope I could restart!). Checking the list of the papers I then suggested my students, I see some overlap with 9 papers out of the 15 groups. (I also remember Steve Fienberg making suggestions for that list, while he was spending a sabbatical in Paris at CREST.) Given that community of focus and purpose, and contrary to my wont, I have really very little of substance to criticize or wish about the book. The less when reading the following
“On a personal note, I met Yates [author of a 1984 paper on tests for 2×2 contingency tables discussing the relevance of conditioning on one or both margins], a charming man, when I was a young graduate student who knew next to nothing about statistics; we discussed the joys of traversing the Cuillin Ridge in Skye.”
since completing that ridge remains high in my mountain-climbing bucket-list! (Possibly next year, since we are running an ICMS workshop on the Island.)
The first paper in the series is more than a foundational paper since (The) Fisher’s 1922 paper is about creating (almost) ex nihilo the field of (modern) mathematical statistics. I don’t know if there is any equivalence in other scientific disciplines of such an impact (and of such a man)… Roderick Little manages to convincingly engage with Fisher’s dismissive views on (not yet called) Bayesian analysis, although, to the latter’s defence, the formalisation of Bayesian inference at that time had not yet emerged. The second chapter is discussing Yates’ 1984 paper on tests for 2×2 contingency tables that he wrote 50 years after writing the original one in the first volume of JRSS. Roderick Little adds a detailed Bayesian analysis with the three standard reference priors, Jeffreys’ version proving quite close to Fisher’s exact test (conditional on both margins). The third chapter is aiming at the generic challenge of hypothesis testing, from the well-known opposition between Fisher and Neyman (both on the cover), to questioning the sanity of hard-set thresholds (with a mention of our American Statistician call to abandon (shi)p!). The later (thus) refers to the recent literature on the replicability crisis and the now famous ASA statement on p-values by Ron Wasserstein and Nicole Lazar, analysed in the chapter. But I would have like to read another full section on alternatives to hypothesis testing. While now a niche interest (imho), Fisher’s attempt at creating a posterior distribution without a prior, aka fiducial inference, is discussed in Chapter 4 with the Behrens-Fisher problem as the illustrating example. The chapter feels rather anticlimactic, with the comparison relying on the (Malay) Ghosh and Kim (2001) simulation results.
Birnbaum’s (1962) likelihood principle is the topic of Chapter 5 (and I cannot remember any of my students choosing this paper over the years, although there was at least one). Roderick Little recalls some sentences from the JASA discussion as an appetiser, a reminder of the time when these discussions could turn in scathing attacks. The chapter contains excerpts from Berger and Wolpert (1988)—which they were writing while I was spending a year at Purdue and which I have always recommended to my PhD students, albeit not for the classic seminar. It then moves to the controversies that surround this principle since its inception, in particular those accumulated by Deborah Mayo (also on the cover) as reported on the ‘Og. In the recent years, I have become less excited about the LP, in part due to the imprecision in its statement, which opens the door to conflicting interpretations. And in part due to the scarcity of models with non-trivial sufficient statistics. (I am also wondering if the sufficiency issue we highlighted in our ABC model choice criticism does relate to the mixture example at the end of the chapter.)
The next chapter is one all for compromise, through the calibrated Bayes perspective that credible statements should be close to confidence statements in the long run. Which I remember him presenting at ASC 2012. The concept is found in the very 1984 paper by Don Rubin (also on the cover) that contains the concept behind Approximate Bayesian Computation (ABC). And the chapter proceeds by listing strengths and weaknesses of frequentist and Bayesian perspectives, towards a fusion of both., e.g. though posterior predictive checks.
While the choice of a (general public) paper from Scientific American may sound surprising in Chapter 7, with Efron’s (on the cover) and Morris’ 1977 Stein’s paradox, I cannot but applaud, the more because this was the first paper I read when starting my PhD on the James-Stein estimators. Although this may sound like happening eons ago, the James and Stein (1961) paper—which is my age!—”created a considerable backlash” by toppling unbiasedness from its pedestal and exhibiting a paradox that 1+1+1≠3… Which Little reinterprets via a random effect (or Bayesian hierarchical) model. (And a chapter where I learned that Little’s father was a journalist, a characteristic he shared with Bruce Lindsay, as I found at Blonde, Glasgow, during an ICMS workshop). Relatedly, the next chapter is about the “57 varieties [of regression] paper” by Demptster, Schatzoff and Wermuth (1977). Apparently connected with Heinz 57 varieties of pickles. The paper considers Stein and ridge and variable selections versions for variable selection. The chapter also covers (Bayesian) Lasso and BART, as well as a brief all too brief mention of Spike & Slab priors—with my friend Veronika Ročková missing from the authors’ index!—, but I was expecting from the title other, robust, forms of regression like L¹ regression and econometrics digressions. Chapter 10 can however been seen as a proxy since covering generalized estimating equations from a 1986 Biometrika paper of Liang and Zeger, with no Bayesian aspect (and an expected appearance of Communications in Statistics B).
Chapter 9 covers the almost immediately classic 1995 paper of Benjamini and Hochbeg on multiple regressions (that Series B turned into a discussion paper ten years later!). Although it spends more time on Berry’s (2012) recommendations than on FDR. The computational Chapter 11 brings together Efron’s (1979) bootstrap [with his picture on the cover] and MCMC, represented by the founding paper of Gelfand and Smith (1990, if mistakenly set in 1988 on p140). A bit of a strange mix imho as the former is more inferential than computational. And not giving the EM algorithm that much space. And not questioning MCMC methods as a good proxy to posterior distributions. Tukey’s Future of Data Analysis (as founding exploratory data analysis) and Breiman’s Two cultures (as launching statistical machine learning) meet in Chapter 12. (With a reminder that the latter invokes Occam’s razor—which may not be that appropriate for hugely overparameterised machine learning black boxes—and…the Rashomon principle! Meaning that distinct models may all fit the same data. Let me nitpickingly add the reference to Ryûnosuke Akutagawa as the author of Rashômon and other stories that Kurosawa adapted in his splendid movie). The chapter contains critical remarks from David Cox, Brad Efron, David Bickel, and Andrew Gelman, with a further section on Little’s view on modelling.
The last three chapters are on design and sampling, in connection with Little’s (and Rubin’s) works in the area. With a 1934 paper of Neyman (whose picture on the cover could have been chosen differently, albeit no fault of Neyman [or of Little!] that his toothbrush style of moustache dramatically got out of fashion!). With a return to calibrated Bayes and a reminiscence of Little’s time at the World Fertility Survey but (apparently) no mention of the probabilistic aspects of modern censuses (that saw my friends Steve Fienberg on the one side and Larry Brown and Marty Wells on the other side argue for and against it!), again relating to the reliance on statistical models. Chapter 14 relates randomized clinical trials to causality, which makes a (worthy) appearance there. Roderick Little also makes a clear case there against the retracted study linking vaccines and autism, a call that will unlikely not reach the current Trump administration and its Secretary of Health.
The book concludes with a list of twenty style and grammar suggestions for improved writing.
As should be crystal-clear from the above, I quite enjoyed the book and would definitely use its reading list in a graduate course whenever the opportunity arises. Once again, some choices are more personal to the author than others, and I would have place more emphasis on the fantastic Dawid, Stone and Zidek (1973)—with Jim Zidek also missing from the author index—, but all make sense in a walk through statistical classics. Let me however regret the absence therein of major actors like, e.g., D. Blackwell, C.R. Rao, or G. Wahba (except in a stylistic example p199), two of whom were awarded the International Prize in Statistics.
[Disclaimer about potential self-plagiarism: this post or an edited version will eventually appear in my Books Review section in CHANCE.]
post-Bayes workshop at UCL [15 & 16 May 2025]
Posted in pictures, Statistics, Travel, University life with tags ABC, approximate Bayesian inference, England, generalised Bayesian inference, Great-Britain, Highlands, ICMS, Isle of Skye Brewery, martingale posterior, martingales, PAC, PAC-Bayes, post-Bayes inference, Scotland, Skye, UCL, University College London, workshop on April 4, 2025 by xi'an
University College London (UCL) is organising a workshop on post-Bayes inference and asked to post the announcement (despite my feeling that we have not entered the post-Bayes era!). So here it is:
Over the course of two days, they will host eight invited talks from leaders across the post-Bayesian landscape, spanning from PAC Bayes and generalised Bayes to predictive resampling and martingale posteriors. Alongside these, they will host six contributed talks, and a poster session to ignite discussion and innovation in our growing community. The workshop will complement the post-Bayesian seminar series.
Registration is now open, and they are actively accepting talk and poster submissions! (Deadline for submissions: April 11th, 2025.) Travel support for early career researchers will be available and announced closer to the date. See the website for more information. The workshop will take place in Bentham House, UCL, London.
[As a personal aside, we just learned that our proposal for an approximate(ly) Bayes workshop supported by ICMS (Edinburgh) and set on the magical Isle of Skye had been accepted! To be held in Spring 2026!]
Nature tidbits [06 Feb 2025]
Posted in Statistics with tags 23andMe, @ScientistTrump, Africa, Australophitecus africanus, bear, bird flu virus, Buachaille Mor, camembert, Canada, Cité des Sciences et de l'Industrie, Data Protection Act, Europe, First Nations, fossils, France, H5N1 virus, infectious diseases, lynx, Nature, Nova Scotia, open source, Paris, plastic waste, raw milk, recycling, red deer, Scotland, silence, Spain, superheated water, unions, University of Warwick, Warwick Manufacturing Group, WHO, WMG, wolverines, wolves, World Health Organization on March 10, 2025 by xi'an
A (naïve, imho) call by the presidente of the Union of Concerned Scientists to boost scientific integrity to protect (US) federal research despite the chainsaw massacre unfolding daily in (US) federal agencies. And the disregard of said massacrers for accountability and legal boundaries. And unions, definitely unions.
Also entries (and two Nature collections) on the one hundredth anniversary of the Taung Child fossil uncovering, as the first Australophitecus africanus that opened the way for the theory that Africa was the birthplace of humanity, along with other extended books reviews. On quantum theory (it’s complicated!, according to Sean Carroll) and Kepler mission (by Jason Steffen). And a show at Cité des Sciences in La Villette about silence that I would love to attend.
A quick assessment of deepseek against its competitors. Mostly praising its open code. And another one on 23andMe losses and trouble, reflecting the one-shot strategy of the company that cannot sell its analysis more than once (despite repeatedly trying, as I can confirm from their frequent emails). And opening concerns about their data or rather our data. Since there is very little protection in the US for this kind of data, considered out of healthcare.
New challenges of large carnivores in Western Europe, with a rise of wolverines, success story for the Iberian lynx, talks of reintroducing wolves to Scotland (to cull red deer like those who roam Buachaille Mor), degrading setting in France with looser rules for shooting wolves.
Microplastics in the brain, unsurprisingly increasing the chances of clots and surprisingly easily moving into blood vessels and the brain. And, speakiMicroplastics in the brainng of plastic, recycling, at last? Warwick Manufacturing Group (WMG) mentioned as evaluating the life-cycle analysis of a new approach with superheated water. Exposing the elephant in the room, namely that there is very little true recycling going on and that part of the recycled plastic ends up as fuel, hence contributing to pollution. Costs and impact of turning used products into new material are mentioned (and staggering albeit not compared with the initial costs and impact.
And I remain perplexed by the Two-Eyed Seeing Indigenous perspective for neuroscience article. As I do not see the scientific component, besides directions to work with local communities.
1984 or 2025 [newspeak]
Posted in Books, pictures, Travel with tags 1984, AfD, anti-abortion organisations, Chornobyl, conservatism, democracy, Чорнобиль, far-right, George Orwell, JD Vance, Münchner Sicherheitskonferenz, MSC 2025, Munich, Munich Security Conference, Newspeak, nuclear power plant, reproductive rights, safety zones, Scotland, Solidarity with Ukraine, Stand Up To Trump, The Guardian, Trump administration, Volodymyr Zelenskiy, welcome to Scotland on February 28, 2025 by xi'an
[Quotes from J.D. Vance’s speech at the Munich Security Conference, on 14 Feb 2025, a perfect Orwellian achievement in newspeak!]
“It looks more and more like old entrenched interests hiding behind ugly Soviet era words like misinformation and disinformation, who simply don’t like the idea that somebody with an alternative viewpoint might express a different opinion, or, God forbid, vote a different way, or, even worse, win an election”
“…when we see European courts cancelling elections and senior officials threatening to cancel others, we ought to ask whether we’re holding ourselves to an appropriately high standard. (…) If your democracy can be destroyed with a few hundred thousand dollars of digital advertising from a foreign country, then it wasn’t very strong to begin with”
“There is no room for firewalls [against the far-right AfD] People dismissing voters’ concerns, shutting down their media, protects nothing. It is the most surefire way to destroy democracy.”
“I look to Brussels, where E.U. Commission commissars warn citizens that they intend to shut down social media during times of civil unrest the moment they spot what they judge to be ‘hateful content,’ or to [Germany], where police have carried out raids against citizens suspected of posting anti-feminist comments online as part of ‘combating misogyny.’”
“in Britain and across Europe, free speech, I fear, is in retreat (…) the United Kingdom backslide away from conscience rights has placed the basic liberties of religious Britons in particular in the crosshairs”
“The Scottish government has begun distributing letters to citizens whose houses lay within so-called safe access zones, warning them that even private prayer within their own homes may amount to breaking the law. The government urged readers to report any fellow citizens suspected guilty of thought crime in Britain and across Europe.”
