Archive for book review

all of regression

Posted in Books, Statistics, University life with tags , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , on October 16, 2026 by xi'an

My friends Isabella Verdinelli and Larry Wasserman published recently a new book with CUP in the spirit of the lean, terse, All of Statistics and All of Non-parametric Statistics (hilariously immodest titles!). This new volume is All of Regression, with expedited treatment of linear regression and hardly anything about machine learning (not even a mention in the index!). Time series barely escape oblivion within the final two pages!

(Our mutual friend) Ed George’s endorsement of All of Regression is worth quoting:

“Remarkable in scope and clarity, this book masterfully traces the evolution of regression from classical linear modeling to its many modern descendants. Each chapter offers a lucid introduction to a distinct methodology, explained with precision and insight from a contemporary perspective. Complete with exercises and datasets, it will serve equally well as a textbook and an indispensable research resource.”

The linear regression chapter shuns most of the linear algebra machinery swamping regression classics (except in its appendix), but it finds space to cover misspecified models, bootstrap, and model choice. The next and minuscule chapter is centred on X-validation for evaluating prediction error, while its follower is (barely) broaching on high-dimensional linear regression with a brief (and un-Bayesian) intuition on the Lasso. A few more words on logistic and Poisson regressions, and we are already landing at non-parametric regression.

The pace does not abate in any manner, though, since the univariate NP chapter covers kernels, local polynomials, k-nearest neighbours, and RKHS with a similar terseness (and no mention of Gaussian processes). Moving to multivariate regression zips thru trees and random forests, without severe consequences. Quantile regression is given the alm of a few pages (which imho may indeed be all it deserves!)

We are now already past the middle of the book, fighting for breath!, and classification then comes, mostly presented as an adaptation of earlier techniques to discrete outcome (which I find mildly objectionable for categorical data). With mentions of boosting (if not bagging) and SVMs. And no time for the ambiguity of the notion (which is at least as evil as mixtures, as earlier posted by Larry!) Of clear interest to the authors, the modern theory of conformal prediction gets its own, cosy, chapter, albeit somewhat misleadingly making it sound a very simple exercise.  And no machine learning link. Next comes the equally modern and central notion of causality. With the (predictable) causal graphs, confounding variables, and instrumental variables (which have been a mystery to me since my first econometrics class). The final chapter is acknowledged as being made of parts each deserving an entire book, still getting a few pages at best. Empirical Bayes is restrained to linear regression, deep learning is questioned about being useful in statistical problems, and survival analysis mostly summarises as the Kaplan-Meier estimator.

Having gone through the book in a single rush (while on a train to Normandy), I felt more exhausted than at the finish line of a successful half-marathon (with a similar race time). It is great to see most fundamental notions linked with regression covered in such a minimalist way. With mathematical justifications whenever manageable in the alloted space. Albeit not expecting them (!), I regret Bayesian approaches to regression and classification not being mentioned. (No BART!) The computational aspects are not covered, hence readers may face a steep cliff when moving to actual problems but this is the theme for another course.

One funny typo: the bibliography (or reference list) is ordered by the first name, except for a misclassified Nicolai Meinshausen!, which presumes some first-hand knowledge of the entire community! And the inevitable “the the” makes its first (?) appearance on p12.

[The usual disclaimer applies, namely that this review is likely to appear later in CHANCE, in my book reviews column.]

Bayesian workflow [book review]

Posted in Books, R, Statistics, University life with tags , , , , , , , , , , , , , , , , , , , , , , , , , , , , , on October 8, 2026 by xi'an


“This original, thought-provoking, and transforming, book is much much more than an implementation manual for Bayesian Data Analysis, even though it shares almost the same perspective. (The first sentence of the book states that the authors’ `conceptions of statistical practice, and of Bayesian statistics, have changed over the years’.) By providing a modus vivendi for undertaking Bayesian modelling from scratch in realistic settings where models are not magicked out of the blue, the authors explicit and rationalise the many steps required by such a bottom-up modelling protocol (`not a checklist, not a cookbook’, and not a flowchart!) in real situations. The contents read very well and very smoothly, with a seamless conjunction of intuition, modelling advices, computational details, and comparison tools. While unsurprisingly Bayesian, the perspective adopted therein remains both open and inclusive, with a welcome humility about the limitations and challenges of Bayesian workflows. This book should thus appeal to and profit a wide variety of readers, as providing guidance through an extensive collection of highly detailed examples, with shared code and exercises.”

This book proposes a modus vivendi for Bayesian modelling in applied, realistic Bayesian analysis, where models are not magicked out of the blue. It thus emphases iterative model building, model checking, computational troubleshooting, and simulated-data experimentation, filling a gap that looks glaring in retrospect. It particularly targets users and developers of Stan, with code excerpts in R and Stan. It consists of four parts:

  1. background on Bayesian methods and computational tools;
  2. the Bayesian workflow proper, namely building a statistical model from its components, together with its assessment tools;
  3. the computational aspects of fitting models, diagnosing convergence and assessing calibration;
  4. case studies.

I was eagerly waiting for the book, as I knew Andrew, Aki, and Richard had been working on it for a few years. (The quote above is the blurb I wrote upon request from the publisher.)

The tenets of BaWoFlo—if I may resort to this acronym!—are (i) fitting multiple models, (ii) applying methods repeatedly, and (iii) resorting to simulated-data experiments, which should not come as a surprise to readers of BDA. As noted in the introduction, the protocol exposed therein can also benefit non-Bayesian experimenters. This agrees with the highly moderate, “M-open”, agnostic approach to Bayesianism adopted by the authors (“there is no safe haven”). I also welcome and share their humble perspective about the limitations and challenges of Bayesian workflows.

Examples are treated in full detail, with successive modelling and computational choices profusely commented, which is a big plus for such a practical book. This starts as early as Chapter 4, with a multiple-choice exam example. Indeed, there cannot be general principles or a generic theory that would make the approach foolproof. See, e.g., “A data model is not just a ‘likelihood’” (p.70), as when the data model is not fully generative. I very much liked the section on choosing priors (5.6), and the very rich graphs (see, e.g., Chapter 8) for assessing the impact of prior and likelihood, as well as for predictive checks. In coherent continuation of the authors’ earlier work, the book advocates LOO methods and model stacking rather than model averaging. (With a surprisingly anti-Ockham perspective in Section 9.7.)

The MCMC coverage is unsurprising, with \(\hat R\) at the forefront. Chapter 12, on using fast experiments to detect fitting or computational issues, is very nice. The book builds on the immense corpus of work achieved by the authors over the decades (for the most senior ones!). By contrast, the chapter on approximate solutions (13) is way too short, and the same goes for those on calibration and software development.

The book is very US-centric, unsurprisingly given Andrew’s focus on political science. Some sections are reminiscent of Andrew’s blog entries (or the opposite). The (football) World Cup example was initiated when Andrew was in France, during the 2014 World Cup, and as a result (?) the names of the teams are in French! One chapter also reanalyses the birthdate data displayed on the cover of BDA.

Mileage varies on the applied chapters, depending on the example. A dog chapter is followed by a cat chapter! Not that the (stat)dog experiment was in any way enjoyable, especially for the dogs. Maybe the cats were running it! And then come chapters on roaches and sharks. There is also a frightening flowchart (Fig. 2.1)! And the book ends with an appendix on going through BDA to better understand BaWoFlo

[The usual disclaimer applies, namely that this review is likely to appear later in CHANCE, in my book reviews column.]

Nature tidbits [20 Aug 2026]

Posted in Books, Mountains, pictures, Statistics, Travel, University life with tags , , , , , , , , , , , , , , , , , , , , , , , , , , , , on September 16, 2026 by xi'an

In this 20 August edition, a wealth of data analysis papers, with many highly informative graphs. A call for China to better balance recognition for its junior scientists, another call for (US?) universities to treat bullying complaints in-depth rather than as a public relation exercise. The “compulsory” current status of the Trump 2.0 wreckage of US science with the Senate blocking the appointment of politicians for grant reviews. And with the absurd, ungrounded, health threatening split of the MMR vaccine.  Another “compulsory” entry on climate change with a scary graph on the ocean surface temperatures rising way way above the confidence band represented by the previous measurements over 50 years. An interview (why?) of a CEO of the startup QED Science that claims an ability to automatically rank preprints and select the top 1% (why?!). Coïnciding with me receiving an email with a review by Claude of our Bayesian Adversarial Privacy paper! A report on the (defunct Starmer) UK Government cutting on fundamental physics projects. An article featuring the predicted rise in the use of exoskeletons, which I read on my way back from the lodge on Mount Fudji that was renting an exoskeleton to help with the climb! With an optimistic view on the consequences on people’s health and muscles. A short book review on Slobodian’s and Tarnoff’s Muskism, concluding that Musk(ism) lacks a coherent philosophy. (A Musk-read according to the Economist!) A long comment on the sleepless summer of the heatwaves, which led me clearly more tired than usual at the end of the summer break. (With a lot of should. And a focus on methodology.) Another one on the Middle East prospects as a sustainable aviation fuel (SAF) hub, which sounds paradoxical in the current geopolitic situation. It made me wonder how sustainable are these SAFs? True, they recycle oils, gases and biomass, rather than extracting “new” oils, but they still pollute the air. And, true, they can fill empty returning tankers, but they divert investment and research from more renewable and less polluting alternatives. Among the actual scientific articles, a long review on the safety and security of LLMs in healthcare (but useless pictures). One on the massive floods that occurred in Europe in 1342-1343, possibly caused by volcanic eruptions plus Arctic sea ice retreat, nothing that could occur today of course! With massive socio-economic consequences. (And a great graph, except I do not see the point for the 2D projections. Or for modern state borders.) An analysis of intergenerational mobility in Europe with the unsurprising conclusion that it impacts innovation. (Go, Erasmus!) With a multivariate regression I did not investigate (using NUTS but not Andrew’s NUTS!). And graphs of intergenerational mobility per European country, with too many colours to be readable (and the regression line to make sense?). Another data analysis of the Pakistan Genome Resource, with distinctive traits of the many ethnicities of Pakistan. And the discovery of many clinically relevant genes (with a massive avalanche of p-values!).

Nature tidbits [14 May 2026]

Posted in Books, pictures, Statistics, Travel, University life with tags , , , , , , , , , , , , , , , , , , , , , , , , , , , , on June 21, 2026 by xi'an

Nature dedicated two pages to the dire situation of Iranian scientists and universities under the cumulated impact of US and Israeli bombings, of increased repression from the theocracy and of internet blackouts. Thirty universities were bombed since the beginning of the attacks (among other civilian buildings). Many scientists are detained at the Evin prison, in Tehran, which is also regularly targeted. This situation is highly concerning about the future of Iranian academia, which stood as an exception in the Middle East against all odds.

The same issue covers the opening of a radiation observation centre in Fukushima, where an area of 300 km² remains off limit. While the remainder of the Fukushima region is declared as safe as the whole of Japan, very few people have returned. One of the goals of the institute (F-REI) is to induce more confidence in the scientific validity of the above declaration, but it remains to be seen how effective it will prove. (I intended to hike nearby this summer but plans have changed!)

Still in the 14 May volume, a longer “feature” article on the dangers of AI-based bioweapons. Which seem real but also difficult to counteract. Especially if rogue states are involved and can create AI-controlled robotic labs for the production. The common recommendation that scientists should create adequate guardrails sounds naïve, at best, since generic LLMs are not designed with such guardrails. (It seems to me each article on the topic reaches the Asilomar trigger at some point!) Followed by a less doom-laden article on the use of AI “vibe coding” by scientists, if not of lesser interest. Which relates to the explosive call to LLMs to design or improve codes. (Also impacting our students and courses in a massive way.) The gains are mostly appreciable for those in the know, since newcomers without coding experience are unlikely to spot subtle errors. (Of course, we a.s. faced pre-AI codes with a subtle error that took ages to detect. Or may even still be there!) The issue also contains an “outlook” leaflet [supported by external sources, who assumedly do not influence the contents!] on antimicrobial (incl. antibiotic) resistance. Among the causes are the default use of antibiotics in farming, which again reflect on the difficulty of controlling such practice (banned in the EU, except in some imports!) and the urge to reduce faster meat consumption. And a book review of Canadian anthropologist Samson’s The Sleepless Ape, which offers an interesting theory of evolution thru sleep deprivation! (“The philosophers John Locke and David Hume thought that sleep hindered rationalism and the pursuit of knowledge.”)

spotlight on the shady zones of the cosmos

Posted in Books, Kids, Travel, University life with tags , , , , , , , , , , on June 7, 2026 by xi'an