Archive for Taoism

Number savvy [book review]

Posted in Books, Statistics with tags , , , , , , , , , , , , , , , , , , , , , , , , , , , , , on March 31, 2023 by xi'an

“This book aspires to contribute to overall numeracy through a tour de force presentation of the production, use, and evolution of data.”

Number Savvy: From the Invention of Numbers to the Future of Data is written by George Sciadas, a  statistician working at Statistics Canada. This book is mostly about data, even though it starts with the “compulsory” tour of the invention(s) of numbers and the evolution towards a mostly universal system and the issue of measurements (with a funny if illogical/anti-geographical confusion in “gare du midi in Paris and gare du Nord in Brussels” since Gare du Midi (south) is in Brussels while Gare du Nord (north) in in Paris). The chapter (Chap. 3) on census and demography is quite detailed about the hurdles preventing an exact count of a population, but much less about the methods employed to improve the estimation. (The request for me to fill the short form for the 2023 French Census actually came while I was reading the book!)

The next chapter links measurement with socio-economic notions or models, like unemployment rate, which depends on so many criteria (pp. 77-87) that its measurement sounds impossible or arbitrary. Almost as arbitrary as the reported number of protesters in a French demonstration! Same difficulty with the GDP, whose interpretation seems beyond the grasp of the common reader. And does not cover significantly missing (-not-at-random) data like tax evasion, money laundering, and the grey economy. (Nitpicking: if GDP got down by 0.5% one year and up by 0.5% the year after, this does not exactly compensate!) Chapter 5 reflects upon the importance of definitions and boundaries in creating official statistics and categorical data. A chapter (Chap 6) on the gathering of data in the past (read prior to the “Big Data” explosion) is preparing the ground to the chapter on the current setting. Mostly about surveys, presented as definitely from the past, “shadows of their old selves”. And with anecdotes reminding me of my only experience as a survey interviewer (on Xmas practices!). About administrative data, progressively moving from collected by design to available for any prospection (or “farming”). A short chapter compared with the one (Chap 7) on new data (types), mostly customer, private sector, data. Covering the data accumulated by big tech companies, but not particularly illuminating (with bar-room remarks like “Facebook users tend to portray their lives as they would like them to be. Google searches may reflect more truthfully what people are looking for.”)

The following Chapter 8 is somehow confusing in its defence of microdata, by which I understand keeping the raw data rather than averaging through summary statistics. Synthetic data is mentioned there, but without reference to a reference model, while machine learning makes a very brief appearance (p.222). In Chapter 9, (statistical) data analysis is [at last!] examined, but mostly through descriptive statistics. Except for a regression model and a discussion of the issues around hypothesis testing and Bayesian testing making its unique visit, albeit confusedly in-between references to Taleb’s Black swan, Gödel’s incompleteness theorem (which always seem to fascinate authors of general public science books!), and Kahneman and Tversky’s prospect theory. Somewhat surprisingly, the chapter also includes a Taoist tale about the farmer getting in turns lucky and unlucky… A tale that was already used in What are the chances? that I reviewed two years ago. As this is a very established parable dating back at least to the 2nd century B.C., there is no copyright involved, but what are the chances the story finds its way that quickly in another book?!

The last and final chapter is about the future, unsurprisingly. With prediction of “plenty of black boxes“, “statistical lawlessness“, “data pooling” and data as a commodity (which relates with some themes of our OCEAN ERC-Synergy grant). Although the solution favoured by the author is centralised, through a (national) statistics office or another “trusted third party“. The last section is about the predicted end of theory, since “simply looking at data can reveal patterns“, but resisting the prophets of doom and idealising the Rise of the (AI) machines… The lyrical conclusion that “With both production consolidation and use of data increasingly in the ‘hands’ of machines, and our wise interventions, the more distant future will bring complete integrations” sounds too much like Brave New World for my taste!

“…the privacy argument is weak, if not hypocritical. Logically, it’s hard to fathom what data that we share with an online retailer or a delivery company we wouldn’t share with others (…) A naysayer will say nay.” (p.190)

The way the book reads and unrolls is somewhat puzzling to this reader, as it sounds like a sequence of common sense remarks with a Guesstimation flavour on the side, and tiny historical or technical facts, some unknown and most of no interest to me, while lacking in the larger picture. For instance, the long-winded tale on evaluating the cumulated size of a neighbourhood lawns (p.34-38) does not seem to be getting anywhere. The inclusion of so many warnings, misgivings, and alternatives in the collection and definition of data may have the counter-effect of discouraging readers from making sense of numeric concepts and trusting the conclusions of data-based analyses. The constant switch in perspective(s) and the apparent absence of definite conclusions are also exhausting. Furthermore, I feel that the author and his rosy prospects are repeatedly minimizing the risks of data collection on individual privacy and freedom, when presenting the platforms as a solution to a real time census (as, e.g., p.178), as exemplified by the high social control exercised by some number savvy dictatures!  And he is highly critical of EU regulations such as GDPR, “less-than-subtle” (p.267), “with its huge impact on businesses” (p.268). I am thus overall uncertain which audience this book will eventually reach.

[Disclaimer about potential self-plagiarism: this post or an edited version will potentially appear in my Books Review section in CHANCE.]

What is luck? [book review]

Posted in Books, Statistics, Travel, University life with tags , , , , , , , , , , , , , , , , , , , , , , , , on December 10, 2021 by xi'an

I was sent—by Columbia University Press—this book for a potential review in CHANCE: What are the chances? (Why we believe in luck?) was written by Barbara Blatchley, professor of Psychology and Neuroscience at Agnes Scott College in Decatur, Georgia. I have read rather quickly its 193 pages over the recent trips I made to Marseille and Warwick. The topic is truly about luck and the psychology of the feeling of being luck or unlucky. There is thus rather little to relate to as a statistician, as this is not a book about chance! (I always need to pay attention when using both words, since, in French chance primarily means luck, while malchance means bad luck. And the French term for chance and randomness is hasard…) The book is pleasant to read, even though the accumulation of reports about psychological studies may prove tiresome in the long run and, for a statistician, worrisome as to which percentage of such studies were properly validated by statistical arguments…

“…the famous quote by Louis Pasteur: “Dans les champs de l’observation, le hasard ne favorise que les esprits préparés”s (…) Pasteur never saw a challenge he couldn’t overcome with patience and preparation.” (p.19)

Even the part about randomness is a-statistical and mostly a-probabilist, rather focusing on our subjective and biased (un)ability to judge randomness. The author introduces us to the concepts of apophenia, which is “the unmotivated seeing of connections accompanied with a specific feeling of abnormal meaningfulness”, and of patternicity for the “tendency to find meaningful patterns in meaningless noise”. She also states that (Neyman-Pearson) Type I error is about seeing a pattern in random noise while Type II errors are for conclusion of meaningless when the data is meaningful (p.15). Which is reductive to say the least, but lead her to recall the four types of luck proposed by James Austin (which I first misread as Jane Austin).

“There is a long-standing and deeply intimate connection between luck, religion, and belief in the supernatural.” (p.28)

I enjoyed very much the sections on these connections between a belief in luck and religions, even though the anthropological references to ancient religions are not strongly connected to luck, but rather to the belief that gods and goddesses could modify one’s fate (and avoiding the most established religions). Still, I appreciate her stressing the fact that if one believes in luck (as opposed to sheer randomness), this expresses at the very least a form of irrational belief in higher powers that can bend randomness in one’s favour (or disfavour). Which is the seed for more elaborate if irrational beliefs. (For illustrations, Borgès’ stories come to mind.)

“B.F. Skinner believed that superstitious behaviour was a consequence of learning and reinforcement.” (p.85)

There are also parts where (a belief in) luck and (human) learning are connected, but, unfortunately, no mention is made of the (vaguely) Bayesian nature of the (plastic, p. 188) brain modus operandi. The large section on the brain found in the book is instead physiological, since concerned with finding regions where the belief in luck could be located. In relation with attention-deficit disorders. (Revealing the interesting existence (for me) of mirror neurons, dedicated to predicting what could happen! Described as “predictive coding”, p.153). The last chapter “How to get lucky” contains a rather lengthy account of “Clever Hans”, the 1990 German counting horse (!). Who, as well-known, reacted to subtle and possibly unconscious signals from his trainer rather than to an equine feeling for arithmetic…

One of the clearest conclusions of the book is (imho) that a belief in luck may improve the life of the believers, while a belief in being unlucky may deteriorate it. The Taoist tale finishing the book is a pure gem. But I am still in the dark as to whether or not my exceptional number of bike punctures in the past year qualifies as bad luck!

“Luck is the way you face the randomness of the world.” (p.191)

As an irrelevant aside, one anecdote at the beginning of the book brought back memories of the Wabash River flowing through Lafayette, IN, as it tells of the luck of two Purdue female rowers who attempted a transatlantic race and survived capsizing in the middle of the Atlantic. It also made me regret I had not realised at the time there was a rowing opportunity there!