Archive for students

reading classics (#10 and #10bis)

Posted in Books, Statistics, University life with tags , , , , , , , , , on February 28, 2013 by xi'an

Today’s classics seminar was rather special as two students were scheduled to talk. It was even more special as both students had picked (without informing me) the very same article by Berger and Sellke (1987), Testing a point-null hypothesis: the irreconcilability of p-values and evidence, on the (deep?) discrepancies between frequentist p-values and Bayesian posterior probabilities. In connection with the Lindley-Jeffreys paradox. Here are Amira Mziou’s slides:

and Jiahuan Li’s slides:

for comparison.

It was a good exercise to listen to both talks, seeing two perspectives on the same paper, and I hope the students in the class got the idea(s) behind the paper. As you can see, there were obviously repetitions between the talks, including the presentation of the lower bounds for all classes considered by Jim Berger and Tom Sellke, and the overall motivation for the comparison. Maybe as a consequence of my criticisms on the previous talk, both Amira and Jiahuan put some stress on the definitions to formally define the background of the paper. (I love the poetic line: “To prevent having a non-Bayesian reality”, although I am not sure what Amira meant by this…)

I like the connection made therein with the Lindley-Jeffreys paradox since this is the core idea behind the paper. And because I am currently writing a note about the paradox. Obviously, it was hard for the students to take a more remote stand on the reason for the comparison, from questioning .the relevance of testing point null hypotheses and of comparing the numerical values of a p-value with a posterior probability, to expecting asymptotic agreement between a p-value and a Bayes factor when both are convergent quantities, to setting the same weight on both hypotheses, to the ad-hocquery of using a drift on one to equate the p-value with the Bayes factor, to use specific priors like Jeffreys’s (which has the nice feature that it corresponds to g=n in the g-prior,  as discussed in the new edition of Bayesian Core). The students also failed to remark on the fact that the developments were only for real parameters, as the phenomenon (that the lower bound on the posterior probabilities is larger than the p-value) does not happen so universally in larger dimensions.  I would have expected more discussion from the ground, but we still got good questions and comments on a) why 0.05 matters and b) why comparing  p-values and posterior probabilities is relevant. The next paper to be discussed will be Tukey’s piece on the future of statistics.

reading classics (#9)

Posted in Books, Statistics, University life with tags , , , , , , , , on February 24, 2013 by xi'an

In today’s classics seminar, my student Bassoum Abou presented the 1981 paper written by Charles Stein for the Annals of Statistics, Estimating the mean of a normal distribution, recapitulating the advances he made on Stein estimators, minimaxity and his unbiased estimator of risk. Unfortunately; this student missed a lot about paper and did not introduce the necessary background…So I am unsure at how much the class got from this great paper… Here are his slides (watch out for typos!)

 Historically, this paper is important as this is one of the very few papers published by Charles Stein in a major statistics journal, the other publications being made in conference proceedings. It contains the derivation of the unbiased estimator of the loss, along with comparisons with posterior expected loss.

reading classics (#8)

Posted in Books, Statistics, University life with tags , , , , , , , , on February 1, 2013 by xi'an

In today’s classics seminar, my student Dong Wei presented the historical paper by Neyman and Pearson on efficient  tests: “On the problem of the most efficient tests of statistical hypotheses”, published in the Philosophical Transactions of the Royal Society, Series A. She had a very hard time with the paper… It is not an easy paper, to be sure, and it gets into convoluted and murky waters when it comes to the case of composite hypotheses testing. Once again, it would have been nice to broaden the view on testing by including some of the references given in Dong Wei’s slides:

Listening to this talk, while having neglected to read the original paper for many years (!), I was reflecting on the way tests, Type I & II, and critical regions were introduced, without leaving any space for a critical (!!) analysis of the pertinence of those concepts. This is an interesting paper also because it shows the limitations of such a notion of efficiency. Apart from the simplest cases, it is indeed close to impossible to achieve this efficiency because there is no most powerful procedure (without restricting the range of those procedures). I also noticed from the slides that Neyman and Pearson did not seem to use a Lagrange multiplier to achieve the optimal critical region. (Dong Wei also inverted the comparison of the sufficient and insufficient statistics for the test on the variance, as the one based on the sufficient statistic is more powerful.) In any case, I think I will not keep the paper in my list for next year, maybe replacing it with the Karlin-Rubin (1956) UMP paper…

recommendation week

Posted in Kids, University life with tags , , , , on April 2, 2012 by xi'an

This week, as the deadlines for next year applications get close, I had to write a dozen of recommendation letters for some of my students. Some of those students I knew well as they were in my english R class or in my graduate courses, but others were unknown to me. The most frustrating emails are those of the kind

Je suis so-and-so et j’ai suivi votre cours de Statistique exploratoire et numérique au premier semestre. Je vous écris ce mail car je souhaiterais postuler l’année prochaine there-and-there. Il m’est demandé de fournir dans mon dossier deux lettres de recommandations, c’est donc pour cela que je vous demande si vous pouvez m’écrire une lettre de recommandation.

(I am so-and-so and I took your course Exploratory and numerical Statistics during the first semester. I am writing this mail because I plan to apply next year to there-and-there. I am required to include two recommendation letters in my application file, this is why I would like to ask you to write a recommendation letter.)

composed as if writing a recommendation letter did not require any information about the recommended student! Or maybe they think I know every one of the 180 of them…

Mathematics looking for mathematicians

Posted in Statistics, University life with tags , , , on December 6, 2009 by xi'an

This is on the cover of Le Monde today! In association with the workshop “Maths à venir“, i.e. “Maths to come”, jointly supported by the Société Mathématique de France, the Société Francaise de Statistique and the Société de Mathématiques Appliquées et Industrielles, there were several newshots in Mathematics this week on the national chanels, including a roundtable on the national public radio France Inter (with Jean-Pierre Bourguignon and the statistician Claudine Schwartz, also signing as C. Robert!) and this piece is an illustration of the efforts of the mathematicians. to reach the medias… The decrease in the number of math (and science) students in universities is a global trend in Western countries and France is not spared by this phenomenon. Till very recently, mathematical finance graduate programs were able to partly compensate for this decline but the subprime crisis has also impacted this flow. While the paper argues that the crisis has degraded the image of mathematics among students, I am quite skeptical about this, because financial mathematics are only taught in the final year of graduate programs. My own observation is that the last year saw instead a surge in the number of PHD students in mathematics (and statistics) as a result of lesser positions in banks and companies.