Archive for cross validated

mean value theorem and signed mixtures [X’ed]

Posted in Books, Kids, Statistics, University life with tags , , , , , , , on January 26, 2025 by xi'an


A question on X validated about the probabilistic version of the mean value theorem brought me to the corresponding Wikipedia page with the explanation that, for measurable and differentiable functions g, when X and Y are positive random variables such X is stochastically dominated by Y and E[X] < E[Y], there exists a random variable Z such that

{\displaystyle {\rm {E}}[g(Y)]-{\rm {E}}[g(X)]={\rm {E}}[g'(Z)]\,[{\rm {E}}(Y)-{\rm {E}}(X)].}

What proves more interesting, however, is that this random variable has density

f_Z(x)={\Pr(Y>x)-\Pr(X>x)\over {\rm E}[Y]-{\rm E}[X]}\,, \qquad x\geqslant 0.

which writes as a signed mixture of the densities proportional to Pr(Y>x) and Pr(X>x), with normalizing constants E[Y] and E[X}, and which correspond to the densities of the stationary excess variables for Y and X, respectively. (Also called residual lifetimes, which are the stationary times one need wait until the next event, when the durations between two events are distributed as Y and X, respectively.) And roughly corresponds to the extra excess time (waiting for bus Y, assuming bus X has passed in the meanwhile). A 1999 paper by Di Crescenzo provides more properties of Z, albeit not achieving a complete characterization of this random variable beyond the “stationary distribution of the difference between the current time and the last occurrence of a repair, conditional on the current state (broken or not)” in a setup with two point processes corresponding to “a repairable component that is alternately ‘up’ or ‘down’, with working and repair episodes.

Monte Carlo [exam]

Posted in Kids, pictures, R, Statistics, University life with tags , , , , , , , , , , , , , , , , , on January 22, 2025 by xi'an

My final exam for the Monte Carlo course I taught last semester proved too much of a challenge for my fourth year students, despite being rather elementary and centred on accept-reject algorithms and importance/bridge sampling. One of the problems was a decomposition of the truncated Normal simulation method proposed by Marsaglia in 1963, found on X Validated!, which I had posted on the course Teams forum (and discussed on the ‘Og!). Obviously overlooked by the students as hardly anyone solved the central question… Quite a disappointment (and more exams to grade for the resit exam in June!)

slice sampling, of course!

Posted in Books, pictures, Statistics with tags , , , , , , , on November 19, 2024 by xi'an

unbiased estimation of a reciprocal

Posted in Books, Statistics, University life with tags , , , , , , , , on November 8, 2024 by xi'an

As often, I came a’X this 2007 paper following an X-validated (if poorly worded) question that linked to it. With weird arguments:

  1. Computing an unbiased estimate of the integral induced by an unnormalised density f is a poor sales argument, as the renormalised object is not a probability density. Call to the unbiased approximation of Bayes factors the paper does not!
  2. The proposed solution involves a replacement of the unnormalised density f  by a substitute and normalised density h  that leads to the identity

\frac{f(y)}{\int f(x)\text dx}=\frac{hf(y)}{1-\int [h(x)-h(y)f(x)/f(x)]\text dx}=\frac{hf(y)}{1-a(y)}

with the assumption that the function a  is between -1 and 1, which requires some insight about the connection between f  and h.

  1. The unbiased estimator is an infinite power series in a(y). Requiring an increasing number of independent generations as the power grows.
  2. The series is unbiasedly terminated by playing roulette (if not Russian roulette!). Stopping when the k-th power estimate is below a certain bound. To be selected with no preliminary knowledge of the range of a.
  3. The uncertainty attached to the power series estimate is not evaluate and could reach the concerning level of an infinite variance.

that may explain for its limited popularity.

 

another, older, truncated Normal algorithm [X’ed]

Posted in Books, pictures, Statistics, University life with tags , , , , , , on September 23, 2024 by xi'an