Archive for Hyperion
corrida de Noël, Issy-les-Moulineaux [10K, 41’00, 701/3335, 1/38 M6M, 4´06/km]
Posted in pictures, Running, Travel with tags 10k, Brooks, corrida, Hyperion, Issy-les-Moulineaux, Paris suburbs, PariSanté campus, PHOTO running, road race, starting gate, Xmas on December 16, 2025 by xi'anflow contrastive estimation
Posted in Books, Statistics with tags Bayesian inference, flight, GAN, generative adversarial networks, Hyperion, noise-contrastive estimation, normalising constant, normalising flow, Université de Montpellier on March 15, 2021 by xi'anOn the flight back from Montpellier, last week, I read a 2019 paper by Gao et al. revisiting the MLE estimation of a parametric family parameter when the normalising constant Z=Z(θ) is unknown. Via noise-contrastive estimation à la Guttman & Hyvärinnen (or à la Charlie Geyer). Treating the normalising constant Z as an extra parameter (as in Kong et al.) and the classification probability as an objective function and calling it a likelihood, which it is not in my opinion as (i) the allocation to the groups is not random and (ii) the original density of the actual observations does not appear in the so-called likelihood.
“When q appears on the right of KL-divergence [against p], it is forced to cover most of the modes of p, When q appears on the left of KL-divergence, it tends to chase the major modes of p while ignoring the minor modes.”
The flow in the title indicates that the contrastive distribution q is estimated by a flow-based estimator, namely the transform of a basic noise distribution via easily invertible and differentiable transforms, for instance with lower triangular Jacobians. This flow is also estimated directly from the data but the authors complain this estimation is not good enough for noise contrastive estimation and suggest instead resorting to a GAN version where the classification log-probability is maximised in the model parameters and minimsed in the flow parameters. Except that I feel it misses the true likelihood part. In other words, why on Hyperion would estimating all θ, Z=Z(θ), and α at once improve the estimation of Z?
The other aspect that puzzles me is that (12) uses integrated classification probabilities (with the unknown Z as extra parameter), rather than conditioning on the data, Bayes-like. (The difference between (12) and GAN is that here the discriminator function is constrained.) Esp. when the first expectation is replaced with its empirical version.
Great North Road [book review]
Posted in Books, Running, Travel with tags Alien, Avatar, book review, book reviews, brands, Brexit, England, Great North Road, Hyoer, Hyperion, India, Newcastle-upon-Tyne, science fiction, space opera, Speaker for the Dead, Travel on January 6, 2017 by xi'an
As I was unsure of the Internet connections and of the more than likely delays I would face during my trip to India, I went fishing for a massive novel on Amazon and eventually ordered Peter Hamilton’s Great North Road, a 1088 pages behemoth! I fear the book qualifies as space opera, with the conventional load of planet invasions, incomprehensible and infinitely wise aliens, gateways for instantaneous space travels, and sentient biospheres. But the core of the story is very, very, Earth-bound, with a detective story taking place in a future Newcastle that is not so distant from now in many ways. (Or even from the past as the 2012 book did not forecast Brexit…) With an occurrence of the town moor where I went running a few years ago.
The book is mostly well-designed, with a plot gripping enough to keep me hooked for Indian evenings in Kolkata and most of the flight back. I actually finished it just before landing in Paris. There is no true depth in the story, though, and the science fiction part is rather lame: a very long part of the detective plot is spent on the hunt for a taxi by an army of detectives, a task one would think should be delegated to a machine-learning algorithm and solved in a nano-second or so. The themes heavily borrow from those of classics like Avatar, Speaker for the Dead, Hyperion [very much Hyperion!], Alien… And from The Girl with the Dragon Tattoo for an hardcore heroin who is perfect at anything she undertakes. Furthermore, the Earth at the centre of this extended universe is very close to its present version, with English style taxis, pub culture, and a geopolitic structure of the World pretty much unchanged. Plus main brands identical to currents ones (Apple, BMW, &tc), to the point it sounds like sponsored links! And no clue of a major climate change despite the continued use of fuel engines. Nonetheless, an easy read when stuck in an airport or a plane seat for several hours.




