Monday, November 21, 2016

F

No, no, I didn't fail a class. Today, I'm writing about the F-distribution. In another odd naming scenario, the F is in honor of Ronald Fisher but it was actually developed by George Snedecor. Snedecor had no problem with publishing under his own name, he just felt that Fisher had done so much of the work on this particular problem that he should get some credit, too. Some texts call it Snedecor's F distribution.

OK, fine, get on with it.

Just as the t-distribution is used to substitute in the sample variance for the true variance to get a distribution on the mean, the F-distribution substitutes in two sample variances to get a distribution on the ratio of the variances. Formally, if Xi are N(μXσY2) and Yi are N(μYσY2), then:



Also as with the t-distribution, there are degrees of freedom. In this case there are two and they are what you'd expect from the t: n - 1 for n observations of X and m - 1 for m observations of Y. You might wonder why the degrees of freedom are always one less than the number of observations. Why not just arbitrarily re-label them so they match? The reason is that these are coming from the underlying chi-squared distributions. Recall that SX2/σX2 is a scaled chi-square, so the F is really just the ratio of two independent chi-squared random variables with corresponding degrees of freedom.

It was this whole chi-squared, degrees of freedom bit that Fisher had worked out with respect to normal samples. Snedecor and Gosset just did the wrapping and formalizing of the distributions. Both were admirers of Fishers work, as is obvious from their deferment of credit. (Though, in the case of Gosset, he pretty much had to publish on the down low because one of his colleagues at Guinness had given away some trade secrets in a publication and the company subsequently took a dim view of anybody publishing anything.)

And, here's three fun transformation facts before I call it a night:

  1. If X ~ Fp,q then 1/X ~ Fq,p. That should be pretty obvious from the formulation as the ratio of two random variables.
  2. If X ~ tq then X2 ~ F1,q. Nothing obvious about that one. At least not to me.
  3. If X ~ Fp,q then (p/q)X/(1+(p/q)X) ~ beta(p/2, q/2). Wow, really? OK.

No comments:

Post a Comment