Education
 

Proof of unbiased estimator for variance

From Mathematics

The unbiased estimator for the variance of the distribution of a random variable math, given a random sample math is

math

That math rather than math appears in the denominator is counterintuitive and confuses many new students. Here it is proven that this form is the unbiased estimator for variance, i.e., that its expected value is equal to the variance itself.

[edit] Proof

Let math be

math

the estimator for the variance of some random variable math. Then

math
math

Then

math
math
math
math
math [1]
math
math

And so

math

The expectations on the right-hand side are not known immediately. However, from the definition of variance

math

where math and math are the variance and mean of math, respectively.

The other term can be represented thus, according to the definition of variance and the Central Limit Theorem

math
math

where math and math are the variance and mean of math, respectively.

These indirect forms are then substituted back into the previously unsolvable equation

math
math
math

Thus the expected value of the estimator is equal to the variance and the estimator is therefore unbiased.

QED

[edit] Notes

  1. A subtle trick was used here. math. It can then be seen easily that math.