Well done to Yixin Wang (Columbia University) and Vivian Meng (McGill University), who provided correct solutions to the various parts of the problem.
Yixin Wang
Vivian Meng
The problem asked was the following: suppose are iid where the mean is some unknown positive integer, and is a completely unknown standard deviation. We are to find the unique MLE of and , and show that the MLE of converges to the true exponentially fast and that the MLE of is consistent.
Denote the likelihood function by . Then, directly, whenever , where stands for the integer part of . Thus, for , the unique MLE of is ; this is the same as the integer closest to the unrestricted MLE , a very intuitive result. If , is monotone decreasing in over the set of positive integers, and in that case the MLE of is .
By a standard calculus argument, once we have found the MLE of , the MLE of is .
To complete the solution, if the true ,
The complementary probability, therefore is , which is of the order of .
This is a (somewhat faster than) exponential rate. The argument for the case is exactly similar; the expression just needs a very small modification. Obviously, therefore, by the Borel-Cantelli lemma, with probability one, for all large . This means, the MLE of is in fact
even strongly consistent, because converges a.s. to by the usual SLLN.
Comments on “Solution to Student Puzzle Corner 8”