Minimax and shrinkage properties of the least-squares estimator
[3/33%]In the linear model (3.4.4), show that (in the notation of Theorem 3.4.4) is minimax for estimating with squared error loss, under the restriction .
Consider the problem of estimating the mean based on , where it is thought that where are known, are unknown, and .
Find the MLE of , say , if is assumed to be in the linear subspace
Show that can be written in the form (6.7), and find .
Construct a Stein estimator that shrinks toward the MLE of part (a) and prove that it is minimax.
Consider the linear model with observed vector having distribution , where is an known matrix, , , and , and the estimation of under the squared error loss, where . Show that the LSE is minimax if with a constant .
Corresponding exercise in Shao (2003): 4.73.