Normal maximum likelihood, weighted least squares, and ridge regression estimates

Abstrakt

There have been many papers published in almost every statistics related journal suggesting that normal maximum likelihood is superior or inferior to weighted least squares and other approaches. In this note, we show that the three main estimation methods normal maximum likelihood, weighted least squares and ridge regression all have the same asymptotic covariance and that there is no gain in efficiency among them. We also show how the bias of these estimators can be reduced and conduct a simulation study to illustrate the magnitude of bias reduction.