Review and classi cations of the ridge parameter estimation techniques

Ridge parameter estimation techniques under the inffuence of multicollinearityin Linear regression model were reviewed and classiffed intodifferent forms and various types. The different forms are Fixed Maximum(FM), Varying Maximum (VM), Arithmetic Mean (AM), GeometricMean (GM), Harmonic Mean (HM) and Median (M) and thevarious types are Original (O), Reciprocal (R), Square Root (SR) andReciprocal of Square Root (RSR). These classiffcations resulted intoproposing some other techniques of Ridge parameter estimation. Investigationof the existing and proposed ones were done by conducting1000 Monte-Carlo experiments under five (5) levels of multicollinearity(ρ = 0.8, 0.9, 0.95, 0.99, 0.999), three (3) levels of error variance(σ2 = 0.25, 1, 25) and ve levels of sample size (n = 10, 20, 30, 40, 50).The relative eciency (RF ≤ 0.75) of the techniques resulting from theratio of their mean square error and that of the ordinary least squarewas used to compare the techniques.Results show that the proposed techniques perform better than the existingones in some situations; and that the best technique is generallythe ridge parameter in the form of Harmonic Mean, Fixed Maximumand Varying Maximum in their Original and Square Root types.

PDF

___

Wichern, D. and Churchill, G. (1978). A Comparison of Ridge Estimators. Technometrics, 20, 301-311.
Vinod, D. and Ullah, A. (1981). Recent Advances in Regression Methods, Marcel Dekker Inc. Publication.
Saleh, A. K. Md. E. and Kibria, B. M. G. (1993). Performances of some new preliminary test ridge regression estimators and their properties. Communications in Statistics-Theory and Methods, 22, 2747-2764.
Muniz, G., Kibria, B.M.G., Mansson, K., Shukur, G. (2012). On Developing Ridge Regression Parameters: A Graphical Investigation. SORT. 36(2), 115-138.
Muniz, G. and Kibria, B. M. G. (2009). On some ridge regression estimators: An empirical comparison. Communications in Statistics-Simulation and Computation, 38, 621-630.
McDonald, G. C. and Galarneau, D. I. (1975). A Monte Carlo evaluation of some ridge-type estimators. Journal of the American Statistical Association, 70, 407-416.
Mardikyan, S. and Cetin, E. (2008). Ecient Choice of Biasing Constant for Ridge Regression, Int.J. Contemp.Math.Sciences, 3, 527-547.
Mansson, K., Shukur, G. and Kibria, B. M. G. (2010). A simulation study of some ridge regression estimators under dierent distributional assumptions. Communications in Statistics-Simulations and Computations, 39(8), 1639 1670.
Lukman, A. F (2015): Review and classication of the Ridge Parameter Estimation Techniques. Ladoke Akintola University of Technology, Ogbomoso, Oyo State, Nigeria. Unpublished P.hD. Thesis.
Lawless, J. F. and Wang, P. (1976). A simulation study of ridge and other regression estimators. Communications in Statistics A, 5, 307-323.
Kibria, B. M. G. (2003). Performance of some new ridge regression estimators. Communications in Statistics-Simulation and Computation, 32, 419-435.
Khalaf, G. and Shukur, G. (2005). Choosing ridge parameters for regression problems. Communications in Statistics- Theory and Methods, 34, 1177-1182.
Hoerl, A. E., Kennard, R. W. and Baldwin, K. F. (1975). Ridge regression: Some simulation. Communications in Statistics 4 (2), 105123.
Gujarati, D.N.(1995). Basic Econometrics, McGraw-Hill, New York. Hoerl, A.E. and Kennard, R.W. (1970). Ridge regression: biased estimation for nonorthogonal problems. Technometrics, 12, 55-67.
Gibbons, D. G. (1981). A simulation study of some ridge estimators. Journal of the American Statistical Association, 76, 131-139.
Alkhamisi, M., Khalaf, G. and Shukur, G. (2006). Some modiffcations for choosing ridge parameters.Communications in Statistics- Theory and Methods, 35(11), 2005-2020.

Hacettepe Journal of Mathematics and Statistics-Cover

Yayın Aralığı: Yılda 6 Sayı
Başlangıç: 2002
Yayıncı: Hacettepe Üniversitesi Fen Fakultesi

Arşiv