A STUDY ON TESTS OF HYPOTHESIS BASED ON RIDGE ESTIMATOR

The literature of Ridge regression include many articles that deal with point estimation of the coefficients vector . However, few of them tackle the statistical inference problem about or some of its components. One of them is introduced by Halawa and Basuiouni[1] who present non-exact tests based on Ridge regression by using two different biasing parameters (k) which are proposed by Hoerl and Kennard [2] and Hoerl et al. [3]. Thus, we investigate others popular k values used the Ridge regression for testing significance of regression coefficients. We compare tests in terms of type I error rates and powers by using Monte Carlo simulation. In addition, a real data example is presented.

___

  • A.M. Halawa and M.Y.E. Basuiouni, “Tests of
  • Regression Coefficients under Ridge Regression
  • Models”, Journal of Statistical Computation and
  • Simulation, 65, 2000, pp. 341-356.
  • A.E. Hoerl and R.W. Kennard, “Ridge regression:
  • biased estimation for non-orthogonalproblems”,
  • Technometrics,12, 1970, pp. 55–67.
  • A.E. Hoerl, R.W. Kennard and K.F. Baldwin, “Ridge
  • regression: some simulation”, Communications in
  • Statistics, 5, 1975,pp. 105–123.
  • C.M. Theobald, “Generalizations of Mean Square
  • Error Applied to Ridge Regression”, Journal of the
  • Royal Statistical Society. Series B
  • (Methodolojical), 36, 1974,pp.103-106.
  • J.F. Lawless and P. Wang, “A Simulation Study of
  • Ridge and Other Regression Estimators”,
  • Communications in Statistics: Theory and
  • Methods,7, 1976, pp. 139-164.
  • A.P. Dempster, M. Schatzoff and N. Wermuth, “A
  • Simulation Study of Alternatives to Ordinary Least
  • Squares”, Journal of the American Statistical
  • Association, 72, 1977,pp. 77-91.
  • D.G. Gibbons, “A Simulation Study of Some Ridge
  • Estimators”, Journal of the American Statistical
  • Association, 76, 1981,pp.131-139.
  • A. K. Md. E. Saleh and B.M.G. Kibria,
  • “Performances of Some New Preliminary Test
  • Ridge Regression Estimators and Their Properties”,
  • Communicationsin Statistics: Theory and Methods,
  • , 1993,pp. 2747-2764.
  • B.M.G. Kibria, “Performance of Some New Ridge
  • Regression Estimators”, Communications in
  • Statistics: Simulation and Computation, 32,
  • ,pp. 419-435.
  • G. Khalaf and G. Shukur, “Choosing Ridge
  • Parameters for Regression Problems”,
  • Communications in Statistics: Theory and Methods,
  • , 2005,pp.1177-1182.
  • J. Zhang and M. Ibrahim, “A Simulation Study on
  • SPSS Ridge Regression and Ordinary Least
  • Squares Regression Procedures for Multicolliearity
  • data”, Journal of Applied Statistics, 32, 2005,pp.
  • -588.
  • A.K.Md.E. Saleh, “Theory of Preliminary Test and
  • Stein-Type Estimation with Applications”, Wiley,
  • New York, 2006.
  • M. Alkhamisi, G. Khalaf and G. Shukur, “Some
  • Modifications for Choosing Ridge Parameters”,
  • Communications in Statistics-Theory and Methods,
  • , 2006,pp. 2005-2020.
  • M. Alkhamisi and G. Shukur, “Developing Ridge
  • Parameters for SUR Model”, Communications in
  • Statistics -Theory and Methods, 37, 2008,pp. 544-
  • G. Muniz and B.M.G. Kibria, “On Some Ridge
  • Regression Estimators: An Empirical
  • Comparisons”, Communications in Statistics-
  • Simulation and Computation, 38, 2009,pp. 621-
  • F. Gökpınar and M. Ebegil, “A Comparative Study
  • on Ridge Estimators in Regression Problems”,
  • Journal of SainsMalaysiana, 2014 (in submission).
  • E.P. Liski, “A Test of the Mean Square Error
  • Criterion for shrinkage Estimators”,
  • Communications in Statistics: Theory and Methods,
  • , 1982,pp. 543-562.
  • E.P. Liski, “Choosing a shrinkage Estimator-a test
  • of the Mean Square Error Criterion”, Proc. First
  • Tampere Sem. Linear Models, 1983,pp. 245-262.
  • R.L. Obenchain, “Classical F-Tests and Confidence
  • Regions for Ridge Regression”, Technometrics, 19,
  • , pp. 429-439.
  • D. Coutsourides and C.G. Troskie, “F and t Tests
  • for a General Class of Estimators”, South African
  • Statistical Journal, 13, 1979,pp. 113-119.
  • A. Ullah, R.A.L. Carter and V.K. Srivastova, “The
  • Sampling Distribution of Shrinkage Estimators and
  • their F Ratio in Regression Model”, Journal of
  • Econometrics, 25, 1984,pp. 109-122.
  • M. Karakuş, A. Bayrak, E. Çalıkoğlu and M.
  • Kıralan, “Comparison of oxidation stability of
  • virgin olive oils from different locations of
  • Turkey”, ActaAlimentaria, 43, 2014, pp. 133-141.
  • H.Woods, H.H. Steinour, and H.R. Starke, “Effect
  • of composition of Portland cement on heat evolved
  • during hardening, Ind. Eng. Chem.”, 24, 1932, pp.
  • –1214.
  • M. Ebegil, F. Gökpınar, “A Test Statistic to Choose
  • Between Liu-Type and Least Squares Estimator
  • Based on Mean Square Error Criteria”, Journal of
  • Applied Statistics, 39(10), 2012, pp. 2081-2096.