How do HCCMEs perform in small samples?

The purpose of this paper is to explore the performances of prominent and popular heteroscedasticity-consistent covariance matrix estimators (HCCMEs) in small samples. The HCCMEs are selected from the literature and their ability to estimate the true covariance matrix of the coefficient's vector is evaluated through simulation runs. We calculate the percentage difference between the expected value of the HCCME and the true covariance matrix to set a convenient stage to make the comparisons under several different regression settings. The main contribution of the paper is the inclusion of the HCCMEs that have been introduced into the literature recently. We report the performances of the HCCMEs under different settings of the covariates and error term variances. We let the covariates follow uniform, normal, Student's t, and Cauchy distributions and tailor the error term variances to increase gradually.

How do HCCMEs perform in small samples?

The purpose of this paper is to explore the performances of prominent and popular heteroscedasticity-consistent covariance matrix estimators (HCCMEs) in small samples. The HCCMEs are selected from the literature and their ability to estimate the true covariance matrix of the coefficient's vector is evaluated through simulation runs. We calculate the percentage difference between the expected value of the HCCME and the true covariance matrix to set a convenient stage to make the comparisons under several different regression settings. The main contribution of the paper is the inclusion of the HCCMEs that have been introduced into the literature recently. We report the performances of the HCCMEs under different settings of the covariates and error term variances. We let the covariates follow uniform, normal, Student's t, and Cauchy distributions and tailor the error term variances to increase gradually.

___

  • J.T. Jeng, C.C. Chuang, S.F. Su, “Support vector interval regression networks for interval regression analysis”, Fuzzy Sets and Systems, Vol. 138, pp. 283–300, 2003.
  • I. Moghram, S. Rahman, “Analysis and evaluation of five short-term load forecasting techniques”, IEEE Trans Power Systems, Vol. 4, pp. 1484–1491, 1989.
  • O. Cord´ on, F. Herrera, L. S´ anchez, “Solving electrical distribution problems using hybrid evolutionary data analysis techniques”, Applied Intelligence, Vol. 10, pp. 5–24, 1999.
  • M.K. Kerr, M. Martin, G.A. Churchill, “Analysis of variance for gene expression microarray data”, Journal of Computational Biology, Vol. 7, pp. 819–837, 2000.
  • C. Maffeis, G. Talamini, L. Tat, “Influence of diet, physical activity and parents’ obesity on children’s adiposity: a four year longitudinal study”, International Journal of Obesity, Vol. 22, pp. 758–764, 1998.
  • B. Peeters, J. Maeck, G. De Roeck, “Vibration-based damage detection in civil engineering excitation sources and temperature effects”, Smart Materials and Structures, Vol. 10, pp. 518–527, 2001.
  • J. Faraway, “Modeling reach motions using functional regression analysis”, SAE Technical Paper 2000-01-2175, 2000.
  • E.L. Breese, J. Hill, “Regression analysis of interactions between competing species”, Heredity, Vol. 31, pp. 181–200, 19 G. Heinemann, D. Nordman, E. Plant, “The relationship between summer weather and summer loads – a regression analysis”, IEEE Transactions on Power Apparatus and Systems, Vol. 85, pp. 1144–1154, 1966.
  • A. Chesher, I. Jewitt, “The bias of a heteroskedasticity-consistent covariance matrix estimator”, Econometrica, Vol. 55, pp. 1217–1222, 1987.
  • H. White, “A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity”, Econometrica, Vol. 48, pp. 817–838, 1980.
  • F. Eicker, “Asymptotic normality and consistency of the least squares estimators for families of linear regressions”, Annals of Mathematical Statistics, Vol. 34, pp. 447–456, 1963.
  • F. Eicker, “Limit theorems for regressions with unequal and dependent errors”, Proceedings of the 5th Berkeley Symposium on Mathematical Statistics and Probability, pp. 59–82, 1967.
  • S.D. Horn, R.A. Horn, D.B. Duncan, “Estimating heteroscedastic variances in linear models”, Econometrica, Vol. 60, pp. 539–547, 1975.
  • D.V. Hinkley, “Jackknifing in unbalanced situations”, Technometrics, Vol. 19, pp. 285–292, 1977.
  • B. Efron, The Jackknife, the Bootstrap, and Other Resampling Plans, Society for Industrial and Applied Mathematics, Philadelphia, 1982.
  • J.G. MacKinnon, H. White, “Some heteroskedasticity consistent covariance matrix estimators with improved finite sample properties”, Journal of Econometrics, Vol. 29, pp. 305–325, 1985.
  • M. Orhan, A. Zaman, “Comparison of several heteroskedasticity consistent covariance matrix estimators”, Middle East Technical University Economic Research Center Conference, 2000.
  • F. Cribari-Neto, “Asymptotic inference under heteroskedasticity of unknown form”, Computational Statistics and Data Analysis, Vol. 45, pp. 215–233, 2004.
  • F. Cribari-Neto, T.C. Souza, K.L.P. Vasconcellos, “Inference under heteroskedasticity and leveraged data”, Communications in Statistics—Theory and Methods, Vol. 36, pp. 1877–1888, 2007.
  • D.W.K. Andrews, “Heteroskedasticity and autocorrelation consistent covariance matrix estimation”, Econometrica, Vol. 59, pp. 817–858, 1991.
  • J.G. MacKinnon, “Thirty years of heteroskedasticity-robust inference”, in: X. Chen, N.R. Swanson, editors, Recent Advances and Future Directions in Causality, Prediction, and Specification Analysis: Essays in Honor of Halbert L. White Jr., Springer, Berlin, pp. 437–461, 2013.
  • A.K. Bera, T. Suprayitno, G. Premaratne, “On some heteroskedasticity-robust estimators of variance-covariance matrix of the least-squares estimators”, Journal of Statistical Planning & Inference, Vol. 108, pp. 121–136, 2002. A.F. Hayes, L. Cai, “Using heteroskedasticity-consistent standard error estimators in OLS regression: an introduction and software implementation”, Behavior Research Methods, Vol. 39, pp. 709–722, 2008.
  • C.F.J. Wu, “Jackknife, bootstrap and other resampling methods in regression analysis”, Annals of Statistics, Vol. 14, pp. 1261–1295, 1986.
  • J.G. Cragg, “More efficient estimation in the presence of heteroscedasticity of unknown form”, Econometrica, Vol. 51, pp. 751–763, 1983.
  • E. Flachaire, “Bootstrapping heteroscedastic regression models: wild bootstrap vs. pairs bootstrap”, Computational Statistics and Data Analysis, Vol. 49, pp . 361–376, 2005.
  • M.C. Lima, T.C. Souza, F. Cribari-Neto, G.B. Fernandes, “Heteroscedasticity-robust inference in linear regressions”, Communications in Statistics—Simulation and Computation, Vol. 39, pp. 194–206, 2010.
  • P.J. Rousseeuw, K. Van Driessen, “A fast algorithm for the minimum covariance determinant estimator”, Technometrics, Vol. 41, pp. 212–223, 1999.
  • M. Orhan, E. S ¸im¸sek “How to improve HCCME performances in small samples?”, 13th International Conference on Econometrics, Operations Research and Statistics, 2012.
  • F. Cribari-Neto, S.L.P. Ferrari, G.M. Cordeiro, “Improved heteroscedasticity-consistent covariance matrix estimators”, Biometrika, Vol. 87, pp. 907–918, 2000.