ANKET METODOLOJİSİNDE DÖRT ANA HATA TÜRÜNE GİRİŞ

Bu makale sosyal bilimlerde sıkça kullanılan anket metodolojisinde yapılan hata türlerine kolay anlaşılır bir giriş yapmayıamaçlamaktadır. Bu giriş yapılırken literatürde "kaliteli anketlerin dört köşe taşı" olarak bilinen çerçeve kullanılmıştır. Bu dörtönemli köşe taşı sırasıyla kapsam hatası, örnekleme hatası, cevap vermeme hatası ve ölçüm hatasıdır. Bu hata türlerinin iyianlaşılması, hedef popülasyon parametreleri hakkında daha sağlıklı yorumlar yapabilmek için çok önemlidir.

AN INTRODUCTION TO FOUR MAIN ERRORS IN SURVEY METHODOLOGY

This article aims to provide an easy-to-understand introduction to main error types in the survey methodology which is commonly used in social sciences. While making this introduction, "four cornerstone of quality surveys" framework was utilized. These four important cornerstones are coverage error, sampling error, non-response error, and measurement error. A good understanding of these errors is very important to make better interpretations about the target population parameters.

___

  • Adida, C. L. (2015). “Do African Voters Favor Coethnics? Evidence from a Survey Experiment in Benin”, Journal of Experimental Political Science, 2/1, pp: 1-11.
  • Aquilino, W. S. (1994). “Interview Mode Effects in Surveys of Drug and Alcohol Use: A Field Experiment”, Public Opinion Quarterly, 58, pp: 210–240.
  • Biemer, P. P. (2010). “Total Survey Error: Design, Implementation and Evaluation”, Public Opinion Quarterly, 74/5, pp: 817-848.
  • Biemer, P. P., & Lyberg, L. E. (2003). Introduction to Survey Quality, Wiley, Hoboken, NJ.
  • Biemer, P., Groves, R. M., Lyberg, L., Mathiowetz, N., & Sudman, S. (Eds.) (1991). Measurement Errors in Surveys, Wiley, New York.
  • Bleck, J., & Michelitch, K. (2018). “Is Women’s Empowerment Associated with Political Knowledge and Opinions? Evidence from Rural Mali”, World Development, 106, pp: 299-323.
  • Bloom, N., & Van Reenen, J. (2007). “Measuring and Explaining Management Practices across Firms and Countries”, The Quarterly Journal of Economics, 122/4, pp: 1351-1408.
  • Blumberg, S. J., & Luke, J. V. (2006). Wireless Substitution: Preliminary Data from the January–June 2006 National Health Interview Survey. National Center for Health Statistics. Retrieved Jan 8, 2021, from https://www.cdc. gov/nchs/data/hestat/wireless2006/wireless2006.htm
  • Blumberg, S. J., & Luke, J. V. (2013). Wireless Substitution: Early Release of Estimates from the National Health Interview Survey, January–June 2013. National Center for Health Statistics. Retrieved November 14, 2020, from http://www.cdc.gov/nchs/data/nhis/earlyrelease/wireless201312.pdf
  • Bradburn, N. M., Sudman, S., & Blair, E. (1979). Improving Interview Method and Questionnaire Design, JosseyBass, San Francisco.
  • Brady, H. E. (2000). “Contributions of Survey Research to Political Science”, PS: Political Science & Politics, 33/1, pp: 47-58.
  • Carreri, M. (2019). Can Good Politicians Compensate for Bad Institutions? Evidence from an Original Survey of Italian Mayors. Retrieved January 5, 2021, from https://papers.ssrn.com/sol3/papers.cfm?abstract_ id=3239492
  • Christian, L. M., Dillman, D. A, & Smyth, J. D. (2007a). After a Decade of Development: A Visual Design Framework for How Respondents Process Survey Information. In the Annual Conference of the American Association for Public Opinion Research, Anaheim, CA.
  • Christian, L. M., Dillman, D. A., & Smyth, J. D. (2007b). “Helping Respondents Get It Right the First Time: The Influence of Words, Symbols, and Graphics in Web Surveys”, Public Opinion Quarterly, 71/1, pp: 113–125.
  • Christian, L. M., Keeter, S. Purcell, K., & Smith, A. (2010). Accessing the Cell Phone Challenge. In the Annual Conference of the American Association for Public Opinion Research, Chicago, IL. Retrieved November 3, 2020, from http://www.pewresearch.org/2010/05/20/assessing-the-cell-phone-challenge/.
  • Cialdini, R. B. (1990). Deriving Psychological Concepts Relevant to Survey Participation from the Literatures on Compliance, Helping, and Persuasion. Paper presented at the First Workshop on Household Survey Nonresponse, October 15–17, Stockholm, Sweden.
  • Cochran,W. G. (1977). Sampling Techniques, 3. Baskı, Wiley, New York.
  • Conrad, F. G., Couper, M. P., Tourangeau, R., & Galesic, M. (2005). Interactive Feedback Can Improve Quality of Responses in Web Surveys. In the Survey Research Methods Section of the American Statistical Association, pp. 3835–3840. Retrieved October 20, 2020, from http://www.amstat.org/sections/srms/Proceedings/
  • Conrad, F. G., Tourangeau, R., Couper, M. P., & Zhang, C. (2010). Professional Web Respondents and Data Quality. Paper presented at the American Association for Public Opinion Research 65th Annual Conference, Chicago, IL.
  • Converse, J., & Presser, S. (1986). Survey Questions: Handcrafting the Standardized Questionnaire, Sage Publications, Thousand Oaks, CA.
  • Couper, M. P. (1996). “Changes in the Interview Setting Under CAPI”, Journal of Official Statistics, 12/3, pp: 301–316.
  • Couper, M. P., Dever, J. A., & Gile, K. J. (2013). “Report of the AAPOR Task Force on Non-Probability Sampling”, Retrieved November 8, 2020, from https://www.aapor.org/AAPOR_Main/media/MainSiteFiles/NPS_TF_ Report_Final_7_revised_FNL_6_22_13.pdf
  • Cronbach, L. J., & Meehl, P. E. (1955). “Construct Validity in Psychological Tests”, Psychological Bulletin, 52/4, pp: 281-302.
  • Cunningham, S. (2021). Causal Inference: The Mixtape, Yale University Press, New Haven.
  • de Leeuw, E. D. (1992). Data Quality in Mail, Telephone, and Face-To-Face Surveys, TT Publications, Amsterdam, The Netherlands.
  • Dillman, D. A. (2002). “Navigating the Rapids of Change: Some Observations on Survey Methodology in the Early Twenty-First Century”, The Public Opinion Quarterly, 66/3, pp: 473-494.
  • Dillman, D. A., Singer, E., Clark, J. R., & Treat, J. B. (1996). “Effects of Benefit Appeals, Mandatory Appeals and Variations in Confidentiality on Completion Rates of Census Questionnaires”, Public Opinion Quarterly, 60/3, pp: 376–389.
  • Dillman, D. A., Smyth, J. D., & Christian, L. M. (2014). Internet, Phone, Mail, And Mixed-Mode Surveys: The Tailored Design Method, 4. Baskı, John Wiley & Sons, Hoboken, New Jersey.
  • Fink, A. (2003). How to Sample in Surveys, The Survey Kit 7, 2. Baskı, Sage Publications, Thousand Oaks, CA.
  • Fowler (2004). “Getting Beyond Pretesting and Cognitive Interviews: The Case for More Experimental Pilot Studies”, Methods for Testing and Evaluating Survey Questionnaires, (Ed: S. Presser, J. M. Rothgeb, M. P. Couper, J. T. Lessler, E. Martin, J. Martin), Wiley, New York.
  • Fowler, F. J., & Cosenza, C. (2008). “Writing Effective Questions”, International Handbook of Survey Methdology, (Ed: E. D. de Leeuw, J. J. Hox, & D. A. Dillman), pp: 136-160, Lawrence Erlbaum Associates, Taylor & Francis Group, New York.
  • Getmansky, A., Sınmazdemir, T., & Zeitzoff, T. (2018). “Refugees, Xenophobia, and Domestic Conflict: Evidence from a Survey Experiment in Turkey”, Journal of Peace Research, 55/4, pp: 491-507.
  • Groebner, D. F., Shannon, P. W., Fry, P. C., & Smith, K. D. (2013). Business Statistics, Pearson Education, Harlow, United Kingdom.
  • Groves, R. (1989). Survey Errors and Survey Costs, Wiley, New York.
  • Groves, R. M., Cialdini, R., & Couper, M. P. (1992). “Understanding the Decision to Participate in a Survey”, Public Opinion Quarterly, 56, pp: 475–495.
  • Groves, R., & Couper, M. (1998). Nonresponse in Household Interview Surveys, Wiley-Interscience, New York.
  • Groves, R., Biemer, P., Lyberg, L., Massey, J., Nicholls, W. L., & Waksberg, J. (1988). Telephone Survey Methodology, Wiley, New York.
  • Hainmueller, J., & Hiscox, M. J. (2010). “Attitudes toward Highly Skilled and Low-Skilled Immigration: Evidence from a Survey Experiment”, American Political Science Review, 104/1, pp: 61-84.
  • Hanehalkı Bilişim Teknojileri (BT) Kullanım Araştırması. (2019). TÜİK Haber Bülteni. Retrieved November 5, 2020, from https://afyonluoglu.org/bit-kilavuzlar/int-stats/
  • Hox, J. J. (1997). “From Theoretical Concept to Survey Question”, Survey Measurement and Process Quality, (Ed: L. E. Lyberg, P. Biemer, M. Collins, E. D. de Leeuw, C. Dippo, N. Schwarz, & D. Trewin), pp: 47–69, WileyInterscience: New York.
  • Jenkins, C., & Dillman, D. A. (1997). “Towards a Theory of Self-Administered Questionnaire Design”, Survey Measurement and Process Quality, (Ed: L. E. Lyberg, P. Biemer, M. Collins, E. D. de Leeuw, C. Dippo, N. Schwarz, & D. Trewin), pp: 165–196, Wiley-Interscience: New York.
  • Kish, L. (1949), “A Procedure for Objective Respondent Selection within the Household”, Journal of the American Statistical Association, 44/247,pp: 380–387
  • Kish, L. (1965). Survey Sampling, Wiley, New York.
  • Krosnick, J. A., & Fabrigar, L. R. (1997). Designing Rating Scales for Effective Measurement in Surveys. In L. Lyberg, P. Biemer, M. Collins, L. Decker, E. D. de Leeuw, C. Dippo, N. Schwarz, & D. Trewin (Eds.), Survey measurement and process quality (pp. 141–164). New York, NY:Wiley-Interscience.
  • Lee, L., Brittingham, A., Tourangeau, R., Rasinski, K., Willis, G., Ching, P., Jobe, J., & Black, S. (1999). “Are Reporting Errors Due to Encoding Limitations or Retrieval Failure? Surveys of Child Vaccination as a Case Study”, Journal of Applied Cognitive Psychology, 13, pp: 43–63.
  • Leonhardt, D. (2020). Retrieved November 20, 2020, from https://www.nytimes.com/2020/11/12/us/politics/ election-polls-trump-biden.html.
  • Lensvelt-Mulders, G. (2008). “ Surveying Sensitive Topics”, International Handbook of Survey Methdology, (Ed: E. D. de Leeuw, J. J. Hox, & D. A. Dillman), pp: 461478-55, Lawrence Erlbaum Associates, Taylor & Francis Group, New York.
  • Levy, P. S., & Lemeshow, S. (2008). Sampling of Populations: Methods and Applications, 4. Baskı, Wiley, Hoboken, NJ. Lipset, S. M. (1959). “Some Social Requisities of Democracy: Economic Development and Political Legitimacy”, American Political Science Review, 53/1, pp: 69-105.
  • Locander, W., Sudman, S. and Bradburn, N., (1976). “An Investigation of Interview Method, Threat and Response Distortion”. Journal of the American Statistical Association, 71/354, pp: 269-275.
  • Lohr, S. L. (1999). Sampling: Design and Analysis, Duxbury Press, Pacific Grove, CA.
  • Lyall, J., Blair, G., & Imai, K. (2013). Explaining Support for Combatants during Wartime: A Survey Experiment in Afghanistan. American Political Science Review, 107/4, pp: 679-705.
  • Lyberg, L., Biemer, P., Collins, M., De Leeuw, E., Dippo, C., Schwarz, N., & Trewin, D. (Eds.) (1997). Survey Measurement and Process Quality, Wiley-Interscience, New York.
  • Lynn, P. (2008). “ The Problem of Non-Response”, International Handbook of Survey Methdology, (Ed: E. D. de Leeuw, J. J. Hox, & D. A. Dillman), pp: 35-55, Lawrence Erlbaum Associates, Taylor & Francis Group, New York.
  • Marshall, M. G., Jaggers, K., & Gurr, T. R. (2002). “Polity IV Project: Political Regime Characteristics and Transitions, 1800-2002.” University of Maryland.
  • Maxim, P. S. (1999). Quantitative Research Methods in the Social Sciences. Oxford University Press, NewYork, NY.
  • Moore, J. (1988). “Self/Proxy Response Status and Survey Response Quality—A Review of the Literature”, Journal of Official Statistics, 4, pp: 155–172.
  • Platek, R., & Särndal, C. E. (2001). “Can a Statistician Deliver?”, Journal of Official Statistics, 17/1, pp: 1-20.
  • Przeworski. A., & Limongi, F. (1997). “Modernization: Theories and Facts”, World Politics, 49/2, pp: 155-183.
  • Riviere, P. (2002). “What Makes Business Statistics Special?”, International Statistical Review, 70/1, pp: 145–159.
  • Rockwood, T. H., Sangster, R. L., & Dillman, D. A. (1997). “The Effect of Response Categories in Questionnarie Answers: Context and Mode Effects”, Sociological Methods and Research, 26/1, pp: 118-140.
  • Roman, A. (1981). Results from the Methods Development Survey (Phase I). In Proceedings of the Section on Survey Research Methods (pp: 232–237). American Statistical Association.
  • Rossi, P., Wright, J., & Anderson, A. (Eds.) (1983). Handbook of Survey Research, Academic Press, San Diego, CA. Schuman, H., & Presser, S. (1981). Questions and Answers in Attitude Surveys: Experiments on Question Form, Wording, and Context, Academic Press, New York.
  • Singleton & Straits (2002). Approaches to Social Research. Oxford University Press, Oxford.
  • Smyth, J. D., Dillman, D. A., & Christian, L. M. (2007a). “Context effects in web surveys: New issues and evidence”, The Oxford Handbook of Internet Psychology (Eds: A. Joinson, K. McKenna, T. Postmes, & U.-D. Reips), pp: 427–443, Oxford University Press: New York.
  • Smyth, J. D., Dillman, D. A., Christian, L. M., & McBride, M. (2009). “Open-Ended Questions in Web Surveys: Can Increasing the Size of Answer Spaces and Providing Extra Verbal Instructions Improve Response Quality?”, Public Opinion Quarterly, 73, pp: 325–337.
  • Sudman, S., & Bradburn, N. (1982). Asking Questions: A Practical Guide to Questionnaire Design, Jossey-Bass, San Francisco.
  • Sudman, S., Bradburn, N. M., & Schwarz, N. (1996). Thinking About Answers: The Applications of Cognitive Processes to Survey Methodology, Jossey-Bass, San Francisco.
  • Tanur, J. (Ed.) (1992). Questions About Questions: Inquiries into the Cognitive Bases of Surveys, Russel Sage Foundation, New York.
  • Tourangeau, R. (1984). “Cognitive Sciences and Survey Methods”, Cognitive Aspects of Survey Methodology: Building a Bridge Between Disciplines, (Ed: T. Jabine vd.), pp: 73–100, National Academy of Science: Washington, D.C.
  • Tourangeau, R., Rips L. J., & Rasinski K. (2000). The Psychology of Survey Response, Cambridge University Press, Cambridge.
  • Turner, C. F., & Martin, E. (Eds.) (1984). Surveying Subjective Phenomena, Volumes I and II, Russell Sage Foundation, New York.
  • Turner, C. F., Forsyth, B. H., O’Reilly, J. M., Cooley, P. C., Smith, T. K., Rogers, S. M., & Miller, H. G. (1998), “Automated Self-Interviewing and the Survey Measurement of Sensitive Behaviors”, Computer Assisted Survey Information Collection, (ED: M. P. Couper, R. P. Baker, J. Bethlehem, C. Z. F. Clark, J. Martin,W. L. Nicholls II ve J. M. O’Reilly), pp. 455–473, Wiley, New York.
  • U.S Government Accountability Office. (2020). 2020 Decennial Census. Retrieved November 20, 2020, from https://www.gao.gov/highrisk/2020_decennial_census/why_did_study - t=1
  • Zickuhr K., & Smith A. (2013). Home Broadband 2013. Retrieved November 23, 2020, from http://pewinternet. org/Reports/2013/Broadband.aspx
  • Beyan ve Açıklamalar (Disclosure Statements)
  • 1. Bu çalışmanın yazarları, araştırma ve yayın etiği ilkelerine uyduklarını kabul etmektedirler (The authors of this article confirm that their work complies with the principles of research and publication ethics).
  • 2. Yazarlar tarafından herhangi bir çıkar çatışması beyan edilmemiştir (No potential conflict of interest was reported by the authors).
  • 3. Bu çalışma, intihal tarama programı kullanılarak intihal taramasından geçirilmiştir (This article was screened for potential plagiarism using a plagiarism screening program).