Revisiting Quick Big Five Personality Test: Testing Measurement Invariance across Gender

Personality is a subject that has been studied because of the social, economic, individual, and educationalimplications of personality. The widely used model for measuring personality is the Five-Factor Model (FFM).The robustness of the factor structure of the FFM of personality has been provided among cultures and diversesamples. The measurement tools are used to identify differences between individuals or groups. However, inorder to make meaningful comparisons, it is necessary to provide the measurement equivalence among thecomparison groups. Thus the current study aimed to test the measurement invariance of the Quick Big Five(QBF) items that are used in many disciplines in Turkey. For this purpose, the QBF items were investigated interms of configural, metric, scalar and strict invariance across gender. In this research, 1114 university studentsaged between 17-32 years were included in the sample. Firstly, several CFAs were performed for the wholesample and then both men and women separately. The findings of the CFA revealed that the QBF model fit thedata. In addition, each of the 30 items of the scale was embedded into a related latent factor in both gendergroups. Secondly, sequential multiple group CFA tests to examine measurement invariance were conducted.According to the findings, full configural, partial metric and scalar invariance were fulfilled across gender.However, strict invariance could not be achieved. Imaginative and inquisitive under the openness factor weredetermined to cause measurement non-invariance. In conclusion, latent mean comparisons can be made byexcluding these two items across gender.

PDF

___

Arnett, J. J. (2000). Emerging adulthood: A theory of development from the late teens through the twenties. American Psychologist, 55(5), 469-480. doi: 10.1037//0003-066X.55.5.469
Barrick, M. R., & Mount, M. K. (1991). The big five personality dimensions and job performance: A metaanalysis. Personnel Psychology, 44(1), 1-26. Retrieved from http://jwalkonline.org/docs/Grad%20Classes/Fall%2007/Org%20Psy/big%205%20and%20job%20per f.pdf
Beauducel, A., & Wittmann, W. W. (2005). Simulation study on fit indexes in CFA based on data with slightly distorted simple structure. Structural Equation Modeling, 12(1), 41-75. doi: 10.1207/s15328007sem1201_3
Berings, D., De Fruyt, F., & Bouwen, R. (2004). Work values and personality traits as predictors of enterprising and social vocational interests. Personality and Individual Differences, 36(2), 349-364. doi: 10.1016/s0191-8869(03)00101-6
Bidjerano, T., & Dai, D. Y. (2007). The relationship between the big-five model of personality and self-regulated learning strategies. Learning and individual differences, 17(1), 69-81. doi: 10.1016/j.lindif.2007.02.001
Bleidorn, W., Hopwood, C. J., & Lucas, R. E. (2018). Life events and personality trait change. Journal of Personality, 86(1), 83-96. doi: 10.1111/jopy.12286
Bono, J. E., Boles, T. L., Judge, T. A., & Lauver, K. J. (2002). The role of personality in task and relationship conflict. Journal of Personality, 70(3), 311-344. doi: 10.1111/1467-6494.05007
Borghuis, J., Denissen, J. J., Oberski, D., Sijtsma, K., Meeus, W. H., Branje, S., …, & Bleidorn, W. (2017). Big Five personality stability, change, and codevelopment across adolescence and early adulthood. Journal of Personality and Social Psychology, 113(4), 641-657. doi: 10.1037/pspp0000138
Borkenau, P., McCrae, R. R., & Terracciano, A. (2013). Do men vary more than women in personality? A study in 51 cultures. Journal of Research in Personality, 47(2), 135-144. doi: 10.1016/j.jrp.2012.12.001
Bouchard, T. J., & Loehlin, J. C. (2001). Genes, evolution, and personality. Behavior Genetics, 31(3), 243-273. doi: 10.1023/A:1012294324713
Brown, T. A. (2006). Confirmatory factor analysis for applied research. New York, NY: Guilford Press.
Browne, K. R. (2006). Evolved sex differences and occupational segregation. Journal of Organizational Behavior, 27(2), 143-162. doi: 10.1002/job.349
Buss, D. M. (2004). Evolutionary psychology: The new science of the mind (2nd ed.). Boston, MA: Allyn & Bacon.
Chamorro-Premuzic, T., & Furnham, A. (2003). Personality predicts academic performance: Evidence from two longitudinal university samples. Journal of Research in Personality, 37(4), 319-338. doi: 10.1016/S0092-6566(02)00578-0
Cheung, F. M., Cheung, S. F., Zhang, J., Leung, K., Leong, F., & Huiyeh, K. (2008). Relevance of openness as a personality dimension in Chinese culture: Aspects of its cultural relevance. Journal of Cross-Cultural Psychology, 39(1), 81-108. doi: 10.1177/0022022107311968
Cheung, F., Fan, W., & To, C. (2008). The Chinese Personality Assessment Inventory as a culturally relevant personality measure in applied settings. Social and Personality Psychology Compass, 2(1), 74-89. doi: 10.1111/j.1751-9004.2007.00045.x
Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233-255. doi: 10.1207/S15328007SEM0902_5
Cole, D., & Espinoza, A. (2008). Examining the academic success of Latino students in science technology engineering and mathematics (STEM) majors. Journal of College Student Development, 49(4), 285-300. doi: 10.1353/csd.0.0018
Connelly, B. S., Ones, D. S., Davies, S. E., & Birkland, A. (2014). Opening up openness: A theoretical sort following critical incidents methodology and a meta-analytic investigation of the trait family measures. Journal of Personality Assessment, 96(1), 17-28. doi: 10.1080/00223891.2013.809355
Cooper, A., Gomez, R., & Aucote, H. (2007). The behavioural inhibition system and behavioural approach system (BIS/BAS) scales: Measurement and structural invariance across adults and adolescents. Personality and Individual Differences, 43(2), 295-305. doi: 10.1016/j.paid.2006.11.023
Costa Jr, P. T., Terracciano, A., & McCrae, R. R. (2001). Gender differences in personality traits across cultures: robust and surprising findings. Journal of Personality and Social Psychology, 81(2), 322-331. doi: 10.1037/0022-3514.81.2.322
De Raad, B., & Schouwenburg, H. C. (1996). Personality in learning and education: A review. European Journal of Personality, 10(5), 303-336. doi: 10.1002/(SICI)1099-0984(199612)10:5<303::AIDPER262> 3.0.CO;2-2
DeYoung, C. G., Peterson, J. B., & Higgins, D. M. (2005). Sources of openness/intellect: Cognitive and neuropsychological correlates of the fifth factor of personality. Journal of Personality, 73(4), 825-858. doi: 10.1111/j.1467-6494.2005.00330.x
Dimitrov, D.M. (2010). Testing for factorial invariance in the context of construct validation. Measurement and Evaluation in Counseling and Development, 43(2) 121-149. doi: 10.1177/0748175610373459
Donnellan, M.B., Conger, R.D., & Burzette, R.G. (2007). Personality development from late adolescence to young adulthood: Differential stability, normative maturity, and evidence for the maturity-stability hypothesis. Journal of Personality, 75(2), 237-263. doi: 10.1111/j.1467-6494.2007.00438.x
Duckworth, A. L., & Seligman, M. E. P. (2005). Self-Discipline outdoes iq in predicting academic performance of adolescents. Psychological Science, 16(12), 939-944. Retrieved from https://www.jstor.org/stable/pdf/40064361.pdf
Dumfart, B., & Neubauer, A. C. (2016). Conscientiousness is the most powerful noncognitive predictor of school achievement in adolescents. Journal of Individual Differences, 37(1), 8-15. doi: 10.1027/1614- 0001/a000182
Durbin, C. E., Hicks, B. M., Blonigen, D. M., Johnson, W., Iacono, W. G., & McGue, M. (2016). Personality trait change across late childhood to young adulthood: Evidence for nonlinearity and sex differences in change. European Journal of Personality, 30(1), 31-44. doi: 10.1002/per.2013
Eccles, J. (2011). Gendered educational and occupational choices: Applying the Eccles et al. model of achievement-related choices. International Journal of Behavioral Development, 35(3), 195-201. doi: 10.1177/0165025411398185
Fadjukoff, P., Feldt, T., Kokko, K., & Pulkkinen, L. (2019). Identity status change within personal style clusters: a longitudinal perspective from early adulthood to midlife. Identity, 19(1), 1-17. doi: 10.1080/15283488.2019.1566066
Falk, A., & Hermle, J. (2018). Relationship of gender differences in preferences to economic development and gender equality (IZA Discussion Papers, No. 12059). Institute of Labor Economics (IZA), Bonn. Retrieved from http://hdl.handle.net/10419/193353
Figueredo, A. J., Sefcek, J. A., & Jones, D. N. (2006). The ideal romantic partner personality. Personality and Individual Differences, 41(3), 431-441. doi: 10.1016/j.paid.2006.02.004
Fischer, A. H., & Manstead, A. S. R. (2000). The relation between gender and emotion in different cultures. In A. H. Fischer (Ed.), Studies in emotion and social interaction. Second series. Gender and emotion: Social psychological perspectives (pp. 71-94). Cambridge University Press. doi: 10.1017/CBO9780511628191.005
Funder, D. C. (2001). Personality. Annual Review of Psychology, 52, 197-221. Retrieved from https://intranet.newriver.edu/images/stories/library/Stennett_Psychology_Articles/Personality.pdf
Gasser, C. E., Larson, L. M., & Borgen, F.H. (2007). Concurrent validity of the 2005 Strong Interest Inventory: An examination of gender and major field of study. Journal of Career Assessment, 15(1), 23-43. Retrieved from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.908.2140&rep=rep1&type=pdf
Guimond, S. (2008). Psychological similarities and differences between women and men across cultures. Social and Personality Psychology Compass, 2(1), 494-510. doi: 10.1111/j.1751-9004.2007.00036.x
Heckman, J. J., Stixrud, J., & Urzua, S. (2006). The effects of cognitive and non-cognitive abilities on labor market outcomes and social behavior. Journal of Labor Economics, 24(3), 411-482. Retrieved from https://www.nber.org/papers/w12006.pdf
Hu, L. T., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3(4), 424-453. Retrieved from https://pdfs.semanticscholar.org /a92c/9726361d9c1d165dbf2ea781b6c48363a816.pdfRelated
Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1-55. doi: 10.1080/10705519909540118
John, O. P., & Srivastava, S. (1999). The Big Five trait taxonomy: History, measurement, and theoretical perspectives. In L. A. Pervin & O. P. John (Eds.), Handbook of personality: Theory and research (2nd ed., pp. 102-138). New York, NY: Guilford Press.
John, O. P., Neumann, L. P., & Soto, C. J. (2008). Paradigm shift to the integrative Big-Five trait taxonomy: History, measurement, and conceptual issues. In O. P. John, R. W. Robins, & L. A. Pervin (Eds.), Handbook of personality: Theory and research (3rd ed., pp. 114-158). New York, NY: Guilford.
Johnson, J. G., Cohen, P., Brown, J., Smailes, E. M., & Bernstein, D. P. (1999). Childhood maltreatment increases risk for personality disorders during early adulthood. Archives of General Psychiatry, 56(7), 600-606. doi: 10.1001/archpsyc.56.7.600
Josephs, R. A., Markus, H. R., & Tafarodi, R. W. (1992). Gender and self-esteem. Journal of Personality and Social Psychology, 63(3), 391-402. Retrieved from https://www.researchgate.net/profile/Robert_Josephs/publication/21751337_Gender_and_Self- Esteem/links/0912f5098177bd1614000000.pdf
Judge, T. A., & Ilies, R. (2002). Relationship of personality to performance motivation: A meta-analytic review. Journal of applied psychology, 87(4), 797-807. doi: 10.1037//0021-9010.87.4.797
Judge, T. A., Erez, A., Bono, J. E., & Thoresen, C. J. (2002). Are measures of self-esteem, neuroticism, locus of control, and generalized self-efficacy indicators of a common core construct? Journal of Personality and Social Psychology, 83(3), 693-710. doi: 10.1037//0022-3514.83.3.693
Kajonius, P. J., & Johnson, J. (2018). Sex differences in 30 facets of the five-factor model of personality in the large public (N=320,128). Personality and Individual Differences, 129(July), 126-130. doi: 10.1016/j.paid.2018.03.026
Klein, H. J., & Lee, S. (2006). The effects of personality on learning: The mediating role of goal setting. Human Performance, 19(1), 43-66. doi: 10.1207/s15327043hup1901_3
Klimstra, T. A., Luyckx, K., Branje, S., Teppers, E., Goossens, L., & Meeus, W. H. (2013). Personality traits, interpersonal identity, and relationship stability: Longitudinal linkages in late adolescence and young adulthood. Journal of Youth and Adolescence, 42(11), 1661-1673. doi: 10.1007/s10964-012-9862-8
Kline, R. B. (2011). Principles and practice of structural equation modeling. New York, NY: The Guilford Press.
Korkmaz, M., Somer, O., & Gungor, D. (2013). Measurement equivalence across gender with mean and covariance structure of five factor personality inventory for adolescent sample. Education and Science, 38(170). 121-134. Retrieved from http://egitimvebilim.ted.org.tr/index.php/EB/article/view/1532/550
Langen, A. V., & Dekkers, H. (2005). Cross‐national differences in participating in tertiary science, technology, engineering and mathematics education. Comparative Education, 41(3), 329-350. doi: 10.1080/03050060500211708
Legewie, J., & DiPrete, T. A. (2014). The high school environment and the gender gap in science and engineering. Sociology of Education, 87(4), 259-280. doi: 10.1177/0038040714547770
Lippa, R. A. (2010). Gender differences in personality and interests: When, where, and why? Social and Personality Psychology Compass, 4(11), 1098-1110. doi: 10.1111/j.1751-9004.2010.00320.x
Lounsbury, J. W., Sundstrom, E., Loveland, J. M., & Gibson, L. W. (2003). Intelligence, “Big Five” personality traits, and work drive as predictors of course grade. Personality and Individual Differences, 35(6), 1231-1239. Retrieved from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.936.3275&rep=rep1&type=pdf
Low, K., & Rounds, J. (2007). Interest change and continuity from early adolescence to middle adulthood. International Journal for Educational and Vocational Guidance, 7(1), 23-36. doi: 10.1007/s10775-006- 9110-4
Lynn, R. (1993). Sex differences in competitiveness and the valuation of money in twenty countries. Journal of Social Psychology, 133(4), 507-511.
Manders, W. A., Scholte, R. H., Janssens, J. M., & De Bruyn, E. E. (2006). Adolescent personality, problem behaviour and the quality of the parent–adolescent relationship. European Journal of Personality, 20(3), 237-254. doi: 10.1002/per.574
Matthews, G., Zeidner, M., & Roberts, R. D. (2006). Models of personality and affect for education: A review and synthesis. In P. A. Alexander & P. H. Winne (Eds.), Handbook of educational psychology (2nd ed., pp. 163-186). Mahwah, NJ: Erlbaum.
McAdams, D. P., & Pals, J. L. (2006). A new Big Five: fundamental principles for an integrative science of personality. American Psychologist, 61(3), 204-217. Retrieved from http://people.wku.edu/richard.miller/new%20big%20five.pdf
McCrae, R. R., & Costa, P. T., Jr. (1997). Conceptions and correlates of openness to experience. In R. Hogan, J. A. Johnson, & S. R. Briggs (Eds.), Handbook of personality psychology (pp. 825-847). Academic Press. doi: 10.1016/B978-012134645-4/50032-9
McCrae, R. R., Terracciano, A., & Pro, P. P. C. (2005). Personality profiles of cultures: Aggregate personality traits. Journal of Personality and Social Psychology, 89(3), 407-425. doi: 10.1037/0022-3514.89.3.407
McCrae, R. R., Yik, M. S., Trapnell, P. D., Bond, M. H., & Paulhus, D. L. (1998). Interpreting personality profiles across cultures: Bilingual, acculturation, and peer rating studies of Chinese undergraduates. Journal of Personality and Social Psychology, 74(4), 1041-1055. doi: 10.1037/0022-3514.74.4.1041
Milfont, T. L., & Fischer, R. (2010). Testing measurement invariance across groups: Applications in crosscultural research. International Journal of psychological research, 3(1), 111-130. Retrieved from http://45.5.172.45/bitstream/10819/6503/1/Testing_Measurement_Invariance_Milfont_2010.pdf
Morizot, J. (2014). Construct validity of adolescents’ self-reported big five personality traits: Importance of conceptual breadth and initial validation of a short measure. Assessment, 21(5), 580-606. doi: 10.1177/1073191114524015
Morsunbul, U. (2014). The validity and reliability study of the Turkish version of quick big five personality test. Dusunen Adam The Journal of Psychiatry and Neurological Sciences, 27(4), 316-322. doi: 10.5350/DAJPN2014270405
Mueller, G., & Plug, E. (2006). Estimating the effect of personality on male and female earnings. Industrial and Labor Relations Review, 60(1), 3-22. Retrieved from http://www.jstor.org/stable/25067572
Nguyen, N. T., Allen, L. C., & Fraccastoro, K. (2005). Personality predicts academic performance: Exploring the moderating role of gender. Journal of Higher Education Policy and Management, 27(1), 105-117. doi: 10.1080/13600800500046313
Noftle, E. E., & Robins, R. W. (2007). Personality predictors of academic outcomes: Big five correlates of GPA and SAT scores. Journal of Personality and Social Psychology, 93(1), 116-130. doi: 10.1037/0022- 3514.93.1.116
O’Connor, M. C., & Paunonen, S. V. (2007). Big five personality predictors of post-secondary academic performance. Personality and Individual Differences, 43(5), 971-990. doi: 10.1016/j.paid.2007.03.017
Ock, J., McAbee, S. T., Mulfinger, E., & Oswald, F. L. (2020). The practical effects of measurement invariance: gender invariance in two big five personality measures. Assessment, 27(4), 657-674. doi: 10.1177/1073191119885018
Paunonen, S. V., & Ashton, M. C. (2001). Big five factors and facets and the prediction of behavior. Journal of Personality and Social Psychology, 81(3), 524-539. doi: 10.1037/0022-3514.81.3.524
Poropat, A. E. (2009). A meta-analysis of the five-factor model of personality and academic performance. Psychological Bulletin, 135(2), 322-338. doi: 10.1037/a0014996
Poropat, A. E. (2011). The Eysenckian personality factors and their correlations with academic performance. British Journal of Educational Psychology, 81(1), 41-58. doi: 10.1348/000709910X497671
Poropat, A. E. (2014). Other-rated personality and academic performance: Evidence and implications. Learning and Individual Differences, 34, 24-32. doi: 10.1016/j.lindif.2014.05.013
Putnick, D. L., & Bornstein, M. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71-90. doi: 10.1016/j.dr.2016.06.004
Rindermann, H., & Neubauer, A. (2001). The influence of personality on three aspects of cognitive performance: Processing speed, intelligence and school performance. Personality and Individual Differences, 30(5), 829- 842. Retrieved from https://pdfs.semanticscholar.org/e468/6271719ef3a12ffc1e3db46bb705cf2195a6.pdf
Roberts, B. W., Kuncel, N., Shiner, R. N., Caspi, A., & Goldberg, L. R. (2007). The power of personality: The comparative validity of personality traits, socio-economic status, and cognitive ability for predicting important life outcomes. Perspectives in Psychological Science, 2(4), 313-345. doi: 10.1111/j.1745- 6916.2007.00047.x
Roberts, B. W., Walton, K. E., & Viechtbauer, W. (2006). Patterns of mean-level change in personality traits across the life course: a meta-analysis of longitudinal studies. Psychological Bulletin, 132(1), 1-25. doi: 10.1037/0033-2909.132.1.1
Roets, A., & Van Hiel, A. (2011). Item selection and validation of a brief, 15-item version of the need for closure scale. Personality and Individual Differences, 50(1), 90-94. doi: 10.1016/j.paid.2010.09.004
Rollock, D., & Lui, P. P. (2016). Measurement invariance and the five-factor model of personality: Asian international and Euro American cultural groups. Assessment, 23(5), 571-587. doi: 10.1177/1073191115590854
Samuel, D. B., South, S. C., & Griffin, S. A. (2015). Factorial invariance of the five-factor model rating form across gender. Assessment, 22(1), 65-75. doi: 10.1177/1073191114536772
Sass, D. A. (2011). Testing measurement invariance and comparing latent factor means within a confirmatory factor analysis framework. Journal of Psychoeducational Assessment, 29(4), 347-363. doi: 10.1177/0734282911406661
Saucier, G., & Goldberg, L. R. (1996). The language of personality: Lexical perspectives on the five- factor model. In J. S. Wiggins. (Ed.), The five-factor model of personality: Theoretical Perspective (pp. 21- 50). New York, NY; Guilford.
Schmitt, D. P., Long, A. E., McPhearson, A., O’Brien, K., Remmert, B., & Shah, S. H. (2017). Personality and gender differences in global perspective. International Journal of Psychology, 52(1), 45-56. doi: 10.1002/ijop.12265
Schmitt, D. P., Realo, A., Voracek, M., & Allik, J. (2008). Why can’t a man be more like a woman? Sex differences in Big Five personality traits across 55 cultures. Journal of Personality and Social Psychology, 94(1), 168-182. doi: 10.1037/0022-3514.94.1.168
Shiner, R. L., Allen, T. A., & Masten, A. S. (2017). Adversity in adolescence predicts personality trait change from childhood to adulthood. Journal of Research in Personality, 67, 171-182. doi: 10.1016/j.jrp.2016.10.002
Soto, C. J. (2016). The little six personality dimensions from early childhood to early adulthood: Mean‐level age and gender differences in parents' reports. Journal of Personality, 84(4), 409-422. doi: 10.1111/jopy.12168
Tabachnick, B.G., & Fidell, L.S. (2001). Using multivariate statistics (4th ed.). Needham Heights, MA: Allyn & Bacon.
Triandis, H. C., & Suh, E. M. (2002). Cultural influences on personality. Annual Review of Psychology, 53(1), 133-160. doi: 10.1146/annurev.psych.53.100901.135200
Van de Schoot, R., Lugtig, P., & Hox, J. (2012). A checklist for testing measurement invariance. European Journal of Developmental Psychology, 9(4), 486-492. doi: 10.1080/17405629.2012.686740
Vandenberg, R. J. (2002). Toward a further understanding of and improvement in measurement invariance methods and procedures. Organizational Research Methods, 5(2), 139-158. doi: 10.1177/1094428102005002001
Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational research methods, 3(1), 4-70. doi: 10.1177/109442810031002
Vermults, A. A., & Gerris, J. R. M. (2005). QBF: Quick Big Five persoonlijkheidstest handleiding [Quick Big Five personality test manual]. Leeuwarden, the Netherlands: LDC Publications.
Wang, M. T., & Degol, J. L. (2017). Gender gap in science, technology, engineering, and mathematics (STEM): Current knowledge, implications for practice, policy, and future directions. Educational Psychology Review, 29(1), 119-140. doi: 10.1007/s10648-015-9355-x
Willingham, W. W., Pollack, J. M., & Lewis, C. (2002). Grades and test scores: Accounting for observed differences. Journal of Educational Measurement, 39(1), 1-37. Retrieved from https://www.jstor.org/stable/1435104?seq=1&cid=pdf-reference#references_tab_contents