바로가기메뉴

본문 바로가기 주메뉴 바로가기

Cultural differences in the stability of self-report measures: A comparison of Korean and German students

Korean Journal of Social and Personality Psychology / Korean Journal of Social and Personality Psychology, (P)1229-0653;
2015, v.29 no.3, pp.67-83
https://doi.org/10.21193/kjspp.2015.29.3.004


  • Downloaded
  • Viewed

Abstract

This study aims to examine if the stability of self-report measures vary with culture. People from East Asian countries are generally assumed to behave more flexibly in different interpersonal contexts and to put less emphasis on the stability of one’s self-image as compared to Westerners. It is hypothesized that this difference is related to the stability of self-report measures and would be explained by interdependence. A questionnaire study was conducted with 257 Korean and 196 German college students. Both samples were divided in two subsamples according to their level of interdependence. Data on the retest-reliability of self-report measures were collected through the repeated assessment of 6 NEO-PI-R scales: warmth, gregariousness. altruism, modesty, dutifulness and self-discipline. There was a one-month interval between the two measurements. Retest-reliability coefficients were transformed into the Fisher’s Z scores, and data analysis was carried out for these scores by one-tailed z-tests. Our results partially support the assumption of cultural effects on the stability of self-report measures. For the altruism scale, retest-reliability was significantly lower in the subsample with a higher level of interdependence both in Korea and in Germany. For the modesty, dutifulness and self-discipline scale Retest-reliability was significantly lower in students from Korea who also showed higher level of interdependence. The results were discussed in terms of interdependence.

keywords
retest-reliability, self-report measures, NEO-PI-R, interdependence, 재검사 신뢰도, 자기보고식 심리측정, NEO-PI-R, 상호의존성

Reference

1.

안창규, 채준호 (1997). NEO-PI-R의 한국표준화를 위한 연구. 한국심리학회지: 상담과 심리치료, 9(1), 443-473.

2.

윤성민, 신희철 (2013). 행복증진을 위한 개입 활동들의 효과에 영향을 미치는 성격 5요인의 역할 탐색. 한국심리학회지: 상담 및 심리치료, 25(2), 275-308.

3.

한규석 (2009). 사회심리학이 이해. 서울: 학지사.

4.

한규석, 신수진 (1999). 한국인의 선호가치 변화 - 수직적 집단주의에서 수평적 개인주의로. 한국심리학회지: 사회 및 성격, 13(2), 293-310.

5.

Allik, J., Laidra, K., Realo, A., & Pullmann, H. (2004). Personality development from 12 to 18 years of age: Changes in mean levels and structures of traits. European Journal of Personality, 18, 445-462.

6.

Caruso, J. C. (2000). Reliability generalization of the NEO personality scales. Educational and Psychological Measurement, 60(2), 236-254.

7.

Cattell, R. B. (1986). The psychometric properties of tests: Consistency, validity, and efficiency. In R. B. Cattell & R. C. Johnson (Eds.), Functional psychological testing (pp. 54-78). New York: Brunner/Mazel.

8.

Chmielewski, M., & Watson, D. (2009). What is being assessed and why it matters: The Impact of transient error on trait research. Journal of Personality and Social Psychology, 97(1), 186-202.

9.

Choi, I., & Choi, Y. (2002). Culture and self-concept flexibility. Personality and Social Psychology Bulletin, 28, 1508-1517.

10.

Church, A. T., Katigbak, M. S., Reyes, J. A. S., Salanga, M. G. C., Miramontes, L. A., & Adams, N. B. (2008). Prediction and cross- situational consistency of daily bahavior across cultures: Testing trait and cultural psychology perspectives. Journal of Research in Personality, 42, 1199-1215.

11.

Cortina J. (1993). What is coefficient alpha: an examination of theory and applications. Journal of Applied Psychology, 78, 98-104.

12.

Costa, P. T., Jr., & McCrae, R. R. (1992). Revised NEO Personality Inventory and NEO Five-Factor Inventory Professional Manual. Odessa, FL: Psychological Assessment Resources.

13.

Cronbach, L. J., (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297-334.

14.

English, T., & Chen, S. (2007). Culture and self-concept stability: Consistency across and within context among Asian Americans and European Americans. Journal of Personality and Social Psychology, 93, 478-490.

15.

Eysenck, H. J. (1992). Four ways five factors are not basic. Personality and Individual Differences, 13, 667-673.

16.

Fiske, A. P. (2002). Using individualism and collectivism to compare cultures-A critique of the validity and measurement of the constructs: Comment on Oyserman et al. (2002). Psychological Bulletin, 128, 78-88.

17.

Green, S. B. (2003). A coefficient alpha for test-retest data. Psychological Methods, 8, 88-101.

18.

Heine, S. J. (2001). Self as cultural product: An examination of East Asian and North American selves. Journal of Personality, 69, 881-.906.

19.

Hoppe-Graff, S., & Kim, H. -O. (2004). Understanding rights and duties in different cultures and contexts: Observations from German and Korean adolescents. In N.J. Finkel & F.M. Moghaddam (Eds.), Human rights and duties: Empirical contributions and normative commentaries (pp. 49-73). Washington, DC: APA Press

20.

John, O. P., & Robins, R. W. (1993). Determinants of interjudge agreement on personality traits: The Big Five domains, observability, evaluativeness, and the unique perspective of the self. Journal of Personality, 61, 521-551.

21.

John, O. P., & Soto, C. H. (2007). The importance of being valid: Reliability and the process of construct validation. In R. W. Robins, R. C. Fraley, & R. F. Krueger (Eds.), Handbook of research methods in personality psychology (pp. 461-494). New York: Guilford Press.

22.

Johnson, J. A. (1997). Units of analysis for the description and explanation of personality. In R. Hogan, J. Johnson, & S. Briggs (Eds.), Handbook of personality psychology (pp. 73-93). San Diego: Academic Press.

23.

Kanagawa, C., Cross, S. E., & Markus, H. R. (2001). “Who am I?” The cultural psychology of the conceptual self. Personality and Social Psychology Bulletin, 27, 90-103.

24.

Kitayama, S., Markus, H. R., & Kurokawa, M. (2000). Culture, emotion, and well-being: Good feelings in Japan and the United States. Cognition and Emotion, 14, 93-124.

25.

Kitayama, S., Park, H., Sevincer, A. T., Karasawa, M., & Uskul, A. (2009). A cultural task analysis of implicit independence: Comparing North America, Westen Europe, and East Asia. Journal of Personality and Social Psychology, 97(2), 236-255.

26.

Kondo, D. (1990). Crafting selves: Power, gender and discourses of identity in a Japanese workplace. Chicago: University of Chicago Press.

27.

Lebra, T. S. (1994). Mother and child in Japanese socialization: A Japan-U.S. comparison. In P. M. Greenfield & R. R. Cocking (Eds.), Cross-cultural roots of minority child development (pp. 259-274). Hillsdale, NJ: Lawrence Erlbaum.

28.

Levine, T. R., Bresnahan, M. J., Park, H., Lapinski, M. K., Wittenbaum, G. M., Shearman, S. M., Lee, S., Chung, D., & Ohashi, R. (2003). Self-constual sclaes lack validity. Human Communication Reseach, 29(2), 210-252.

29.

Markus, H. R., & Kitayama, S. (1991). Culture and the self: Implications for cognition, emotion, and motivation. Psychological Review, 98, 224-253.

30.

Markus, H. R., & Kitayama, S. (1994). A collective fear of the collective: Implications for selves and theories of selves. Personality and Social Psychology Bulletin, 20, 568-.579.

31.

Markus, H. R., & Kitayama, S. (1998). The cultural psychology of personality. Journal of Cross-Cultural Psychology, 29, 63-87.

32.

Markus, H. R., & Kitayama, S., Mullally, P., Masuda, T., & Fryberg, S. (1997). Of selves and selfways: Patterns of individuality and uniformity in identity. Stanford, CA: Stanford University Press.

33.

Masuda, T., & Nisbett, R. E. (2001). Attending holistically versus analytically: Comparing the context sensitivity of Japanese and Americans. Journal of Personality and Social Psychology, 81, 922-934.

34.

Matsumoto, D. (2003). The discrepancy between consensual-level culture and individual-level culture. Culture & Psychology, 9(1), 89-95.

35.

McCrae, R. R., & Costa, P. T. (1994). The stability of personality: Observations and evaluations. Current Directions in Psychological Science, 3, 173-175.

36.

McCrae, R. R., Kurtz, J. W., Yamagata, S., & Terracciano, A. (2011). Internal consistency, retest reliability, and their implications for personality scale validity. Personality and Social Psychology Review, 15(1), 28-50.

37.

Morris, M. W., & Peng, K. (1994). Culture and cause: American and Chinese attributions for social and physical events. Journal of Personality and social Psychology, 67, 949-971.

38.

Murphy, K. R., & Davidshofer, C. O. (2001). Psychological testing: Principles and applications (5th ed.). Upper Saddle River, NJ: Prentice Hall.

39.

Newman, L. S. (1993). How individualists interpret behavior: Idiocentrism and spontaneous trait inference. Social Cognition, 11, 243-269.

40.

Noguchi, K. (2007). Examination of the content of individualism/ collectivism scales in cultural comparisons of the USA and Japan. Asian Journal of Social Psychology, 10, 131-144.

41.

Nunnally, J. C., & Bernstein, I. (1994). Psychometric theory (3rd ed.). New York, NY: McGraw-Hill.

42.

Oishi, S., Diener, E., Scollon, C. N., & Biswas- Diener, R. (2004). Cross-situational consistency of affective experiences across cultures. Journal of Personality and Social Psychology, 86, 460-.472.

43.

Osburn, H. G. (2000). Coefficient alpha and related internal consistency reliability coefficients. Psychological Methods, 5(3), 343-355.

44.

Ostendorf, F., & Angleitner, A. (2004). NEO-PI-R Manual. Göttingen: Hogrefe.

45.

Owe, E. 외 78인 (2013). Contextualism as an important facet of individualism-collectivism: Personhood beliefs across 37 national groups. Journal of Cross-Cultural Psychology, 44(1), 24-45.

46.

Pedhazur, E. J., & Schmelkin, L. P. (1991). Measurement, design, and analysis: An integrated approach. Hillsdale, NJ: Lawrence Erlbaum.

47.

Peng, K., & Nisbett, R. E. (1999). Culture, dialectics, and reasoning about contradiction. American Psychologist, 54, 741-.754.

48.

Pietmont, R. L., & Chae, J. (1997). Cross-cultural generalizability of the five-factor model of personality: Development and validation of the NEO-PI-R for Koreans. Journal of Cross-Cultural Psychology, 28(2), 131-155.

49.

Schimmack, U., Oishi, S., & Diener, E. (2005). Individualism: A valid and important dimension of cultural differences. Personality and Social Psychology Review, 9, 17-31.

50.

Schmidt, F. L., Lee, H., & Ilies, R. (2003). Beyond alpha: An empirical examination of the effects of different sources of measurement error on reliability estimates for measures of individual differences constructs. Psychological Methods, 8, 206-224.

51.

Schmitt, D. P., Allik, J., McCrae, R. R., & Benet-Martinez, V. (2007). The geographic distribution of big five personality traits: Patterns and Profiles of Human Self-Description Across 56 Nations. Journal of Cross-Cultural Psychology, 38, 173-212.

52.

Schwartz, S. H. (2006). A theory of cultural value orientations: explication and application. Comparative Sociology, 5(2), 137-182.

53.

Schweder, R. A. (1991). Thinking through cultures: Expeditions in cultural psychology. Cambridge, MA: Harvard University Press.

54.

Scollon, C. N., Diener, E., Oishi, S., & Biswas- Diener, R. (2005). An experience sampling and cross-cultural investigation of the relation between pleasant and unpleasant affect. Cognition and Emotion, 19, 27-.52.

55.

Singelis, T. M. (1994). The measurement of independent and interdependent self-construals. Personality and Social Psychology Bulletin, 20(5), 580-591.

56.

Spencer-Rodgers, J., Peng, K., Wang, L., & Hou, Y. (2004). Dialectical self-esteem and East-West differences in psychological well-being. Personality and Social Psychology Bulletin, 30, 1416-1432.

57.

Thompson, B. (1994). Guidelines for authors. Educational and Psychological Measurement, 54, 837-847.

58.

Triandis, H. C. (1995). Individualism and collectivism. Boulder, CO: Westview Press.

59.

Triandis, H. C., Bontempo, R., Villareal, M. J., Asai, M., & Lucca, N. (1988). Individualism and collectivis: Cross-cultural perspectives on self- ingroup relationships. Journal of Personality and Social Psychology, 54(2), 323-338.

60.

Vacha-Haase, T. (1998). Reliability generalization: Exploring variance in measurement error affecting score reliability across studies. Educational and Psychological Measurement, 58, 6-20.

61.

Watson, D. (2004). Stability versus change, dependability versus error: Issues in the assessment of personality over time. Journal of Research in Personality, 38, 319-350.

62.

Yoon, K., Schmidt, F., & Ilies, R. (2002). Cross-cultural construct validity of the five-factor models of personality among Korean employees. Journal of Cross-Cultural Psychology, 33(3), 217- 235.

Korean Journal of Social and Personality Psychology