바로가기메뉴

본문 바로가기 주메뉴 바로가기

logo

The Effect of Rater Training Type on Rating Accuracy: Focusing on Interaction Effect of Accountability and Rater Mood

Abstract

The purpose of this study was to compare the effects of two types of rater training on rating accuracy in performance appraisal context. It also investigated whether accountability and rater mood interact with the effects. Specifically, the study examined the effects of frame-of-reference training (FOR) and rater variability training (RVT) in terms of elevation (EL), differential elevation (DE), stereotype accuracy (SA), and DA (differential accuracy), which are conceptualized by Cronbach (1955). The study also studied 2-way interactions, comparing the differences of accuracy according to the conditions whether accountability is required or not, and positive or negative mood is imposed. In addition, it tested a 3-way interaction effect among the three conditions. The study conducted an experiment with 2 x 2 x 2 design in which 146 undergraduate students were assigned for lecture evaluation. The results revealed that accuracy in DE was improved more in RVT than FOR, while the other types of accuracy were not significantly different. The effects of accountability and mood were not found significant, either. The interaction effect of accountability and rater mood was significant in EL in the way that the accountability-required group rated more accurately when it was in positive mood whereas the accountability-not-required group was more accurate in negative mood. The other interaction effects were not significant, neither was the 3-way interaction. Theoretical and practical implications including limitations were discussed in performance appraisal context.

keywords
인사평가, 참조틀 훈련, 변산성 훈련, 책임성, 평가자 기분, Cronbach의 평가 정확성 요소, Performance Appraisal, Frame-of-Reference Training, Rater Variability Training, Accountability, Rater Mood, Cronbach's Accuracy Components

Reference

1.

이주일, (1999) 조직 장면에서 체험된 정서와 표현된 정서간 불일치의 효과: 경쟁가설의 검증, 산업 및 조직

2.

한국경제, (2007) 인사고과 시즌, 흔히 볼 수 있는 평가자 유형 1위 ‘내 사람 챙기기형’. 8월 23일자,

3.

한태영, (2005) 청소년의 정서관련 변인과 학업 스트레스의 관계: 체험정서, 표현정서, 및 정서지능의 영향, 학교

4.

Bernardin, H. J., (1980) Effects of rater training: New response sets and decreasing accuracy, Journal of Applied Psychology

5.

Bernardin, H. J., (1981) Strategies in rater training, Academy of Management Review

6.

Bless, H., (1990) Mood and persuasion: A cognitive response analysis, Personality and Social Psychology Bulletin

7.

Bodenhausen, G. V., (1994) Happiness and stereotypic thinking in social judgment, Journal of Personality and Social Psychology

8.

Cardy, R. L., (1994) Performance Appraisal: Alternate Perspectives, South-Western Publishing.

9.

Carroll, S. J., (1982) Performance appraisals and revel systems: The identification. measurement. and development of performance in organizations, Scott. Foresman.

10.

Cronbach, L. J., (1955) Processes affecting scores on “understanding of others” and “assumed similarity, Psychology Bulletin

11.

DeNisi,A., (1996) Implications for theory and practice, In Cognitive approach to performance appraisal, NY

12.

Feldman, J. M., (1981) Beyond attribution theory: a perceptual -cognitive viewpoint. In Personal and Human Resource Management, 4, JAI Press.

13.

Ferris, G. R., (1991) Personnel /human resources management: A political influence perspective, Journal of Management

14.

Forgas, J. P., (1987) Mood Effects on Person -Perceptron Judgments, Journal of Personality and Social Psychology

15.

Harris, M. M., (1994) Rater motivation in the performance appraisal context: A theoretical framework, Journal of Management

16.

Hauenstein,N.M.A., (1998) Training raters to increase the accuracy of appraisals and the usefulness of feedback. In Performance Appraisal , Jossey Bass San Francisco

17.

Hauenstein, N. M. A., (1992) An information -processing approach to leniency in performance judgments, Journal of Applied Psychology

18.

Hauenstein, N. M. A., (1999) Rater variability training: An alternative procedure to rater error training and frame-of-reference training. Unpublished Manuscript, Virginia Polytechnic Institute and State University, Blacksburg

19.

Izard, C. E., (1991) Psychology of emotions, Plenum

20.

Kemter, v., (2007) Frame-of-reference training: Evaluation of rating accuracy within a double-pretest-one- posttest-design, LASER Discussion Papers-paper

21.

Landy, F. J., (1980) Performance rating, Psychological Bulletin

22.

Latham, G. P., (1986) Job performance and appraisal In International Review of Industrial and Organizational Psychology,, Wiley

23.

Lazarus,R.S., (1991) Emotion and Adaptation, Oxford University Press.

24.

Lerkowitz, J., (2000) The role of interpersonal affective regard in supervisory performance ratings: A literature review and proposed causal model, Journal of Occupational & Organizational psychology

25.

McAllister, D. W., (1979) The contingency model for the selection of decision strategies: An empirical test of the effects of significance, accountability, and reversibility, Organizational Behavior and Human Performance

26.

Mero, N. P., (2007) Accountability in a Performance Appraisal Context: The Effect of Audience and Form of Accounting on Rater Response and Behavior, Journal of Management

27.

Murphy, K. R., (1995) Understanding performance appraisal: Social, organization, and goal-based perspectives, Sage publications.

28.

Murphy, K. R., (1986) Rater errors and rating accuracy, Journal of Applied Psychology

29.

Palmer. J. K., (2005) Accountability and Need for Cognition Effects on Contrast, Halo, and Accuracy in Performance Ratings, The Journal of Psychology: Interdisciplinary and Applied

30.

Pulakos, E. D., (1984) A comparison of training programs: Error training and accuracy training, Journal of Applied Psychology

31.

Robbins, T. L., (1998) Mood VS.Interpersonal Affect: Identifying Process and Rating Distortions in Performance Appraisal, Journal of Business and Psychology

32.

Schlenker, B. R., (1985) The self and social life, McGraw-Hill

33.

Schwarz, N., (1983) Mood, misattribution, and judgments of wellbeing: Informative and directive functions of affective states, Journal of Personality and Social Psychology

34.

Schwarz, N., (1988) How do I feel about it? The informative function of affective states. In Affect, cognition, and social behavior, Hogrefe.

35.

Schwarz, N., (2002) Feelings as information: Moods influence judgments and processing strategies. In Heuristics and biases: The psychology of intuitive judgment , Cambridge University Press.

36.

Sinclair, A. L., (2000) Differentiating Rater Accuracy Training Programs. Thesis?submitted to the Faculty of the Virginia Polytechnic Institute and State University in partial fulfillment of the requirement for the degree of Master of Science in Industrial, Organizational Psychology

37.

Sinclair, R. C., (1998) Mood, categorization breadth. and performance appraisal: The effects of information acquisition and acquisition and affective state on halo, accuracy, information retrieval, and evaluations, Organizational Behavior and Human Decision Processes

38.

Srull, T. K., (1989) Person memory and judgment, Psychological Review

39.

Stamoulis. D. T., (1993) Rater Training and Ratting Accuracy: Training for Dimensional Accuracy Versus Training for Ratee Differentiation, Journal of Applied Psychology

40.

Sulsky, L. M., (1992) Frame -of-reference training and cognitive?categories: Am empirical investigation of rater memory issue, Journal of Applied Psychology

41.

Woehr, D. J., (1994) Rater Training for Performance Appraisal: A Quantitative Review, Journal of Occupational and Organizational Psychology

logo