바로가기메뉴

본문 바로가기 주메뉴 바로가기

logo

Format and scale effects on leniency error and halo effect in 360° feedback

Abstract

The purpose of the present study was to investigate the effect of rating format(Likert, Behavioral description rating format) and scale type(balanced scale, positively unbalanced scale) on leniency error and halo effect in 360° feedback. The competency scale developed to appraise the job performance of employees in a large Korean company was administered to a sample of 440 raters who are composed of oneself, supervisor, subordinate, and peer. The raters of four groups rated the level of 133 ratees on thirty core competencies of the company through the 5-point scale. The results of 22 ANOVA and degree of skewness analysis indicated that positively unbalanced scale showed less leniency than the conventional measure of balanced scale, while there was no effect of rating format. Furthermore, the results of analyses of both standard deviation and correlation demonstrated that Behavioral description rating was more effective in reducing halo effect than Likert scale format. However, no scale effect was found since the two analyses of standard deviation and correlation produced inconsistent results. Finally, the limitations and future direction of the present study were discussed.

keywords
다면평가, 평가형식, 척도화 방법, 관대화 오류, 후광효과, 평가오류 측정, 360°feedback, rating format, scale type, leniency error, halo effect, measurement of rating errors

Reference

1.

김명소, (1992) 심리검사 제작의 이론과 실제:척도화 방법, 1992년 한국심리학회 학술대회 발표집

2.

김판석, (1999) 다면평가제 사례연구: 신화와 실상, 1999년도 하계학술대회

3.

문화일보, (2007) <사설>고위공무원단 실험 1년과 하나마나한 직무평가. 7월 28일자,

4.

이규만 ; 박경규, (2001) 부하의 체면중시가 상사-부하간 교환관계 및 조직행동에 미친 영향, 경영학 연구

5.

박영석, (2003) 리더십 다면평가에서 나타난 평가자 조망.한국심리학회지, 산업 및 조직

6.

양진환, (1999) 인사고과의 조작적 정의에 대한 평정정확성, 강남대학교 논문집

7.

이승계, (2005) 다면평가제도의 실효성에 관한 연구, 대한경영학회지

8.

이종구, (2001) SAS와 통계자료분석, 학지사

9.

임창희, (1999) 360도 다면평가, 21세기 북스

10.

장재윤, (1999) 연구개발 관리자에 대한 다면평가의 일치도 및 수행과의 관계, 산업 및 조직

11.

중앙인사위원회 (2003). 다면평가 운영관련 유의사항,

12.

한영석, (2007) 9개 리더십 역량이 성과평가에 미치는 영향, 007년 한국 산업 및 조직 심리학회 추계학술대회 및 심포지움 발표집

13.

Bernardin, H. J., (1984) Performance appraisal: Assessing human behavior at work, Kent

14.

Bernardin, H. J., (1977) Effect of rater training and diary-keeping on psychometric error in rating, Journal of Applied Psychology

15.

Bernardin, H. J., (1976) A recomparison of behavioral expectation scales to summated scales, Journal of Applied Psychology

16.

Bernardin, H. J., (1976) Behavioral expectation scales: Effects of development procedures and format, Journal of Applied Psychology

17.

Bretz, Jr., R. D., (1992) The current state of performance appraisal research and practice: Concerns , directions and implications, Journal of Management

18.

Campbell, J. D., (1990) Self-esteem and perceptions of conveyed impression: Is negative affectivity associated with greater realism, Journal of Personality and Social Psychology

19.

Chruch, A. H, (1995) First-rate multi-rater feedback, Training and Development

20.

Cooper,W.H, (1981) Ubiquitous halo.Psychological, Psychological Bulletin

21.

Decotiis, T. A, (1977) An analysis of the external validity and applied relevance of three rating formats, Organizational Behavior and Human Performance

22.

Dickinson, T. L., (1977) The discriminant validity of scales developed by retranslation, Personnel Psychology

23.

Feldman,J.M, (1981) Beyond attribution theory: Cognitive processes in performance appraisal, Journal of Applied Psychology

24.

Finley, D. M., (1977) Behaviorally based rating scales: Effects of specific anchors and disguised scale continua, Personnel Psychology

25.

Firedman, B. A., (1976) Effect of rater participation in scale construction on the psychometric characteristics of two rating scale format, Journal of Applied Psychology

26.

Friedman. H. H., (1981) Label versus position in rating scales, Journal of the Academy of Marketing Science

27.

Fisicaro, S. A, (1988) A re-examination of the relation between halo error and accuracy, Journal of Applied Psychology

28.

Fox, S., (1994) Variables affecting leniency, halo and validity of self-appraisal, Journal of Occupational and Organizational Psychology

29.

Friedman, H. H., (1999) Rating the rating scales, The Journal of Marketing Management

30.

Harris, M. M, (1994) Rater motivation in the performance appraisal context: A theoretical framework, Journal of Management

31.

Harris,M.M., (1988) A meta-analysis of self-supervisor, self-peer and peer-supervisor ratings, Personnel Psychology

32.

Jeffrey, S. K., (1995) Stability of Rater Leniency: Three Studies, The Academy of Management Journal

33.

Jones, L., (2002) Self-assessment in a selection situation: An evaluation of different measurement approaches, Journal of Occupational and Organizational Psychology

34.

Kasten, R., (1999) Rating errors and rating accuracy: A field experiment, Human Performance

35.

Keaveny, T. J., (1975) A comparison of behavioral expectation scales and graphic rating scales, Journal of Applied Psychology

36.

Landy. F. J., (1976) Behaviorally anchored scales for rating the performance of police officers, Journal of Applied Psychology

37.

Latham,G.P., (1981) Increasing productivity through performance appraisal, Addison-Wesley Company

38.

Levy, P. E., (1998) Reactions to appraisal discrepancies: Performance ratings and attributions, Journal of Business and Psychology

39.

Longenecker,C.O., (1987) Behind the mask:The politics of employee appraisal.Academy of Management, Academy of Management Executive

40.

Mount, M. K, (1984) Psychometric properties of subordinate ratings of managerial performance, Personnel Psychology

41.

Mikovich,G.T.,&?Boudreau.J.W, (1994) Human Resource Management(7th ed.), Irwin.

42.

Motowidlo, S. J., (1977) Behaviorally anchored scales for measuring morale in military units, Journal of Applied Psychology

43.

Murphy, K. R., (1989) Rater errors and rating accuracy, Journal of Applied Psychology

44.

Ronen, K, (1999) Rating errors and rating accuracy: A field experiment, Human Performance

45.

Saal, F. E., (1980) Rating the ratings: Assessing the quality of rating data, Psychological Bulletin

46.

Schwab, D. P., (1975) Behaviorally anchored rating scales: A review of the literature, Personnel Psychology

47.

Steele, R. P, (1984) Self-appraisal based upon supervisory feedback, Personnel Psychology

48.

Thornton, III, G. C, (1980) Psychometric properties of self-appraisal and job performance, Personnel Psychology

49.

Viswesvaran, C., (1996) Comparative analysis of the reliability of job performance ratings, Journal of Applied Psychology

50.

Wayne, S. J., (1990) Journal of Applied Psychology, Psychology

51.

Wildt, A. R., (1978) Determinants of scale response: Label versus position, Journal of Marketing Research

logo