- P-ISSN1013-0799
- E-ISSN2586-2073
- KCI
용어 가중치부여 기법을 이용한 로치오 분류기의 성능 향상에 관한 연구
A Study on the Performance Improvement of Rocchio Classifier with Term Weighting Methods
초록
로치오 알고리즘에 기반한 자동분류의 성능 향상을 위하여 두 개의 실험집단(LISA, Reuters-21578)을 대상으로 여러 가중치부여 기법들을 검토하였다. 먼저, 가중치 산출에 사용되는 요소를 크게 문헌요소(document factor), 문헌집합 요소(document set factor), 범주 요소(category factor)의 세 가지로 구분하여 각 요소별 단일 가중치부여 기법의 분류 성능을 살펴보았고, 다음으로 이들 가중치 요소들 간의 조합 가중치부여 기법에 따른 성능을 알아보았다. 그 결과, 각 요소별로는 범주 요소가 가장 좋은 성능을 보였고, 그 다음이 문헌집합 요소, 그리고 문헌 요소가 가장 낮은 성능을 나타냈다. 가중치 요소 간의 조합에서는 일반적으로 사용되는 문헌 요소와 문헌집합 요소의 조합 가중치(tfidf or ltfidf)와 함께 문헌 요소를 포함하는 조합(tf*cat or ltf*cat) 보다는, 오히려 문헌 요소를 배제하고 문헌 집합 요소를 범주 요소와 결합한 조합 가중치 기법(idf*cat)이 가장 좋은 성능을 보였다. 그러나 실험집단 측면에서 단일 가중치와 조합 가중치를 서로 비교한 결과에 따르면, LISA에서 범주 요소만을 사용한 단일 가중치(cat only)가 가장 좋은 성능을 보인 반면, Reuters-21578에서는 문헌집합 요소와 범주 요소간의 조합 가중치(idf*cat)의 성능이 가장 우수한 것으로 나타났다. 따라서 가중치부여 기법에 대한 실제 적용에서는, 분류 대상이 되는 문헌집단 내 범주들의 특성을 신중하게 고려할 필요가 있다.
- keywords
- weighting, Rocchio algorithm, classifier, automatic classification, text categorization, feature selection principles, 가중치, 가중치부여 기법, 로치오 알고리즘, 문헌분류, 텍스트 범주화, 분류기
Abstract
This study examines various weighting methods for improving the performance of automatic classification based on Rocchio algorithm on two collections(LISA, Reuters-21578). First, three factors for weighting are identified as document factor, document factor, category factor for each weighting schemes, the performance of each was investigated. Second, the performance of combined weighting methods between the single schemes were examined. As a result, for the single schemes based on each factor, category-factor-based schemes showed the best performance, document set-factor-based schemes the second, and document-factor-based schemes the worst. For the combined weighting schemes, the schemes(idf*cat) which combine document set factor with category factor show better performance than the combined schemes(tf*cat or ltf*cat) which combine document factor with category factor as well as the common schemes(tfidf or ltfidf) that combining document factor with document set factor. However, according to the results of comparing the single weighting schemes with combined weighting schemes in the view of the collections, while category-factor-based schemes(cat only) perform best on LISA, the combined schemes(idf*cat) which combine document set factor with category factor showed best performance on the Reuters-21578. Therefore for the practical application of the weighting methods, it needs careful consideration of the categories in a collection for automatic classification.
- keywords
- weighting, Rocchio algorithm, classifier, automatic classification, text categorization, feature selection principles, 가중치, 가중치부여 기법, 로치오 알고리즘, 문헌분류, 텍스트 범주화, 분류기
참고문헌
김판준. (2007). 로치오 알고리즘을 이용한 자동분류에서 용어 가중치 기법. 문헌정보학논집, (9), 157-185.
김판준. (2006). 기계학습을 통한 디스크립터 자동부여에 관한 연구. 정보관리학회지, 23(1), 279-299.
김판준. (2006). 로치오 알고리즘을 이용한 학술지 논문의 디스크립터 자동부여에 관한 연구. 정보관리학회지, 23(3), 69-90.
이재윤. (2005). 자질 선정 기준과 가중치 할당 방식간의 관계를 고려한 문서 자동분류의 개선에 대한 연구. 한국문헌정보학회지, 39(2), 123-146.
이재윤. (2000). 문헌 자동분류에서 용어가중치 기법에 대한 연구 (41-44). 제7회 한국정보관리학회 학술대회 논문집. 이화여자대학교.
정영미. (1993). 정보검색론:구미무역(주) 출판부.
Brank, J.. (2007). Interaction of feature selection methods and linear classification models (-). Proceedings of the ICML-02 Workshop on Text Learning, Sydney.
Castillo M. D.. (2004). A multistrategy approach for digital text categorization from imbalanced docu- ments. ACM SIGKDD Explorations Newsletter: Special Issue on Leaning from Imbalanced Datasets, 6(1), 70-79.
Debole, Franca. (2003). Super- vised term weighting for automated text categorization (784-788). Proceedings of SAC-03, 18th ACM Symposium on Applied Computing. ACM.
Deng, Zhi-Hong. (2004). A Comparative study on feature weight in text catego- rization (588-597). In Proceedings of The Sixth Asia Pacific Web Conference(APWEB 2004).
Forman G.. (2003). An extensive empirical study of feature selection metrics for text classification. The Journal of Machine Learning Research, 3, 1289-1305.
Geng, L.. (2006). Choosing the right lens: finding what is interesting in data mining in: Quality Measures in Data Mining.
How, Bong Chih. (2004). An empirical study of feature selection for text categorization based on term weightage (592-602). In Proceedings of the 2004 IEEE/WIC/ACM International Con- ference on Web Intelligence.
Joachims, Thorsten. (1996). A probabilistic analysis of the rocchio algorithm with TFIDF for text categorization (143-151). Pro- ceedings of ICML-97, 14th International Conference on Machine Learning.
Joachims, Thorsten. (1998). Text categorization with support vector machines: learning with many relevant features (137-142). Pro- ceedings of the 10th European Con- ference on Machine Learning.
Lan, Man. (2007). Proposing a new term weighting scheme for text categori- zation (-). In 21st National Conference on Artificial Intelligence.
Liu, Ying. (2007). Han- dling of imbalanced data in text classification: category-based term weights (171-192). Natural Language Pro- cessing and Text Mining.
Papineni, K.. (2001). Why inverse document frequency? (25-32). Proceedings of the North American Association for Computational Linguistics. NAACI.
Prabowo, Ruby. (2006). A comparison of feature selection met- hods for an evloving RSS feed corpus. Information Processing and Manage- ment, 42, 1491-1512.
Robertson S.. (2004). Understanding inverse document frequency: on theoretical arguments for IDF. Journal of Docu- mentation, 60(5), 503-520.
Robertson, S. E.. (1976). Relevance weighting of search terms. JASIS, 27(3), 129-146.
Rogati, M.. (2007). High-Performing Feature Selection for Text Classification (-). Proceedings of the eleventh inter- national conference on Information and knowledge management, CIKM '02.
Rogati, M.. (2007). High-Performing Feature Selection for Text Classification (-). Proceedings of the eleventh inter- national conference on Information and knowledge management, CIKM '02.
Salton, G.. (1981). The Measurement of term importance in automatic indexing. JASIS, 32(3), 175-186.
Salton, G.. (1983). Introduc- tion to Modern Information Retrieval:McGraw-Hill.
Sebastiani, Fabrizio. (2002). Machine learning in automated text categorization. ACM Computing Surveys, 34(1), 1-47.
Soucy P.. (2007). Beyond TFIDF weighting for text categori- zation in the vector space model (1130-1135). IJCAI-05 proceedings.
Yang, Y.. (1999). A re-examination of text categorization methods:Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval.
Yang, Y.. (1999). Evaluation of statistical approaches to text categorization. Information Retrieval, 1, 69-90.
Yang, Y.. (1997). A com- parative Study on Feature Selection in Text Categorization (412-420). Proceedings of ICML-97, 14th International Con- ference on Machine Learning.
Yu, C. T.. (1976). Precision weighting-an effective automatic in- dexing method. Journal of Association for Computing Machinery, 23(1), 76-88.
Yu, C. T.. (1982). Term weighting in information re- trieval using the term precision model. Journal of Association for Computing Machinery, 29(1), 152-170.
Zheng Z.. (2004). Feature selection for text categori- zation on imbalanced data. ACM SIGKDD Explorations Newsletter: Special Issue on Leaning from Imba- lanced Datasets, 6(1), 80-89.
- 다운로드 수
- 조회수
- 0KCI 피인용수
- 0WOS 피인용수