바로가기메뉴

본문 바로가기 주메뉴 바로가기

logo

Article Contents

Prev Next
e-Submission

Vol.26 No.1
Citation Share

A Study on Extracting News Contents from News Web Pages

Journal of the Korean Society for Information Management / Journal of the Korean Society for Information Management, (P)1013-0799; (E)2586-2073
2009, v.26 no.1, pp.305-320
https://doi.org/10.3743/KOSIM.2009.26.1.305

(2009). A Study on Extracting News Contents from News Web Pages. Journal of the Korean Society for Information Management, 26(1), 305-320, https://doi.org/10.3743/KOSIM.2009.26.1.305
  • Downloaded
  • Viewed
PDF Download

Abstract

The news pages provided through the web contain unnecessary information. This causes low performance and inefficiency of the news processing system. In this study, news content extraction methods, which are based on sentence identification and block-level tags news web pages, was suggested. To obtain optimal performance, combinations of these methods were applied. The results showed good performance when using an extraction method which applied the sentence identification and eliminated hyperlink text from web pages. Moreover, this method showed better results when combined with the extraction method which used block-level. Extraction methods, which used sentence identification, were effective for raising the extraction recall ratio.

keywords
웹 뉴스 기사 추출, 문장 기반 추출, 블록 기반 추출, 웹 마이닝, web news content extraction, sentence based extraction, block based extraction, web mining, web news content extraction, sentence based extraction, block based extraction, web mining

Reference

1.

정영미. (2005). 정보검색연구:구미무역 출판부.

2.

한광록. (2007). 웹 뉴스의 기사 추출과 요약. 한국컴퓨터정보학회논문지, 12(5), 1-10.

3.

Cadenhead,Tyrone. (2008). Improving web infor- mation indexing and retrieval based on center block duplication detection. Inter-national Journal of Innovative Com-puting and Applications, 1(3), 194-204.

4.

Debnath, Sandip. (2005). Automatic extraction of in- formative blocks from webpages (1722-1726). Pro-ceedings of the 2005 ACM Symposium on Applied Computing.

5.

Etzioni, Oren. (1996). The world wide web: Quagmire or gold mine. Communica-tions of the ACM, 39(11), 65-68.

6.

Gupta, S. (2003). DOM-based content extraction of HTML documents (249-256). Proceedings of the 12th International Conference on World Wide Web.

7.

Lin, Shian-Hua. (2002). Discovering informative content blocks from web documents (588-593). Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.

8.

Reis, Davi Castro. (2003). Automatic web news extraction using tree edit distance (502-511). Proceedings of the 13th International Conference on World Wide Web.

9.

Sebastiani, Fabrizio. (2002). Machine learning in automated text categorization. ACM Computing Surveys, 34(1), 1-47.

10.

Song, Ruihua. (2004). Learning block importance models for web pages (203-111). Proceedings of the 13th International Con- ference on World Wide Web.

11.

Vitali, Fabio. Rule-Based Structural Analysis of Web Pages.

12.

Yi, Lan. (2003). Eliminating noisy information in Web pages for data mining (296-305). Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and data Mining.

13.

Yu, Shipeng. (2003). Improving pseudorelevance feedback in web information retrieval using web page segmentation (11-18). Proceedings of the 12th International Conference on World Wide Web.

Journal of the Korean Society for Information Management

e-Submission OA Policy