바로가기메뉴

본문 바로가기 주메뉴 바로가기

logo

  • P-ISSN1013-0799
  • E-ISSN2586-2073
  • KCI

Article Contents

Prev Next
e-Submission

Vol.32 No.2

Citation Share

Extracting Evaluation Criteria for Evaluating Ontology Quality

Journal of the Korean Society for Information Management / Journal of the Korean Society for Information Management, (P)1013-0799; (E)2586-2073
2015, v.32 no.2, pp.193-219
https://doi.org/10.3743/KOSIM.2015.32.2.193


& (2015). Extracting Evaluation Criteria for Evaluating Ontology Quality. Journal of the Korean Society for Information Management, 32(2), 193-219, https://doi.org/10.3743/KOSIM.2015.32.2.193

Abstract

The focus of traditional evaluations of ontologies is largely performance-based. A comparison of a new ontology with well-established ones, testing of ontologies in different applications, as well as any judgment of an ontology’s appropriateness and relatedness to source data heavily rely on what results that ontology seems to manifest. This study, on the other hand, is an attempt to evaluate the quality of a particular ontology as manifested by its structure, representation, and interoperability. To that end, major categories of quality evaluations were first identified through an extensive survey of literature. Evaluation questions were formulated from these categories using the Delphi method and were validated by ontology experts. The entire process produced a set of 53 evaluation questions, which was then employed to test the quality of a newly-developed smartphone ontology.

keywords
온톨로지, 온톨로지 평가방법, 온톨로지 평가항목, 델파이 조사, ontology, ontology evaluation method, ontology evaluation items, delphi

Reference

1.

고영만. (2005). 온톨로지 기반 메타데이터 명명 규칙에 관한 연구. 정보관리학회지, 22(4), 97-109.

2.

김수경. (2007). 지능형 이미지 검색 시스템을 위한 추론 기반의 웹 온톨로지 구축. 정보관리학회지, 24(3), 119-147.

3.

김수경. (2008). 기술논리와 SWRL 기반의 웹 온톨로지 모델링. 정보관리학회지, 25(1), 149-171.

4.

김은경. (2004). 시맨틱웹을 위한 온톨로지 구축방법에 관한 비교연구.

5.

김정민. (2005). 텍스트 내용 지식 기반의 철학 온톨로지 구축. 정보과학회 컴퓨팅의 실제 논문지, 11(3), 275-283.

6.

노영희. (2011). A Study on Constructing the Ontology of LIS Journal. 정보관리학회지, 28(2), 177-193.

7.

박진수. (2008). 온톨로지 자동추출도구의 기능적 성능 평가를 위한 평가지표의 개발 및 적용. 지능정보연구, 14(4), 69-87.

8.

심재후. (2013). 창업학 지식구조 분석결과를 활용한창업 온톨로지 구축. Journal of Information Technology Applications & Management, 20(2), 161-176.

9.

유은지. (2012). 시맨틱 텍스트 마이닝을 위한 온톨로지 활용 방안. 정보시스템연구, 21(3), 137-161.

10.

이병길. (2013). 새마을운동 기록물의 개체기반 온톨로지 검색시스템 설계 및 평가. 한국기록관리학회지, 13(3), 67-97. http://dx.doi.org/10.14404/JKSARM.2013.13.3.067.

11.

이정연. (2007). 확률적 온톨로지와 연구자 네트워크를 이용한 심사자 자동 추천에 관한 연구. 정보관리학회지, 24(3), 43-65.

12.

이정희. (2007). 대학 전자기록물을 위한 온톨로지 기반 검색시스템 설계 및 구현. 정보관리학회지, 24(3), 343-362.

13.

이해윤. (2006). 동사 온톨로지 구축 방법론 - 한국어 이동동사. 언어와언어학, (38), 89-108.

14.

정태영. (2011). 傷寒論 온톨로지 구축 방법론 연구. 동의생리병리학회지, 25(5), 765-772.

15.

조나혜. (2013). 지리개념 이해를 위한 지오 온톨로지 구축: 해안지형을 사례로. 한국지도학회지, 13(3), 75-87.

16.

함영균. (2014). 프레임넷을 통한디비피디아 온톨로지 인스턴스 생성의 커버리지 개선 (-). 제 26회 한글 및 한국어 정보처리 학술대회 논문집.

17.

Brank, J.. (2006). Gold standard based ontology evaluation using instance assignment (-). The 4th International Workshop on Evaluation of Ontologies for the Web(EON) at the 15th International World Wide Web Conference.

18.

Brewster, C.. (2004). Data driven ontology evaluation (-). International Conference on Language Resources and Evaluation.

19.

Burton-Jones, A.. (2005). A semiotic metrics suite for assessing the quality of ontologies. Data &Knowledge Engineering, 55, 84-102.

20.

Cimiano, P.. (2006). Ontology learning and popuatioin from text: Algorithms, evaluation and application:Springer.

21.

Fernandez, M.. (1997). METHONTOLOGY: From ontological art towards ontological engineering (-). AAAI-97 Spring Symposium on Ontological Engineering, Stanford University.

22.

Gomez-Perez, A.. (1996). Towards a method to conceptualize domain ontologies (-). ECAI-96 Workshop on Ontological Engineering.

23.

Grüninger, M.. (1994). The design and evaluation of ontologies for enterprise engineering (-). Workshop on Implemented Ontologies, European Conference on Artificial Intelligence 1994.

24.

Grüninger, M.. (1995). Methodology for the design and evaluation of ontologies (-). IJCAI-95 Workshop on Basic Ontological Issues in Knowledge Sharing.

25.

Grüninger, M.. (1995). Benchmarking—Theory and Practice:Springer.

26.

Lozano-Tello, A.. (2004). Ontometric: A method to choose the appropriate ontology. Journal of Database Management, 2(15), 1-18.

27.

Maedche, A.. Measuring similarity between ontologies.

28.

Noy, N. F.. Ontology development 101: A guide to creating your first ontology. http://protege.stanford.edu/publications/ontology_development/ontology101-noy-mcguinness.html.

29.

Porzel, R.. (2004). A task-based approach for ontology evaluation (9-16). Proc. ECAI 2004 Workshop on Ontology Learning and Population.

30.

Prieto-Díaz, R.. (2003). A faceted approach to building ontologies (458-465). In Information Reuse and Integration, 2003. IRI 2003. IEEE International Conference on. IEEE.

31.

Ra, M.. (2012). The mixed ontology building methodology using database information (-). Proceedings of the International MultiConference of Engineers and Computer Scientists.

32.

Uschold, M.. (1996). Converting an informal ontology into ontolingua: Some experiences (-). ECAI-96 Workshop on Ontological Engineering.

33.

Uschold, M.. (1996). Building ontologies: Towards a unified methodology (-). Proc. Expert Systems 96.

34.

Uschold, M.. (1995). Towards a methodology for building ontologies (-). IJCAI-95 Workshop on Basic Ontological Issues in Knowledge Sharing.

Journal of the Korean Society for Information Management

e-Submission OA Policy