Analysis of evaluation of ontology quality

Krzysztof Goczyła, Aleksandra Karpus


This paper elaborates on what is the quality of the ontology, how to measure the quality of existing ontologies, and how to create high-quality ontologies. A review of existing ontology metrics that can be used to evaluate the quality of ontology is presented. The paper also discusses the problem of quality assurance and quality evaluation of modular ontologies as an important research problem in the face of the prevailing emergence of complicated, difficult to use and modify flat ontologies common in the Semantic Web.


ontology; metrics; quality; modularization

Full Text:

PDF (Polski)


Arpinar I. B., Giriloganathan K., Aleman-Meza B.: Ontology Quality by Detection of Conflicts in Metadata. Proc. of Fourth International EON Workshop: Evaluation of Ontologies for the Web, 2006.

Goczyła K., Waloszek A., Waloszek W., Zawadzka T.: Modularized Knowledge Bases Using Contexts, Conglomerates and a Query Language, [in:] Bembenik R., Skonieczny L., Rybiński H., Niezgódka M. (eds.): Intelligent Tools for Building a Scientific Information Platform, Seria: Studies in Computational Intelligence, Vol. 390, Springer, Berlin / Heidelberg 2012, s. 179÷201.

Goczyła K., Waloszek A., Waloszek W.: Contextualization of a DL Knowledge Base, [in:] Calvanese D. et al. (eds.): Proc. of the 20th International Workshop on Description Logics DL’07, Bozen-Bolzano University Press, 2007, s. 291÷298.

Gómez-Pérez A.: Ontology Evaluation, [in:] Staab S., Studer R. (eds.): Handbook on Ontologies, Springer-Verlag, 2004, s. 251÷273.

Guarino N., Welty C. A.: An Overview of OntoClean. [in:] Staab S., Studer R. (eds.): Handbook on Ontologies, Springer-Verlag, 2004, s. 151÷171.

Janowicz K., Kessler C., Schwarz M., Wilkes M., Panov I., Espeter M., Baeumer B.: Algorithm. Implementation and Application of the SIM-DL Similarity Server. Second International Conference on GeoSpatial Semantics (GeoS 2007), Lecture Notes in Computer Science, Vol. 4853, Springer, 2007, s. 128÷145.

Janowicz K., Maue P., Wilkes M., Schade S., Scherer F., Braun M., Dupke S., Kuhn W.: Similarity as a Quality Indicator in Ontology Engineering. Proc. of the Fifth International Conference FOIS, IOS Press, Vol. 183, 2008.

Kohler J., Munn K., Ruegg A., Skusa A., Smith B.: Quality control for terms and definitions in ontologies and taxonomies. BMC Bioinformatics, BioMed Central, Vol. 7, No. 212, 2006.

Tartir S., Arpinar I. B., Moore M., Sheth A. P., Aleman-Meza B.: OntoQA: Metric- Based Ontology Quality Analysis. IEEE Workshop on Knowledge Acquisition from Distributed, Autonomous, Semantically Heterogeneous Data and Knowledge Sources, 2005.

Verspoor K., Dvorkin D., Cohen K. B., Hunter L. E.: Term Analysis for Ontology Quality Assurance. Proc. Of the 11th International Protégé Conference, Amsterdam 2009.

Waloszek A.: Hierarchiczna kontekstualizacja baz wiedzy. Rozprawa doktorska, Gdańsk 2011