International Journal of Information Engineering and Electronic Business(IJIEEB)

ISSN: 2074-9023 (Print), ISSN: 2074-9031 (Online)

Published By: MECS Press

IJIEEB Vol.12, No.2, Apr. 2020

A Review on Ontology Development Methodologies for Developing Ontological Knowledge Representation Systems for various Domains

Full Text (PDF, 466KB), PP.28-39

Views:2   Downloads:0


Enesi Femi Aminu, Ishaq Oyebisi Oyefolahan, Muhammad Bashir Abdullahi, Muhammadu Tajudeen Salaudeen

Index Terms

Ontology;domain;methodology;intelligent system;semantic web


The success of machine represented web known as semantic web largely hinges on ontologies. Ontology is a data modeling technique for structured data repository premised on collection of concepts with their semantic relationships and constraints on domain. There are existing methodologies to aid ontology development process. However, there is no single correct ontology design methodology. Therefore, this paper aims to present a review on existing ontology development approaches for different domains with the goal of identifying individual methodology’s weakness and suggests for hybridization in order to strengthen ontology development in terms of its content and constructions correctness. The analysis and comparison of the review were carried out by considering these criteria but not limited to: activities of each method, the initial domain of the methodology, ontology created from scratch or reuse, frequently used ontology management tools based on literature, subject granularity, and usage across different platforms.  This review based on the literature showed some approaches that exhibit the required principles of ontology engineering in tandem with software development principles. Nonetheless, the review still noted some gaps among the methodologies that when bridged or hybridized a better correctness of ontology development would be achieved in building intelligent system. 

Cite This Paper

Enesi Femi Aminu, Ishaq Oyebisi Oyefolahan, Muhammad Bashir Abdullahi, Muhammadu Tajudeen Salaudeen, " A Review on Ontology Development Methodologies for Developing Ontological Knowledge Representation Systems for various Domains", International Journal of Information Engineering and Electronic Business(IJIEEB), Vol.12, No.2, pp. 28-39, 2020. DOI: 10.5815/ijieeb.2020.02.05


[1]Hitzler, P., & Janowicz, K. (2013). Linked Data, Big Data, and the 4th Paradigm. Semantic Web, 4(3), 233-235

[2]Grigoris, A. & Frank-van, H. (2008). A Semantic Web Primer. The MIT Press Cambridge, Massachusetts London, England.

[3]Ashraf, J., Chang, E., Hussain, O. K., & Hussain, F. K. (2015). Ontology usage analysis in the ontology lifecycle: A state-of-the-art review. Knowledge-Based Systems, 80, 34-47.

[4]Noh, Y. (2015). Imagining library 4.0: creating a model for future libraries. The Journal of Academic Librarianship, 41(6), 786-797

[5]Pan, Y. (2016). Heading toward artificial intelligence 2.0. Engineering, 2(4), 409-413.

[6]Wang, W., De, S., Cassar, G., & Moessner, K. (2013). Knowledge representation in the internet of things: semantic modelling and its applications. automatika, 54(4), 388-400.

[7]Ramos, L. (2015). Semantic Web for manufacturing, trends and open issues: Toward a state of the art. Computers & Industrial Engineering, 90, 444-460

[8]Pattuelli, M. C., Provo, A., & Thorsen, H. (2015). Ontology building for linked open data: A  pragmatic perspective. Journal of Library Metadata, 15(3-4), 265-294

[9]Sanfilippo, E. M., & Borgo, S. (2016). What are features? An ontology-based review of the literature. Computer-Aided Design, 80, 9-18.

[10]Thomas C. J. (2009) ‘Just what is an ontology, anyway?’ IT Professional, 11, 22-27.

[11]Wei Y., Wang, R. Hu, Y. & Wang, X. (2012). From Web Resources to Agricultural Ontology: a Method for Semi-Automatic Construction’Journalof Integrative Agriculture, 11(5): 775-783

[12]Meriyem, C., Adil, S., & Hicham, M. (2015). IT Governance ontology building process:example of developing audit ontology. International Journal of Computer Techniques, 2(1), 134-141.

[13]Ivanović, M., & Budimac, Z. (2014). An overview of ontologies and data resources in medical domains. Expert Systems with Applications, 41(11), 5158-5166

[14]Barão, A., de Vasconcelos, J. B., Rocha, Á., & Pereira, R. (2017). A knowledge management approach to capture organizational learning networks. International Journal of  Information Management, 37(6), 735-740.

[15]Gruber, T. R. (1993). A Translation Approach to Portable Ontology Specifications. Knowledge Acquisition, 5(2): 199-220

[16]Dou, D., Wang, H., & Liu, H. (2015, February). Semantic data mining: A survey of ontology-based approaches. In Semantic Computing (ICSC), 2015 IEEE International Conferenc on (pp. 244-251). IEEE

[17]Kang, Y. B., Haghighi, P. D., & Burstein, F. (2014). CFinder: An intelligent key concept finder from text for ontology development. Expert Systems with Applications, 41(9), 4494-4504

[18]Uschold, M., & King, M. (1995). Towards a Methodology for Building Ontologies. In IJCAI95 Workshop on Basic Ontological Issues in Knowledge Sharing. Montreal

[19]Dnyanesh, R. & Rahul, C. A (2011). Generic ontology development framework for data integration and decision support in a distributed environment.  International Journal of Computer Integrated Manufacturing Vol. 24, No. 2, 154–170

[20]Pratibha, G., Sangeeta, D. & Bhanumurthy, K. (2011). Ontology Development Methods. DESIDOC Journal of Library & Information Technology, Vol. 31, No. 2, pp. 77-83

[21]Agyapong-Kodua, K., Niels, L., Robert, D., & Svetan, R. (2013) ‘Review of semantic modeling technologies in support of virtual factory design’ International Journal of Production Research, Vol. 51, No. 14, 4388–4404

[22]Noy, N. F. and McGuinness, D. L. (2001) ‘Ontology Development 101: A guide to Creating Your First Ontology’, Stanford University, Stanford, CA, USA, pp. 1-25.

[23]Noy, N. F., & McGuinness, D. L. (2016). Ontology development 101: a guide to creating your first ontology Stanford University.

[24]Alexander, C. Y. (2006). Methods in biomedical ontology. Journal of biomedical informatics, 39(3), 252-266

[25]Anusha, I. W., Athula G., & Gihan, N. W. (2015) ‘User centered ontology for SriLanka farmers’ Ecological Informatics, 140-150

[26]Bhaskar, K. & Savita S. (2010) ‘A Comparative Study Ontology Building Tools for Semantic Web Applications’ International journal of Web & Semantic Technology   (IJWesT) Vol.1, Num.3, July 2010 DOI : 10.5121/ijwest.2010.1301 1

[27]Ast, M., Glas, M., Roehm, T., & Luftfahrt, V. B. (2014). Creating an ontology for aircraft design. Deutsche Gesellschaft für Luft-und Raumfahrt-Lilienthal-Oberth eV

[28]Munir, K., & Anjum, M. S. (2018). The use of ontologies for effective knowledge Modeling and information retrieval. Applied Computing and Informatics, 14(2), 116-126

[29]Bechhofer, S. (2009) "OWL: Web ontology language." Encyclopedia of database systems. Springer, Boston, MA, 2009. 2008-2009

[30]Richard F., Patrick H., & Ian H. (2004). OWL-QL—a language for deductive query answering on the Semantic Web. Web Semantics: Science, Services and Agents on the World Wide Web 2  19–29

[31]Cardoso, J., & Pinto, A. M. (2015). The Web Ontology Language (OWL) and its Applications. In Encyclopedia of Information Science and Technology, Third Edition (pp.   7662-7673). IGI Global

[32]Sengupta, K., & Hitzler, P. (2014). Web ontology language (OWL). Encyclopedia of Social Network Analysis and Mining, 2374-2378.

[33]Arenas, M., Grau, B. C., Kharlamov, E., Marciuška, Š., & Zheleznyakov, D. (2016). Faceted search over RDF-based knowledge graphs. Journal of Web Semantics, 37, 55-74

[34]Calbimonte, J. P., Mora, J., & Corcho, O. (2016, May). Query rewriting in RDF stream processing. In European Semantic Web Conference (pp. 486-502). Springer, Cham

[35]Jeen B., Michel K., Stefan D., Dieter F., Frankvan H., & Ian H. (2002). Enabling knowledge representation on the Web by extending RDF Schema. Computer Networks 39  609–634

[36]Khan, J. A., & Kumar, S. (2014, October). Deep analysis for development of RDF, RDFS and OWL ontologies with protege. In Proceedings of 3rd International Conference on Reliability, Infocom Technologies and Optimization (pp. 1-6). IEEE

[37]Schenner, G., Bischof, S., Polleres, A., & Steyskal, S. (2014, September). Integrating Distributed Configurations With RDFS and SPARQL. In Configuration Workshop (Vol.1220, pp. 9-15)

[38]Rodríguez, N. D., Cuéllar, M. P., Lilius, J., & Calvo-Flores, M. D. (2014). A survey on ontologies for human behavior recognition. ACM Computing Surveys (CSUR), 46(4), 43

[39]Slimani, T. (2015). Ontology development: A comparing study on tools, languages and formalisms. Indian Journal of Science and Technology, 8(24), 1-12

[40]Enesi, F. A. & Adewale, O. S. (2015) ‘A Mechanism for Detecting Dead URLs in XTM-Based Ontology Repository’ International Journal of Computer Applications (0975 – 8887) Volume 111 – No 12

[41]Carroll, J., Herman, I., & Patel-Schneider, P. F. (2015). OWL 2 web ontology language RDF-based semantics. W3C Recommendation (October 27, 2009)

[42]Hacherouf, M., Bahloul, S. N., & Cruz, C. (2015). Transforming XML documents to OWL ontologies: A survey. Journal of Information Science, 41(2), 242-259

[43]John, H. G., Mark, A. M., Ray, W. F., Williams, E. G., Monica, C., Henrik, E., Natalya, F. N. & Samson W. T. (2003). The evolution of Protégé: an environment for knowledge-based systems development. International Journal of Human-Computer Studies, Vol. 58, Issue1, Pages 89 – 123

[44]Chujai, P., Kerdprasop, N., & Kerdprasop, K. (2014). On transforming the ER model to ontology using protégé OWL tool. International Journal of Computer Theory and  Engineering, 6(6), 484

[45]Wohlgenannt, G., Sabou, M., & Hanika, F. (2016). Crowd-based ontology engineering with the uComp Protégé plugin. Semantic Web, 7(4), 379-398

[46]Yadav, U., Narula, G. S., Duhan, N., Jain, V., & Murthy, B. K. (2016). Development and visualization of domain specific ontology using protege. Indian Journal of Science and Technology, 9(16), 1-7

[47]Panita, Y., Dussadee, T., Thanapat, S., Asanee, K., Sachit, R., Margherita, S., & Johannes K. (2008). The AGROVOC Concept Server Workbench: A Collaborative Tool for Managing Multilingual Knowledge. World Conference on Agricultural Information and IT

[48]Stellato, A., Turbati, A., Fiorelli, M., Lorenzetti, T., Costetchi, E., Laaboudi, C., & Keizer, J. (2017, September). Towards VocBench 3: pushing collaborative development of thesauri and ontologies further beyond. In  17th European Networked Knowledge Organization Systems Workshop, NKOS 2017 (Vol. 1937, pp. 39-52). CEUR-WS

[49]John D., Midori A. H., Melissa Haendel & Suzanna L. (2007). OBO-Edit—an ontology editor for biologists.  Bioinformatics, Volume 23, Issue 16, 15, Pages 2198–2200

[50]Mungall, C. J., Dietze, H., & Osumi-Sutherland, D. (2014). Use of OWL within the Gene Ontology. BioRxiv, 010090

[51]Aditya, K., Bijan, P., Evren, S., Bernardo, C. C. & James, H. (2006) ‘Swoop: A Web Ontology Editing Browser’ Web Semantics: Science, Services and Agents on the World Wide Web Vol. Issue 2, 144–153

[52]Khan, Z. C., & Keet, C. M. (2015). An empirically-based framework for ontology modularisation. Applied Ontology, 10(3-4), 171-195

[53]Emhimed A. (2013). Comparison Some of Ontology Editors. Management Information Systems, Vol. 8, No. 2, pp. 018-024

[54]Hogan, W. R., Wagner, M. M., Brochhausen, M., Levander, J., Brown, S. T., Millett, N., & Hanna, J. (2016). The Apollo Structured Vocabulary: an OWL2 ontology of Phenomena in infectious disease epidemiology and population biology for use in epidemic simulation. Journal of biomedical semantics, 7(1), 50.

[55]Mutton, P & Golbeck, J. (2003). Visualization of semantic metadata and ontologies. Information Visualization, 2003. IV 2003. Proceedings. Seventh International Conference on. IEEE, 2003

[56]Anikin, A., Litovkin, D., Kultsova, M., Sarkisova, E., & Petrova, T. (2017, September). Ontology visualization: Approaches and software tools for visual representation of large ontologies in learning. In Conference on Creativity in Intelligent Technologies and Data Science (pp. 133-149). Springer, Cham

[57]Alatrish, E. S. (2013) "Comparison some of ontology." Journal of Management Information Systems 8.2 (2013): 018-024

[58]García-Peñalvo, F. J., Ordónez de Pablos, P., García, J., & Therón, R. (2014). Using OWL-VisMod through a decision-making process for reusing OWL ontologies. Behaviour & Information Technology, 33(5), 426-442.

[59]Jianwei, L., Li, L. & Xiaoyan, L. (2015) ‘An Integrated, Ontology-Based Agricultural Information System’ Information Development, Vol. 31(2) 150–163

[60]Corcho, O., Fernández-López, M., & Gómez-Pérez, A. (2003). Methodologies, tools and languages for building ontologies. Where is their meeting point?. Data & knowledge engineering, 46(1), 41-64.

[61]Nanda, J., Simpson, T. W., Kumara, S. R., & Shooter, S. B. (2006). A methodology for product family ontology development using formal concept analysis and web ontology language. Journal of computing and information science in engineering, 6(2), 103-113.

[62]Gavrilova, T. & Gladkova, M. (2014). Big data structuring: the role of visual models and ontologies. Procedia Computer Science 31, 336 – 343

[63]Vigo, M., Bail, S., Jay, C., & Stevens, R. (2014). Overcoming the pitfalls of ontology authoring: Strategies and implications for tool design. International Journal of Human-Computer Studies, 72(12), 835-845.

[64]Lenat, D. B., & Guha, R. V. (1990). Building Large Knowledge-based Systems: Representation and Inference in the Cyc Project.  Boston, MA: Addison-Wesley.

[65]Dean, J., Trevor, B. C. & Pepijn V. (1998). Methodologies for Ontology Development. 62-75

[66]Fernandez-Lopez, M. Gomez-Perez, A., Pazos-Sierra, A., & Pazos-Sierra, J. (1999) Building a chemical ontology using METHONTOLOGY and the ontology design    environment’, IEEE Intelligent Systems & their applications 4 (1) 37–46

[67]Oscar C., Mariano F., and Asuncion G. (2003) ‘Methodologies, tools and languages for building ontologies. Where is their meeting point?’ Data & Knowledge Engineering 46, 41–64

[68]Rizwan, I., & Aida, M. (2013). An experience of developing Quran ontology with contextual information support. Multicultural Education & Technology Journal Vol. 7 No. 4, pp. 333-343.

[69]Tan, H., Ismail, M., Tarasov, V., Adlemo, A., & Johansson, M. (2016). Development and evaluation of a software requirements ontology. In 7th International Workshop on Software Knowledge-SKY 2016 in conjunction with the 9th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management-IC3K 2016, November 9-10, 2016, in Porto, Portugal (pp. 11-18). SciTePress.

[70]Zhou, Z., Goh, Y. M., & Shen, L. (2016). Overview and analysis of ontology studies supporting development of the construction industry. Journal of Computing in Civil Engineering, 30(6), 04016026.

[71]Soner, K., Ozgur, A., Orkunt, S., Samet, A., Nihan, K. C. & Ferda, N. A. (2012) ‘Ontology-Based Retrieval System using Semantic Indexing’ Information Systems 37, 294–305

[72]Zhanjun L., Victor R. & Karthik, R. (2007). A Methodology of Engineering Ontology Development for Information Retrieval. International Conference on Engineering Design, Iced 07 28 - 31, Paris, France

[73]Obrst, L., Chase, P., & Markeloff, R. (2012, October). Developing an Ontology of the Cyber Security Domain. In STIDS (pp. 49-56).

[74]Simperl, E., & Luczak-Rösch, M. (2014). Collaborative ontology engineering: a survey. The Knowledge Engineering Review, 29(1), 101-131.

[75]Stojadinović, S. M., & Majstorović, V. D. (2014). Developing engineering ontology for domain coordinate metrology. FME Transactions, 42(3), 249-255.

[76]Godspower, O. E. and Esingbemi, P. E. (2016). Ontology for Alleviating Poverty among Farmers in Nigeria.  INFOS '16, May 09-11, 2016, Giza, Egypt

[77]Gruninger, M., & Fox, M. S. (1995). Methodology for the Design and Evaluation of Ontologies. Workshop on Basic Ontological Issues in Knowledge Sharing, Montreal.

[78]Zainab, A. B. & Khairul N. I. (2013). Base Durian Ontology Development Using Modified Methodology. Second International Multi-Conference on Artificial Intelligence Technology, M-CAIT  Shah Alam.

[79]Hitzler, P., Gangemi, A., & Janowicz, K. (Eds.). (2016). Ontology Engineering with Ontology Design Patterns: Foundations and Applications (Vol. 25). IOS Press.

[80]Kim, H. M., & Laskowski, M. (2018). Toward an ontology‐driven blockchain design for supply‐chain provenance. Intelligent Systems in Accounting, Finance and Management, 25(1), 18-27.

[81]Hadjar, K. (2016). University Ontology: A Case Study at Ahlia University. In Semantic Web (pp. 173-183). Springer, Cham.

[82]Bilgin, G., Dikmen, I., & Birgonul, M. T. (2018). An ontology-based approach for delay analysis in construction. KSCE Journal of Civil Engineering, 22(2), 384-398 

[83]El-Diraby, T. E. & Osman, H. (2011). A domain ontology for construction concepts in urban infrastructure products. Automation in Construction 20, 1120–1132

[84]Gomez-Perez, A., Fernandez-Lopez, M. & Corcho, O. (2004) ‘Ontological Engineering: With Examples from the Areas of Knowledge Management, e-Commerce and the   Semantic Web’, Springer Science & Business Media, 2006.

[85]Hafedh, N., Mohamed, F., Imed R. F. & Basel S. (2014). A Critical Analysis of lifecycles and Methods for Ontology Construction and Evaluation’ 1st International Conference on Advanced Technologies for Signal and Image Processing - ATSIP'2014

[86]Haghighi, P. D., Burstein, F., Zaslavsky, A., & Arbon, P. (2013). Development and evaluation of ontology for intelligent decision support in medical emergency management for mass gatherings. Decision Support Systems, 54(2), 1192-1204.

[87]Janowicz, K. (2012). Observation‐driven geo‐ontology engineering. Transactions in GIS, 16(3), 351-374.

[88]Jinsoo, P., Kimoon, S., & Sewon, M. (2008). Developing Graduation Screen Ontology based on the METHONTOLOGY Approach. Fourth International Conference on Networked Computing and Advanced Information Management.

[89]Guo, B. H., & Goh, Y. M. (2017). Ontology for design of active fall protection systems. Automation in Construction, 82, 138-153.

[90]Noman, I., Abu, Z. A. and Zubair, A. S. (2010) ‘Semantic Web: Choosing the Right Methodologies, Tools and Standards’, Information and Emerging Technologies (ICIET), 2010 International Conference on. IEEE, 2010.

[91]Rizwan, I., Masrah A. A. M., Aida, M. & Nurfadhlina, M. S. (2013). An Analysis of Ontology Engineering Methodologies: A Literature Review. Research Journal of  Applied Sciences, Engineering and Technology 6(16): 2993-3000

[92]Gavrilova, T. A., & Leshcheva, I. A. (2015). Ontology design and individual cognitive peculiarities: A pilot study. Expert systems with Applications, 42(8), 3883-3892.

[93]Ibrahim, A. A., Abdul, A. A. G., Wan, N. W. R. & Rodziah, A. (2014). A Comparative Study on Ontology Development Methodologies towards Building Semantic Conflicts Detection Ontology for Heterogeneous Web Services. Research Journal of Applied Sciences, Engineering and Technology 7(13): 2674-2679

[94]De Nicola, A., M., Missikoff & Navigli, R. (2009) ‘A Software Engineering Approach to Ontology Building’ Inform. Syst., 34(2): 258-275.

[95]Del Águila, I. M., Palma, J., & Túnez, S. (2014). Milestones in software engineering and knowledge engineering history: A comparative review. The Scientific World Journal, 2014.

[96]Jain, V., & Singh, M. (2013). Ontology development and query retrieval using protégé tool. International Journal of Intelligent Systems and Applications, 9, 67-75.

[97]Rao, L., Mansingh, G., & Osei-Bryson, K. M. (2012). Building ontology based knowledge maps to assist business process re-engineering. Decision Support Systems, 52(3), 577-589.

[98]Serna, E., & Serna, A. (2014). Ontology for knowledge management in software maintenance. International Journal of Information Management, 34(5), 704-710.

[99]Tiffani J. B., Furuya E. Y., Gilad J. K., James J. C., & Suzanne B. (2012). Development and evaluation of an ontology for guiding appropriate antibiotic prescribing’, Journal of Biomedical Informatics 45  120–128

[100]Arp R. (2009) ‘Practical steps in building a domain  ontology, models and simulations 3: emergence, computation, and reality’ Virginia: Charlottesville.

[101]Chen-Huei C., Fatemeh M. Z., & Huimin Z. (2011). Ontology for Developing Web Sites for Natural Disaster Management: Methodology and Implementation.  IEEE Transactions on Systems, Man, and Cybernetics—Part A: Systems and Humans, Vol. 41, No. 1

[102]Uschold, M & Grüninger, M, (1996). Ontologies: principles methods and applications’,   KnowledgEngineeringReview11(2)93–137.

[103]Ceccaroni, L, Cortés, U & Sánchez-Marré, M, (2000) ‘WaWO – an ontology embedded into an environmental decision-support system for wastewater treatment plant    management’ Workshop on Applications of Ontologies and Problem solving Methods.14th European Conference on ArtificialIntelligence(ECAI’00)2–1–2–9

[104]Zheng, Y., He, Q., Qian, P. & Li, Z. (2012). Construction of the Ontology-Based Agricultural Knowledge Management System. Journal of Integrative Agriculture, 11(5): 700-709

[105]Bonanci, R., Nabuco, O. F. & Junior, I. P. (2016). Ontology models of the impacts of agriculture and climate changes on water resources: Scenarios on interoperability and information recovery’ Future Generation Computer Systems. 54 (2016) 423–434

[106]Aree, T., Asanee, K., Supamard, P. & Uamporn, V. (2009) ‘Ontology Development: A Case Study for Thai Rice’ Kasetsart J. (Nat. Sci.) 43 : 594 – 604

[107]Niu, J., & Issa, R. R. (2015). Developing taxonomy for the domain ontology of construction contractual semantics: A case study on the AIA A201 document. Advanced Engineering Informatics, 29(3), 472-482.

[108]Gregor, D., Toral, S., Ariza, T., Barrero, F., Gregor, R., Rodas, J., & Arzamendia, M. (2016). A methodology for structured ontology construction applied to intelligent transportation systems. Computer Standards & Interfaces, 47, 108-119.

[109]Dutta, B., Chatterjee, U., & Madalli, D. P. (2015). YAMO: yet another methodology for large-scale faceted ontology construction. Journal of Knowledge Management, 19(1), 6-24.

[110]Zeb, J., Froese, T., & Vanier, D. (2015). An ontology-supported asset information integrator system in infrastructure management. Built Environment Project and Asset Management, 5(4), 380-397.

[111]Mezghani, E., Exposito, E., & Drira, K. (2016). A collaborative methodology for tacit knowledge management: Application to scientific research. Future Generation Computer Systems, 54, 450-455.

[112]Bautista-Zambrana, M. R. (2015). Methodologies to  build ontologies for terminological purposes. Procedia-Social and Behavioral Sciences, 173, 264-269.

[113]Keet, C. M., Ławrynowicz, A., d’Amato, C., Kalousis, A., Nguyen, P., Palma, R., & Hilario, M. (2015). The data mining OPtimization ontology. Journal of web semantics, 32, 43-53.

[114]Rayyaan, R., Wang, Y., & Kennon, R. (2014). Ontology-based interoperability solutions for textile supply chain. Advances in Manufacturing, 2(2), 97-105.

[115]Cristani, M., & Cuel, R. (2005). A survey on ontology creation methodologies. International Journal on Semantic Web and Information Systems (IJSWIS), 1(2), 49-69.

[116]Sazedj, P. & Pinto, H. S. (2005). Time to evaluate: Targeting annotation tools. In Proc. of Knowledge Markup and Semantic Annotation at ISWC 2005.