7th EON2010 - International Workshop onEvaluation of Ontology-based Tools

Seals Community
Sunday, May 30, 2010
Knossos Royal Village

Roughly 10 years after the vision of the Semantic Web was first presented, semantic technologies have become a well-established pillar of computer science research. With the increasing number of technologies being developed, the problem of how to compare and evaluate the various approaches gains more and more importance. Such evaluation is critical not only for future scientific progress, but also for the industrial adoption of the developed technologies.

Scientific progress and industrial adoption of new technologies depend on the ability to objectively evaluate and compare competing approaches. For researchers, evaluations are critical to identify promising approaches and discard poor ones. For industry, evaluations are critical to prove the applicability and relative advantage of semantic technologies to solve real world problems. Well-established cultures and methodologies for evaluations foster a stronger consensus of a community's research goals, tighter collaboration between research groups, more rigorous examination of research results, and generally faster technical progress.

Currently, the evaluation of Semantic Web technology and its applications is difficult and expensive. Practitioners want to evaluate their tools and to have data sets available in order to minimize the evaluation cost. Also, there are some data sets that are widely being used by the community (such as the Lehigh University Benchmark). The problem is that it is difficult for users and developers to replicate these semantic technology evaluations, to know what they are intended for, or to correctly use them.

The importance of evaluation for the growing maturity of semantic technologies calls for established and agreed upon evaluation methods and data sets. However, the achievement of these consensual mechanisms requires to be actively driven by the whole community and, to this end, the community requires a forum to express their opinions and to discuss them.

For more information please visit the website: http://www.seals-project.eu/events/15-eon2010



Universidad Politecnica

University of Aberdeen

Karlsruhe Institute of Technology (KIT)


Won Kwang University

The Open University


University of Innsbruck