This service provides test beds and challenges for evaluating, testing, demonstrating, and comparing semantic technologies.

The aim is to offer sophisticated and commonly accepted metrics for evaluating the technical quality of new technology developments as well as for assessing their capabilities in real-world problem solving. For this, we assemble and develop methodologies, use cases, and test environments for several fields of semantic technology developments. These can be used to validate research results, to compare different technologies, to demonstrate the benefits of semantic technologies to industry and to other interested parties, and to build interwoven communities of researchers and developers.

On this website you find:

• a description and overview of the service
• a collection of test beds for benchmarking semantic technologies
• a collection of challenges for testing and demonstrating the problem-solving capabilities of semantic technologies
• announcements of related events
• a bibliography on testing and evaluation of semantic technologies
• contact information on the service team.