|
|
Testbeds
The successful deployment of Semantic Technologies such as ontology editors, inference engines, semantic web service discovery engines, annotation tools etc. requires that they become off-the-shelf tools, easy to integrate by non-experts, scalable to a maximum degree and robust. Key to meet the real world challenges are commonly agreed testbeds which help to standardize evaluation and benchmarking with the aim to ensure seamless interoperability and integration of the various Semantic Technologies.
STI2 facilitates the shared development of open, globally distributed testbeds for developing, deploying and testing Semantic Web and Semantic Web Services at a worldwide scale. In developing such testbeds STI2 intends both supporting short-term experiments and continuously-running applications, which demonstrate the uses of semantics in real world scenarios. We will join forces for the endeavour to create such testbeds which consist of (i) realistic, large scale volumes of data (structured and unstructured), (ii) a machinery which automates testing to the maximum degree and (iii) methodological standards on how to perform testing. The main reasons for setting up such open testbeds in STI2 are:
- Sharing the costs,
- Collaborating in setting up realistic problems,
- Cooperating in finding the best solutions to such problems,
- Agreeing on evaluation methods for measuring the results.
|