Ontology matching is one of the biggest challenges of Semantic Web research. In the last years the number of matching techniques and systems has significantly increased, and this, in turn, has raised the issue of their evaluation and comparison. In this paper we present a mapping dataset extracted from the Google, Yahoo and Looksmart web directories. This dataset allows for the evaluation of both Precision and Recall, and it is an order of magnitude larger than the state of the art datasets with the same capabilities. We have evaluated this dataset on nine state of the art matching solutions. The evaluation results highlight the fact that the dataset has three key properties, namely it is error-free, it is hard to solve, and it can discriminate among systems.

A Large Scale Dataset for the Evaluation of Matching Systems / Yatskevich, Mikalai; Giunchiglia, Fausto; Avesani, Paolo. - ELETTRONICO. - (2006), pp. 1-16.

A Large Scale Dataset for the Evaluation of Matching Systems

Yatskevich, Mikalai;Giunchiglia, Fausto;Avesani, Paolo
2006-01-01

Abstract

Ontology matching is one of the biggest challenges of Semantic Web research. In the last years the number of matching techniques and systems has significantly increased, and this, in turn, has raised the issue of their evaluation and comparison. In this paper we present a mapping dataset extracted from the Google, Yahoo and Looksmart web directories. This dataset allows for the evaluation of both Precision and Recall, and it is an order of magnitude larger than the state of the art datasets with the same capabilities. We have evaluated this dataset on nine state of the art matching solutions. The evaluation results highlight the fact that the dataset has three key properties, namely it is error-free, it is hard to solve, and it can discriminate among systems.
2006
Trento
Università degli Studi di Trento - Dipartimento di Informatica e Telecomunicazioni
A Large Scale Dataset for the Evaluation of Matching Systems / Yatskevich, Mikalai; Giunchiglia, Fausto; Avesani, Paolo. - ELETTRONICO. - (2006), pp. 1-16.
Yatskevich, Mikalai; Giunchiglia, Fausto; Avesani, Paolo
File in questo prodotto:
File Dimensione Formato  
035.pdf

accesso aperto

Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 211.4 kB
Formato Adobe PDF
211.4 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/358098
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
  • OpenAlex ND
social impact