In this paper, we summarize our experience and rst results achieved in the context of advanced research evaluation. Striving for research metrics that eectively allow us to predict real opinions about researchers in a variety of scenarios, we conducted two experiments to understand the respective suitability of common indicators, such as the h-index. We concluded that realistic research evaluation is more complex than assumed by those indicators and, hence, may require the specica- tion of even complex evaluation algorithms. While the reconstruction (or reverse engineering) of those algorithms from publicly available data is one of our research goals, in this paper we show how can we enable users to develop their own algorithms with Reseval, our mashup-based research evaluation platform, and how doing so requires dealing with a variety of data management issues that are specic to the domain of research evaluation. Therefore, we also present the main concepts and model of our data access and management solution, the Scientic Re- source Space (SRS).

A Scientific Resource Space for Advanced Research Evaluation Scenarios

Parra Trepowski, Cristhian Daniel;Mirylenka, Daniil;Daniel, Florian;Casati, Fabio;Marchese, Maurizio
2011-01-01

Abstract

In this paper, we summarize our experience and rst results achieved in the context of advanced research evaluation. Striving for research metrics that eectively allow us to predict real opinions about researchers in a variety of scenarios, we conducted two experiments to understand the respective suitability of common indicators, such as the h-index. We concluded that realistic research evaluation is more complex than assumed by those indicators and, hence, may require the specica- tion of even complex evaluation algorithms. While the reconstruction (or reverse engineering) of those algorithms from publicly available data is one of our research goals, in this paper we show how can we enable users to develop their own algorithms with Reseval, our mashup-based research evaluation platform, and how doing so requires dealing with a variety of data management issues that are specic to the domain of research evaluation. Therefore, we also present the main concepts and model of our data access and management solution, the Scientic Re- source Space (SRS).
2011
Proceedings of the Nineteenth Italian Symposium on Advanced Database Systems
AA. VV.
Berlin; Heidelberg
Springer
Parra Trepowski, Cristhian Daniel; M., Imran; Mirylenka, Daniil; Daniel, Florian; Casati, Fabio; Marchese, Maurizio
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/96454
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 1
  • ???jsp.display-item.citation.isi??? ND
  • OpenAlex ND
social impact