Conceptual models are used in a variety of areas within Computer Science, including Software Engineering, Databases and AI. A major bottleneck in broadening their applicability is the time it takes to build a conceptual model for a new application. Not surprisingly, a variety of tools and techniques have been proposed for reusing conceptual models, e.g. ontologies, or for building them semi-automatically from natural language (NL) descriptions. What has been left largely unexplored is the impact of such tools on the quality of the models that are being created. This paper presents the results of three experiments designed to assess the extent to which a Natural-Language Processing (NLP) tool improves the quality of conceptual models, specifically object-oriented ones. Our main experimental hypothesis is that the quality of a domain class model is higher if its development is supported by a NLP system. The tool used for the experiment – named NL-OOPS – extracts classes and associations from a knowledge base realized by a deep semantic analysis of a sample text. Specifically, NL-OOPS produces class models at different levels of detail by exploiting class hierarchies in the knowledge base of a NLP system and marks ambiguities in the text. In our experiments, we had groups working with and without the tool, and then compared and evaluated the final class models they produced. The results of the experiments – the first on this topic – give insights on the state of the art of linguistics-based Computer Aided Software Engineering (CASE) tools and allow identifying important guidelines to improve their performance. In particular it was possible to highlight which of the linguistic tasks are more critical to effectively support conceptual modelling.

NLP-Based Requirements Modeling: Experiments on the Quality of the models / Kiyavitskaya, Nadzeya; Zeni, Nicola; Mich, Luisa; Mylopoulos, John. - ELETTRONICO. - (2004), pp. 1-17. [10.15168/11572_40582]

NLP-Based Requirements Modeling: Experiments on the Quality of the models

Kiyavitskaya, Nadzeya
Primo
;
Zeni, Nicola
Secondo
;
Mich, Luisa
Penultimo
;
Mylopoulos, John
Ultimo
2004-01-01

Abstract

Conceptual models are used in a variety of areas within Computer Science, including Software Engineering, Databases and AI. A major bottleneck in broadening their applicability is the time it takes to build a conceptual model for a new application. Not surprisingly, a variety of tools and techniques have been proposed for reusing conceptual models, e.g. ontologies, or for building them semi-automatically from natural language (NL) descriptions. What has been left largely unexplored is the impact of such tools on the quality of the models that are being created. This paper presents the results of three experiments designed to assess the extent to which a Natural-Language Processing (NLP) tool improves the quality of conceptual models, specifically object-oriented ones. Our main experimental hypothesis is that the quality of a domain class model is higher if its development is supported by a NLP system. The tool used for the experiment – named NL-OOPS – extracts classes and associations from a knowledge base realized by a deep semantic analysis of a sample text. Specifically, NL-OOPS produces class models at different levels of detail by exploiting class hierarchies in the knowledge base of a NLP system and marks ambiguities in the text. In our experiments, we had groups working with and without the tool, and then compared and evaluated the final class models they produced. The results of the experiments – the first on this topic – give insights on the state of the art of linguistics-based Computer Aided Software Engineering (CASE) tools and allow identifying important guidelines to improve their performance. In particular it was possible to highlight which of the linguistic tasks are more critical to effectively support conceptual modelling.
2004
Trento
Università di Trento
NLP-Based Requirements Modeling: Experiments on the Quality of the models / Kiyavitskaya, Nadzeya; Zeni, Nicola; Mich, Luisa; Mylopoulos, John. - ELETTRONICO. - (2004), pp. 1-17. [10.15168/11572_40582]
Kiyavitskaya, Nadzeya; Zeni, Nicola; Mich, Luisa; Mylopoulos, John
File in questo prodotto:
File Dimensione Formato  
005.pdf

accesso aperto

Tipologia: Altro materiale allegato (Other attachments)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 635.29 kB
Formato Adobe PDF
635.29 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/358914
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact