There exists a real need in industry to have guidelines on what testing techniques use for different testing objectives, and how usable (effective, efficient, satisfactory) these techniques are. Up to date, these guidelines do not exist. Such guidelines could be obtained by doing secondary studies on a body of evidence consisting of case studies evaluating and comparing testing techniques and tools. However, such a body of evidence is also lacking. In this paper, we will make a first step towards creating such body of evidence by defining a general methodological evaluation framework that can simplify the design of case studies for comparing software testing tools, and make the results more precise, reliable, and easy to compare. Using this framework, (1) software testing practitioners can more easily define case studies through an instantiation of the framework, (2) results can be better compared since they are all executed according to a similar design, (3) the gap in existing work on methodological evaluation frameworks will be narrowed, and (4) a body of evidence will be initiated. By means of validating the framework, we will present successful applications of this methodological framework to various case studies for evaluating testing tools in an industrial environment with real objects and real subjects. © 2012 IEEE.

A methodological framework for evaluating software testing techniques and tools / Vos, T. E. J.; Marint, B.; Escalona, M. J.; Marchetto, A.. - (2012), pp. 230-239. (Intervento presentato al convegno 12th International Conference on Quality Software, QSIC 2012 tenutosi a Xi'an, Shaanxi, chn nel 2012) [10.1109/QSIC.2012.16].

A methodological framework for evaluating software testing techniques and tools

Marchetto A.
2012-01-01

Abstract

There exists a real need in industry to have guidelines on what testing techniques use for different testing objectives, and how usable (effective, efficient, satisfactory) these techniques are. Up to date, these guidelines do not exist. Such guidelines could be obtained by doing secondary studies on a body of evidence consisting of case studies evaluating and comparing testing techniques and tools. However, such a body of evidence is also lacking. In this paper, we will make a first step towards creating such body of evidence by defining a general methodological evaluation framework that can simplify the design of case studies for comparing software testing tools, and make the results more precise, reliable, and easy to compare. Using this framework, (1) software testing practitioners can more easily define case studies through an instantiation of the framework, (2) results can be better compared since they are all executed according to a similar design, (3) the gap in existing work on methodological evaluation frameworks will be narrowed, and (4) a body of evidence will be initiated. By means of validating the framework, we will present successful applications of this methodological framework to various case studies for evaluating testing tools in an industrial environment with real objects and real subjects. © 2012 IEEE.
2012
Proceedings - International Conference on Quality Software
10662 LOS VAQUEROS CIRCLE, PO BOX 3014, LOS ALAMITOS, CA 90720-1264 USA
IEEE COMPUTER SOC
978-1-4673-2857-9
978-0-7695-4833-3
Vos, T. E. J.; Marint, B.; Escalona, M. J.; Marchetto, A.
A methodological framework for evaluating software testing techniques and tools / Vos, T. E. J.; Marint, B.; Escalona, M. J.; Marchetto, A.. - (2012), pp. 230-239. (Intervento presentato al convegno 12th International Conference on Quality Software, QSIC 2012 tenutosi a Xi'an, Shaanxi, chn nel 2012) [10.1109/QSIC.2012.16].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/331382
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 34
  • ???jsp.display-item.citation.isi??? 16
social impact