Modern Graphical User Interface testing frameworks automate the testing of web-based interfaces to ensure the absence of functional and visual regressions. They employ common strategies to tackle different testing use-cases. This paper presents an analysis of these strategies, highlighting that it is not possible to test some kinds of interactive interfaces exhaustively. We propose a novel image-based framework that combines current techniques with new ones. These leverage Machine Learning and Computer Vision algorithms to analyze screenshots of the interface and prove its correctness. Results suggest that it suffices to automate the verification of interactive interfaces that were not fully testable before. Automated tests, developed as a benchmark, present almost no false-positives and high accuracy.

Image-based approaches for automating GUI testing of interactive web-based applications / Macchi, F.; Rosin, P.; Mervi, J. M.; Turchet, L.. - 2021-:(2021). ((Intervento presentato al convegno 28th Conference of Open Innovations Association FRUCT, FRUCT 2021 tenutosi a rus nel 2021 [10.23919/FRUCT50888.2021.9347592].

Image-based approaches for automating GUI testing of interactive web-based applications

Turchet L.
2021

Abstract

Modern Graphical User Interface testing frameworks automate the testing of web-based interfaces to ensure the absence of functional and visual regressions. They employ common strategies to tackle different testing use-cases. This paper presents an analysis of these strategies, highlighting that it is not possible to test some kinds of interactive interfaces exhaustively. We propose a novel image-based framework that combines current techniques with new ones. These leverage Machine Learning and Computer Vision algorithms to analyze screenshots of the interface and prove its correctness. Results suggest that it suffices to automate the verification of interactive interfaces that were not fully testable before. Automated tests, developed as a benchmark, present almost no false-positives and high accuracy.
Conference of Open Innovation Association, FRUCT
New York
IEEE Computer Society
Macchi, F.; Rosin, P.; Mervi, J. M.; Turchet, L.
Image-based approaches for automating GUI testing of interactive web-based applications / Macchi, F.; Rosin, P.; Mervi, J. M.; Turchet, L.. - 2021-:(2021). ((Intervento presentato al convegno 28th Conference of Open Innovations Association FRUCT, FRUCT 2021 tenutosi a rus nel 2021 [10.23919/FRUCT50888.2021.9347592].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/11572/296117
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact