Failures of the vehicle camera may compromise the correct acquisition of frames, that are subsequently used by autonomous driving tasks. A clear understanding of the behavior of the autonomous driving tasks under such failure conditions, together with strategies to avoid safety is jeopardized, are indeed necessary. This study analyses and improve the performance of Traffic Sign Recognition (TSR) systems for road vehicles under the possible occurrence of camera failures. Our experimental assessment relies on three public datasets, which are commonly used for benchmarking TSR systems. We artificially inject 13 different types of camera failures into the three datasets. Then, we exploit three deep neural networks (DNNs) to classify either a single frame of a traffic sign or a sequence (i.e., a sliding window) of frames. We show that sliding windows significantly improves the robustness of the classifier against altered frames. We confirm our observations through explainable AI, which allows understanding why different classifiers have different performance in case of camera failures

Robust Traffic Sign Recognition Against Camera Failures / Atif, Muhammad; Ceccarelli, Andrea; Zoppi, Tommaso; Gharib, Mohamad; Bondavalli, Andrea. - In: IEEE OPEN JOURNAL OF INTELLIGENT TRANSPORTATION SYSTEMS. - ISSN 2687-7813. - ELETTRONICO. - 3:(2022), pp. 709-722. [10.1109/OJITS.2022.3213183]

Robust Traffic Sign Recognition Against Camera Failures

TOMMASO ZOPPI;
2022-01-01

Abstract

Failures of the vehicle camera may compromise the correct acquisition of frames, that are subsequently used by autonomous driving tasks. A clear understanding of the behavior of the autonomous driving tasks under such failure conditions, together with strategies to avoid safety is jeopardized, are indeed necessary. This study analyses and improve the performance of Traffic Sign Recognition (TSR) systems for road vehicles under the possible occurrence of camera failures. Our experimental assessment relies on three public datasets, which are commonly used for benchmarking TSR systems. We artificially inject 13 different types of camera failures into the three datasets. Then, we exploit three deep neural networks (DNNs) to classify either a single frame of a traffic sign or a sequence (i.e., a sliding window) of frames. We show that sliding windows significantly improves the robustness of the classifier against altered frames. We confirm our observations through explainable AI, which allows understanding why different classifiers have different performance in case of camera failures
2022
Atif, Muhammad; Ceccarelli, Andrea; Zoppi, Tommaso; Gharib, Mohamad; Bondavalli, Andrea
Robust Traffic Sign Recognition Against Camera Failures / Atif, Muhammad; Ceccarelli, Andrea; Zoppi, Tommaso; Gharib, Mohamad; Bondavalli, Andrea. - In: IEEE OPEN JOURNAL OF INTELLIGENT TRANSPORTATION SYSTEMS. - ISSN 2687-7813. - ELETTRONICO. - 3:(2022), pp. 709-722. [10.1109/OJITS.2022.3213183]
File in questo prodotto:
File Dimensione Formato  
Robust_Traffic_Sign_Recognition_Against_Camera_Failures.pdf

accesso aperto

Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Creative commons
Dimensione 3.76 MB
Formato Adobe PDF
3.76 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/390277
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 6
  • ???jsp.display-item.citation.isi??? 4
social impact