Modern Graphics Processing Units (GPUs) have dedicated hardware to execute floating-point operations with different precisions (64-bit double, 32-bit single, and 16-bit half). Using reduced precision for specific applications like Deep Neural Networks (DNNs) has been shown to reduce both the execution time and power consumption with negligible effects on the DNNs' accuracy. As GPUs are playing a critical role in DNN for object detection and get into safety-critical environments, their reliability is becoming a growing concern. In this paper, we evaluate the reliability of a DNN implemented in three different precisions (half, single, and double) on NVIDIA mixed-precision GPUs. We evaluate not only the error rate of the applications but also the effects of the errors on the final detection. We perform extensive fault-injection campaign on the register file of NVIDIA mixed-precision GPUs. We found that reducing data and operation precision increases the probability for the fault to impact the DNN detection and classification. Then, we complement the fault injection study with beam experiments. We exposed YOLOv3 running on Tesla V100s to neutron beams and found that the use of half precision reduces the error rate of up to 2x. The smaller exposed area and improved performances brought by reduced precision is then likely to increase the DNN reliability.
Impact of reduced precision in the reliability of deep neural networks for object detection / Dos Santos, F. F.; Navaux, P.; Carro, L.; Rech, P.. - 2019-:(2019), pp. 1-6. ((Intervento presentato al convegno 2019 IEEE European Test Symposium, ETS 2019 tenutosi a deu nel 2019 [10.1109/ETS.2019.8791554].
Scheda prodotto non validato
I dati visualizzati non sono stati ancora sottoposti a validazione formale da parte dello Staff di IRIS, ma sono stati ugualmente trasmessi al Sito Docente Cineca (Loginmiur).
Titolo: | Impact of reduced precision in the reliability of deep neural networks for object detection | |
Autori: | Dos Santos, F. F.; Navaux, P.; Carro, L.; Rech, P. | |
Autori Unitn: | ||
Titolo del volume contenente il saggio: | Proceedings of the European Test Workshop | |
Luogo di edizione: | usa | |
Casa editrice: | Institute of Electrical and Electronics Engineers Inc. | |
Anno di pubblicazione: | 2019 | |
Codice identificativo Scopus: | 2-s2.0-85071154346 | |
ISBN: | 978-1-7281-1173-5 | |
Handle: | http://hdl.handle.net/11572/346653 | |
Citazione: | Impact of reduced precision in the reliability of deep neural networks for object detection / Dos Santos, F. F.; Navaux, P.; Carro, L.; Rech, P.. - 2019-:(2019), pp. 1-6. ((Intervento presentato al convegno 2019 IEEE European Test Symposium, ETS 2019 tenutosi a deu nel 2019 [10.1109/ETS.2019.8791554]. | |
Appare nelle tipologie: | 04.1 Saggio in atti di convegno (Paper in Proceedings) |