Deep learning (DL) has proved successful in medical imaging and, in the wake of the recent COVID-19 pandemic, some works have started to investigate DLbased solutions for the assisted diagnosis of lung diseases. While existing works focus on CT scans, this paper studies the application of DL techniques for the analysis of lung ultrasonography (LUS) images. Specifically, we present a novel fully-annotated dataset of LUS images collected from several Italian hospitals, with labels indicating the degree of disease severity at a frame-level, videolevel, and pixel-level (segmentation masks). Leveraging these data, we introduce several deep models that address relevant tasks for the automatic analysis of LUS images. In particular, we present a novel deep network, derived from Spatial Transformer Networks, which simultaneously predicts the disease severity score associated to a input frame and provides localization of pathological artefacts in a weakly-supervised way. Furthermore, we introduce a new method based on uninorms for effective frame score aggregation at a video-level. Finally, we benchmark state of the art deep models for estimating pixel-level segmentations of COVID-19 imaging biomarkers. Experiments on the proposed dataset demonstrate satisfactory results on all the considered tasks, paving the way to future research on DL for the assisted diagnosis of COVID-19 from LUS data.

Deep learning for classification and localization of COVID-19 markers in point-of-care lung ultrasound / Roy, Subhankar; Menapace, Willi; Oei, Sebastiaan; Luijten, Ben; Fini, Enrico; Saltori, Cristiano; Huijben, Iris; Chennakeshava, Nishith; Mento, Federico; Sentelli, Alessandro; Peschiera, Emanuele; Trevisan, Riccardo; Maschietto, Giovanni; Torri, Elena; Inchingolo, Riccardo; Smargiassi, Andrea; Soldati, Gino; Rota, Paolo; Passerini, Andrea; Van Sloun, Ruud J G; Ricci, Elisa; Demi, Libertario. - In: IEEE TRANSACTIONS ON MEDICAL IMAGING. - ISSN 0278-0062. - 2020:(2020), pp. 1-1. [10.1109/TMI.2020.2994459]

Deep learning for classification and localization of COVID-19 markers in point-of-care lung ultrasound

Roy, Subhankar;Menapace, Willi;Fini, Enrico;Saltori, Cristiano;Mento, Federico;Rota, Paolo;Passerini, Andrea;Ricci, Elisa;Demi, Libertario
2020

Abstract

Deep learning (DL) has proved successful in medical imaging and, in the wake of the recent COVID-19 pandemic, some works have started to investigate DLbased solutions for the assisted diagnosis of lung diseases. While existing works focus on CT scans, this paper studies the application of DL techniques for the analysis of lung ultrasonography (LUS) images. Specifically, we present a novel fully-annotated dataset of LUS images collected from several Italian hospitals, with labels indicating the degree of disease severity at a frame-level, videolevel, and pixel-level (segmentation masks). Leveraging these data, we introduce several deep models that address relevant tasks for the automatic analysis of LUS images. In particular, we present a novel deep network, derived from Spatial Transformer Networks, which simultaneously predicts the disease severity score associated to a input frame and provides localization of pathological artefacts in a weakly-supervised way. Furthermore, we introduce a new method based on uninorms for effective frame score aggregation at a video-level. Finally, we benchmark state of the art deep models for estimating pixel-level segmentations of COVID-19 imaging biomarkers. Experiments on the proposed dataset demonstrate satisfactory results on all the considered tasks, paving the way to future research on DL for the assisted diagnosis of COVID-19 from LUS data.
Roy, Subhankar; Menapace, Willi; Oei, Sebastiaan; Luijten, Ben; Fini, Enrico; Saltori, Cristiano; Huijben, Iris; Chennakeshava, Nishith; Mento, Federico; Sentelli, Alessandro; Peschiera, Emanuele; Trevisan, Riccardo; Maschietto, Giovanni; Torri, Elena; Inchingolo, Riccardo; Smargiassi, Andrea; Soldati, Gino; Rota, Paolo; Passerini, Andrea; Van Sloun, Ruud J G; Ricci, Elisa; Demi, Libertario
Deep learning for classification and localization of COVID-19 markers in point-of-care lung ultrasound / Roy, Subhankar; Menapace, Willi; Oei, Sebastiaan; Luijten, Ben; Fini, Enrico; Saltori, Cristiano; Huijben, Iris; Chennakeshava, Nishith; Mento, Federico; Sentelli, Alessandro; Peschiera, Emanuele; Trevisan, Riccardo; Maschietto, Giovanni; Torri, Elena; Inchingolo, Riccardo; Smargiassi, Andrea; Soldati, Gino; Rota, Paolo; Passerini, Andrea; Van Sloun, Ruud J G; Ricci, Elisa; Demi, Libertario. - In: IEEE TRANSACTIONS ON MEDICAL IMAGING. - ISSN 0278-0062. - 2020:(2020), pp. 1-1. [10.1109/TMI.2020.2994459]
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/263776
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? 110
  • Scopus 264
  • ???jsp.display-item.citation.isi??? 197
social impact