Neonatal respiratory disorders pose significant challenges in clinical settings, often requiring rapid and accurate diagnostic solutions for effective management. Lung ultrasound (LUS) has emerged as a promising tool to evaluate respiratory conditions in neonates. This evaluation is mainly based on the interpretation of visual patterns (horizontal artifacts, vertical artifacts, and consolidations). Automated interpretation of these patterns can assist clinicians in their evaluations. However, developing AI-based solutions for this purpose is challenging, primarily due to the lack of annotated data and inherent subjectivity in expert interpretations. This study aims to propose an automated solution for the reliable interpretation of patterns in LUS videos of newborns. We employed two distinct strategies. The first strategy is a frame-to-video-level approach that computes frame-level predictions from deep learning (DL) models trained from scratch (F2V-TS) along with fine-tuning pre-trained models (F2V-FT) followed by aggregation of those predictions for video-level evaluation. The second strategy is a direct video classification approach (DV) for evaluating LUS data. To evaluate our methods, we used LUS data from 34 neonatal patients comprising of 70 exams with annotations provided by three expert human operators (3HOs). Results show that within the frame-to-video-level approach, F2V-FT achieved the best performance with an accuracy of 77% showing moderate agreement with the 3HOs. while the direct video classification approach resulted in an accuracy of 72%, showing substantial agreement with the 3HOs, our proposed study lays down the foundation for reliable AI-based solutions for newborn LUS data evaluation.

Deep learning approaches for automated classification of neonatal lung ultrasound with assessment of human-to-AI interrater agreement / Fatima, Noreen; Khan, Umair; Han, Xi; Zannin, Emanuela; Rigotti, Camilla; Cattaneo, Federico; Dognini, Giulia; Ventura, Maria Luisa; Demi, Libertario. - In: COMPUTERS IN BIOLOGY AND MEDICINE. - ISSN 0010-4825. - 2024, 183:(2024), pp. 10931501-10931517. [10.1016/j.compbiomed.2024.109315]

Deep learning approaches for automated classification of neonatal lung ultrasound with assessment of human-to-AI interrater agreement

Fatima, Noreen;Khan, Umair;Han, Xi;Demi, Libertario
2024-01-01

Abstract

Neonatal respiratory disorders pose significant challenges in clinical settings, often requiring rapid and accurate diagnostic solutions for effective management. Lung ultrasound (LUS) has emerged as a promising tool to evaluate respiratory conditions in neonates. This evaluation is mainly based on the interpretation of visual patterns (horizontal artifacts, vertical artifacts, and consolidations). Automated interpretation of these patterns can assist clinicians in their evaluations. However, developing AI-based solutions for this purpose is challenging, primarily due to the lack of annotated data and inherent subjectivity in expert interpretations. This study aims to propose an automated solution for the reliable interpretation of patterns in LUS videos of newborns. We employed two distinct strategies. The first strategy is a frame-to-video-level approach that computes frame-level predictions from deep learning (DL) models trained from scratch (F2V-TS) along with fine-tuning pre-trained models (F2V-FT) followed by aggregation of those predictions for video-level evaluation. The second strategy is a direct video classification approach (DV) for evaluating LUS data. To evaluate our methods, we used LUS data from 34 neonatal patients comprising of 70 exams with annotations provided by three expert human operators (3HOs). Results show that within the frame-to-video-level approach, F2V-FT achieved the best performance with an accuracy of 77% showing moderate agreement with the 3HOs. while the direct video classification approach resulted in an accuracy of 72%, showing substantial agreement with the 3HOs, our proposed study lays down the foundation for reliable AI-based solutions for newborn LUS data evaluation.
2024
Fatima, Noreen; Khan, Umair; Han, Xi; Zannin, Emanuela; Rigotti, Camilla; Cattaneo, Federico; Dognini, Giulia; Ventura, Maria Luisa; Demi, Libertario...espandi
Deep learning approaches for automated classification of neonatal lung ultrasound with assessment of human-to-AI interrater agreement / Fatima, Noreen; Khan, Umair; Han, Xi; Zannin, Emanuela; Rigotti, Camilla; Cattaneo, Federico; Dognini, Giulia; Ventura, Maria Luisa; Demi, Libertario. - In: COMPUTERS IN BIOLOGY AND MEDICINE. - ISSN 0010-4825. - 2024, 183:(2024), pp. 10931501-10931517. [10.1016/j.compbiomed.2024.109315]
File in questo prodotto:
File Dimensione Formato  
1-s2.0-S0010482524014008-main.pdf

accesso aperto

Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Creative commons
Dimensione 4.98 MB
Formato Adobe PDF
4.98 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/438076
Citazioni
  • ???jsp.display-item.citation.pmc??? 0
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
  • OpenAlex ND
social impact