Brain vascular damage accumulate in aging and often manifest as white matter hyperintensities (WMHs) on MRI. Despite increased interest in automated methods to segment WMHs, a gold standard has not been achieved and their longitudinal reproducibility has been poorly investigated. The aim of present work is to evaluate accuracy and reproducibility of two freely available segmentation algorithms. A harmonized MRI protocol was implemented in 3T-scanners across 13 European sites, each scanning five volunteers twice (test-retest) using 2D-FLAIR. Automated segmentation was performed using Lesion segmentation tool algorithms (LST): the Lesion growth algorithm (LGA) in SPM8 and 12 and the Lesion prediction algorithm (LPA). To assess reproducibility, we applied the LST longitudinal pipeline to the LGA and LPA outputs for both the test and retest scans. We evaluated volumetric and spatial accuracy comparing LGA and LPA with manual tracing, and for reproducibility the test versus retest. Median volume difference between automated WMH and manual segmentations (mL) was −0.22[IQR = 0.50] for LGA-SPM8, −0.12[0.57] for LGA-SPM12, −0.09[0.53] for LPA, while the spatial accuracy (Dice Coefficient) was 0.29[0.31], 0.33[0.26] and 0.41[0.23], respectively. The reproducibility analysis showed a median reproducibility error of 20%[IQR = 41] for LGA-SPM8, 14% [31] for LGA-SPM12 and 10% [27] with the LPA cross-sectional pipeline. Applying the LST longitudinal pipeline, the reproducibility errors were considerably reduced (LGA: 0%[IQR = 0], p < 0.001; LPA: 0% [3], p < 0.001) compared to those derived using the cross-sectional algorithms. The DC using the longitudinal pipeline was excellent (median = 1) for LGA [IQR = 0] and LPA [0.02]. LST algorithms showed moderate accuracy and good reproducibility. Therefore, it can be used as a reliable cross-sectional and longitudinal tool in multi-site studies.

Accuracy and reproducibility of automated white matter hyperintensities segmentation with lesion segmentation tool: A European multi-site 3T study / Ribaldi, Federica; Altomare, Daniele; Jovicich, Jorge; Ferrari, Clarissa; Picco, Agnese; Pizzini, Francesca Benedetta; Soricelli, Andrea; Mega, Anna; Ferretti, Antonio; Drevelegas, Antonios; Bosch, Beatriz; Müller, Bernhard W.; Marra, Camillo; Cavaliere, Carlo; Bartrés-Faz, David; Nobili, Flavio; Alessandrini, Franco; Barkhof, Frederik; Gros-Dagnac, Helene; Ranjeva, Jean-Philippe; Wiltfang, Jens; Kuijer, Joost; Sein, Julien; Hoffmann, Karl-Titus; Roccatagliata, Luca; Parnetti, Lucilla; Tsolaki, Magda; Constantinidis, Manos; Aiello, Marco; Salvatore, Marco; Montalti, Martina; Caulo, Massimo; Didic, Mira; Bargallo, Núria; Blin, Olivier; Rossini, Paolo M; Schonknecht, Peter; Floridi, Piero; Payoux, Pierre; Visser, Pieter Jelle; Bordet, Régis; Lopes, Renaud; Tarducci, Roberto; Bombois, Stephanie; Hensch, Tilman; Fiedler, Ute; Richardson, Jill C.; Frisoni, Giovanni B.; Marizzoni, Moira. - In: MAGNETIC RESONANCE IMAGING. - ISSN 0730-725X. - 76:(2021), pp. 108-115. [10.1016/j.mri.2020.11.008]

Accuracy and reproducibility of automated white matter hyperintensities segmentation with lesion segmentation tool: A European multi-site 3T study

Jovicich, Jorge;Aiello, Marco;
2021-01-01

Abstract

Brain vascular damage accumulate in aging and often manifest as white matter hyperintensities (WMHs) on MRI. Despite increased interest in automated methods to segment WMHs, a gold standard has not been achieved and their longitudinal reproducibility has been poorly investigated. The aim of present work is to evaluate accuracy and reproducibility of two freely available segmentation algorithms. A harmonized MRI protocol was implemented in 3T-scanners across 13 European sites, each scanning five volunteers twice (test-retest) using 2D-FLAIR. Automated segmentation was performed using Lesion segmentation tool algorithms (LST): the Lesion growth algorithm (LGA) in SPM8 and 12 and the Lesion prediction algorithm (LPA). To assess reproducibility, we applied the LST longitudinal pipeline to the LGA and LPA outputs for both the test and retest scans. We evaluated volumetric and spatial accuracy comparing LGA and LPA with manual tracing, and for reproducibility the test versus retest. Median volume difference between automated WMH and manual segmentations (mL) was −0.22[IQR = 0.50] for LGA-SPM8, −0.12[0.57] for LGA-SPM12, −0.09[0.53] for LPA, while the spatial accuracy (Dice Coefficient) was 0.29[0.31], 0.33[0.26] and 0.41[0.23], respectively. The reproducibility analysis showed a median reproducibility error of 20%[IQR = 41] for LGA-SPM8, 14% [31] for LGA-SPM12 and 10% [27] with the LPA cross-sectional pipeline. Applying the LST longitudinal pipeline, the reproducibility errors were considerably reduced (LGA: 0%[IQR = 0], p < 0.001; LPA: 0% [3], p < 0.001) compared to those derived using the cross-sectional algorithms. The DC using the longitudinal pipeline was excellent (median = 1) for LGA [IQR = 0] and LPA [0.02]. LST algorithms showed moderate accuracy and good reproducibility. Therefore, it can be used as a reliable cross-sectional and longitudinal tool in multi-site studies.
2021
Ribaldi, Federica; Altomare, Daniele; Jovicich, Jorge; Ferrari, Clarissa; Picco, Agnese; Pizzini, Francesca Benedetta; Soricelli, Andrea; Mega, Anna; ...espandi
Accuracy and reproducibility of automated white matter hyperintensities segmentation with lesion segmentation tool: A European multi-site 3T study / Ribaldi, Federica; Altomare, Daniele; Jovicich, Jorge; Ferrari, Clarissa; Picco, Agnese; Pizzini, Francesca Benedetta; Soricelli, Andrea; Mega, Anna; Ferretti, Antonio; Drevelegas, Antonios; Bosch, Beatriz; Müller, Bernhard W.; Marra, Camillo; Cavaliere, Carlo; Bartrés-Faz, David; Nobili, Flavio; Alessandrini, Franco; Barkhof, Frederik; Gros-Dagnac, Helene; Ranjeva, Jean-Philippe; Wiltfang, Jens; Kuijer, Joost; Sein, Julien; Hoffmann, Karl-Titus; Roccatagliata, Luca; Parnetti, Lucilla; Tsolaki, Magda; Constantinidis, Manos; Aiello, Marco; Salvatore, Marco; Montalti, Martina; Caulo, Massimo; Didic, Mira; Bargallo, Núria; Blin, Olivier; Rossini, Paolo M; Schonknecht, Peter; Floridi, Piero; Payoux, Pierre; Visser, Pieter Jelle; Bordet, Régis; Lopes, Renaud; Tarducci, Roberto; Bombois, Stephanie; Hensch, Tilman; Fiedler, Ute; Richardson, Jill C.; Frisoni, Giovanni B.; Marizzoni, Moira. - In: MAGNETIC RESONANCE IMAGING. - ISSN 0730-725X. - 76:(2021), pp. 108-115. [10.1016/j.mri.2020.11.008]
File in questo prodotto:
File Dimensione Formato  
Ribaldi et al., JMRI 2020, Accuracy and reproducibility of white hyperintensities segmentation.pdf

Solo gestori archivio

Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 1.91 MB
Formato Adobe PDF
1.91 MB Adobe PDF   Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/287477
Citazioni
  • ???jsp.display-item.citation.pmc??? 16
  • Scopus 24
  • ???jsp.display-item.citation.isi??? 24
  • OpenAlex ND
social impact