3D point cloud semantic segmentation is fundamental for autonomous driving. Most approaches in the literature neglect an important aspect, i.e., how to deal with domain shift when handling dynamic scenes. This can significantly hinder the navigation capabilities of self-driving vehicles. This paper advances the state of the art in this research field. Our first contribution consists in analysing a new unexplored scenario in point cloud segmentation, namely Source-Free Online Unsupervised Domain Adaptation (SF-OUDA). We experimentally show that state-of-the-art methods have a rather limited ability to adapt pre-trained deep network models to unseen domains in an online manner. Our second contribution is an approach that relies on adaptive self-training and geometric-feature propagation to adapt a pre-trained source model online without requiring either source data or target labels. Our third contribution is to study SF-OUDA in a challenging setup where source data is synthetic and target data is point clouds captured in the real world. We use the recent SynLiDAR dataset as a synthetic source and introduce two new synthetic (source) datasets, which can stimulate future synthetic-to-real autonomous driving research. Our experiments show the effectiveness of our segmentation approach on thousands of real-world point clouds.

GIPSO: Geometrically Informed Propagation for Online Adaptation in 3D LiDAR Segmentation / Saltori, Cristiano; Krivosheev, Evgeny; Lathuiliére, Stéphane; Sebe, Nicu; Galasso, Fabio; Fiameni, Giuseppe; Ricci, Elisa; Poiesi, Fabio. - 13693:(2022), pp. 567-585. (Intervento presentato al convegno European Conference on Computer Vision (ECCV) tenutosi a Tel Aviv nel 23-27 October 2022) [10.1007/978-3-031-19827-4_33].

GIPSO: Geometrically Informed Propagation for Online Adaptation in 3D LiDAR Segmentation

Saltori, Cristiano;Krivosheev, Evgeny;Sebe, Nicu;Ricci, Elisa;Poiesi, Fabio
2022-01-01

Abstract

3D point cloud semantic segmentation is fundamental for autonomous driving. Most approaches in the literature neglect an important aspect, i.e., how to deal with domain shift when handling dynamic scenes. This can significantly hinder the navigation capabilities of self-driving vehicles. This paper advances the state of the art in this research field. Our first contribution consists in analysing a new unexplored scenario in point cloud segmentation, namely Source-Free Online Unsupervised Domain Adaptation (SF-OUDA). We experimentally show that state-of-the-art methods have a rather limited ability to adapt pre-trained deep network models to unseen domains in an online manner. Our second contribution is an approach that relies on adaptive self-training and geometric-feature propagation to adapt a pre-trained source model online without requiring either source data or target labels. Our third contribution is to study SF-OUDA in a challenging setup where source data is synthetic and target data is point clouds captured in the real world. We use the recent SynLiDAR dataset as a synthetic source and introduce two new synthetic (source) datasets, which can stimulate future synthetic-to-real autonomous driving research. Our experiments show the effectiveness of our segmentation approach on thousands of real-world point clouds.
2022
European Conference on Computer Vision (ECCV)
Heidelberg
Springer
978-3-031-19826-7
978-3-031-19827-4
Saltori, Cristiano; Krivosheev, Evgeny; Lathuiliére, Stéphane; Sebe, Nicu; Galasso, Fabio; Fiameni, Giuseppe; Ricci, Elisa; Poiesi, Fabio
GIPSO: Geometrically Informed Propagation for Online Adaptation in 3D LiDAR Segmentation / Saltori, Cristiano; Krivosheev, Evgeny; Lathuiliére, Stéphane; Sebe, Nicu; Galasso, Fabio; Fiameni, Giuseppe; Ricci, Elisa; Poiesi, Fabio. - 13693:(2022), pp. 567-585. (Intervento presentato al convegno European Conference on Computer Vision (ECCV) tenutosi a Tel Aviv nel 23-27 October 2022) [10.1007/978-3-031-19827-4_33].
File in questo prodotto:
File Dimensione Formato  
136930557.pdf

Open Access dal 03/11/2023

Tipologia: Post-print referato (Refereed author’s manuscript)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 6.77 MB
Formato Adobe PDF
6.77 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/361313
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 4
  • ???jsp.display-item.citation.isi??? 1
social impact