Presently, pseudo-labeling stands as a prevailing approach in cross-domain semantic segmentation, enhancing model efficacy by training with pixels assigned with reliable pseudo-labels. However, we identify two key limitations within this paradigm: (1) under relatively severe domain shifts, most selected reliable pixels appear speckled and remain noisy. (2) when dealing with wild data, some pixels belonging to the open-set class may exhibit high confidence and also appear speckled. These two points make it difficult for the pixel-level selection mechanism to identify and correct these speckled close- and open-set noises. As a result, error accumulation is continuously introduced into subsequent self-training, leading to inefficiencies in pseudo-labeling. To address these limitations, we propose a novel method called Semantic Connectivity-driven Pseudo-labeling (SeCo). SeCo formulates pseudo-labels at the connectivity level, which makes it easier to locate and correct closed and open set...

Connectivity-Driven Pseudo-Labeling Makes Stronger Cross-Domain Segmenters / Zhao, Dong; Zang, Qi; Wang, Shuang; Sebe, Nicu; Zhong, Zhun. - 37:(2024). ( 38th Conference on Neural Information Processing Systems, NeurIPS 2024 Vancouver, Canada December 2024) [10.52202/079017-2506].

Connectivity-Driven Pseudo-Labeling Makes Stronger Cross-Domain Segmenters

Nicu Sebe;Zhun Zhong
2024-01-01

Abstract

Presently, pseudo-labeling stands as a prevailing approach in cross-domain semantic segmentation, enhancing model efficacy by training with pixels assigned with reliable pseudo-labels. However, we identify two key limitations within this paradigm: (1) under relatively severe domain shifts, most selected reliable pixels appear speckled and remain noisy. (2) when dealing with wild data, some pixels belonging to the open-set class may exhibit high confidence and also appear speckled. These two points make it difficult for the pixel-level selection mechanism to identify and correct these speckled close- and open-set noises. As a result, error accumulation is continuously introduced into subsequent self-training, leading to inefficiencies in pseudo-labeling. To address these limitations, we propose a novel method called Semantic Connectivity-driven Pseudo-labeling (SeCo). SeCo formulates pseudo-labels at the connectivity level, which makes it easier to locate and correct closed and open set...
2024
38th Conference on Neural Information Processing Systems (NeurIPS 2024)
New York
Neural information processing systems foundation
Zhao, Dong; Zang, Qi; Wang, Shuang; Sebe, Nicu; Zhong, Zhun
Connectivity-Driven Pseudo-Labeling Makes Stronger Cross-Domain Segmenters / Zhao, Dong; Zang, Qi; Wang, Shuang; Sebe, Nicu; Zhong, Zhun. - 37:(2024). ( 38th Conference on Neural Information Processing Systems, NeurIPS 2024 Vancouver, Canada December 2024) [10.52202/079017-2506].
File in questo prodotto:
File Dimensione Formato  
5556_Connectivity_Driven_Pseud.pdf

accesso aperto

Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Creative commons
Dimensione 8.26 MB
Formato Adobe PDF
8.26 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/442616
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 2
  • ???jsp.display-item.citation.isi??? ND
  • OpenAlex 0
social impact