Unsupervised Domain Adaptation (UDA) for object detection aims to adapt a model trained on a source domain to detect instances from a new target domain for which annotations are not available. Different from traditional approaches, we propose ConfMix, the first method that introduces a sample mixing strategy based on region-level detection confidence for adaptive object detector learning. We mix the local region of the target sample that corresponds to the most confident pseudo detections with a source image, and apply an additional consistency loss term to gradually adapt towards the target data distribution. In order to robustly define a confidence score for a region, we exploit the confidence score per pseudo detection that accounts for both the detector-dependent confidence and the bounding box uncertainty. Moreover, we propose a novel pseudo labelling scheme that progressively filters the pseudo target detections using the confidence metric that varies from a loose to strict manner along the training. We perform extensive experiments with three datasets, achieving state-of-the-art performance in two of them and approaching the supervised target model performance in the other. Code is available at https://github.com/giuliomattolin/ConfMix.

ConfMix: Unsupervised Domain Adaptation for Object Detection via Confidence-based Mixing / Mattolin, Giulio; Zanella, Luca; Ricci, Elisa; Wang, Yiming. - (2023), pp. 423-433. (Intervento presentato al convegno Winter Conference on Applications of Computer Vision tenutosi a Waikoloa nel 3rd Jan-7th Jan 2023) [10.1109/WACV56688.2023.00050].

ConfMix: Unsupervised Domain Adaptation for Object Detection via Confidence-based Mixing

Zanella, Luca;Ricci, Elisa;Wang, Yiming
2023-01-01

Abstract

Unsupervised Domain Adaptation (UDA) for object detection aims to adapt a model trained on a source domain to detect instances from a new target domain for which annotations are not available. Different from traditional approaches, we propose ConfMix, the first method that introduces a sample mixing strategy based on region-level detection confidence for adaptive object detector learning. We mix the local region of the target sample that corresponds to the most confident pseudo detections with a source image, and apply an additional consistency loss term to gradually adapt towards the target data distribution. In order to robustly define a confidence score for a region, we exploit the confidence score per pseudo detection that accounts for both the detector-dependent confidence and the bounding box uncertainty. Moreover, we propose a novel pseudo labelling scheme that progressively filters the pseudo target detections using the confidence metric that varies from a loose to strict manner along the training. We perform extensive experiments with three datasets, achieving state-of-the-art performance in two of them and approaching the supervised target model performance in the other. Code is available at https://github.com/giuliomattolin/ConfMix.
2023
Proceedings of 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)
10662 LOS VAQUEROS CIRCLE, PO BOX 3014, LOS ALAMITOS, CA 90720-1264 USA
IEEE COMPUTER SOC
978-1-6654-9346-8
Mattolin, Giulio; Zanella, Luca; Ricci, Elisa; Wang, Yiming
ConfMix: Unsupervised Domain Adaptation for Object Detection via Confidence-based Mixing / Mattolin, Giulio; Zanella, Luca; Ricci, Elisa; Wang, Yiming. - (2023), pp. 423-433. (Intervento presentato al convegno Winter Conference on Applications of Computer Vision tenutosi a Waikoloa nel 3rd Jan-7th Jan 2023) [10.1109/WACV56688.2023.00050].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/399530
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 32
  • ???jsp.display-item.citation.isi??? 26
  • OpenAlex ND
social impact