CINECA IRIS Institutional Research Information System

IRIS è l'Anagrafe della ricerca dell'Università degli Studi di Trento, e ha lo scopo di raccogliere, documentare, conservare e diffondere, anche ad accesso aperto, la produzione scientifica degli autori afferenti all'Università degli Studi di Trento.

Visible thermal person re-identification (VT-REID) is an important and challenging task in that 1) weak lighting environments are inevitably encountered in real-world settings and 2) the inter-modality discrepancy is serious. Most existing methods either aim at reducing the cross-modality gap in pixel- and feature-level or optimizing cross-modality network by metric learning techniques. However, few works have jointly considered these two aspects and studied their mutual benefits. In this paper, we design a novel framework to jointly bridge the modality gap in pixel- and feature-level without additional parameters, as well as reduce the inter- and intra-modalities variations by a center-guided metric learning constraint. Specifically, we introduce the Class-aware Modality Mix (CMM) to generate internal information of the two modalities for reducing the modality gap in pixel-level. In addition, we exploit the KL-divergence to further align modality distributions on feature-level. On the other hand, we propose an efficient Center-guided Metric Learning (CML) method for decreasing the discrepancy within the inter- and intra-modalities, by enforcing constraints on class centers and instances. Extensive experiments on two datasets show the mutual advantage of the proposed components and demonstrate the superiority of our method over the state of the art.

Class-Aware Modality Mix and Center-Guided Metric Learning for Visible-Thermal Person Re-Identification / Ling, Yongguo; Zhong, Zhun; Luo, Zhiming; Rota, Paolo; Li, Shaozi; Sebe, Nicu. - (2020), pp. 889-897. ((Intervento presentato al convegno ACM International Conference on Multimedia (ACM MM) tenutosi a online nel October 2020 [10.1145/3394171.3413821].

Powered by IRIS-about IRIS-Utilizzo dei cookie

 Copyright © 2022