While convolutional neural networks have brought significant advances in robot vision, their ability is often limited to closed world scenarios, where the number of semantic concepts to be recognized is determined by the available training set. Since it is practically impossible to capture all possible semantic concepts present in the real world in a single training set, we need to break the closed world assumption, equipping our robot with the capability to act in an open world. To provide such ability, a robot vision system should be able to (i) identify whether an instance does not belong to the set of known categories (i.e., open set recognition), and (ii) extend its knowledge to learn new classes over time (i.e., incremental learning). In this work, we show how we can boost the performance of deep open world recognition algorithms by means of a new loss formulation enforcing a global to local clustering of class-specific features. In particular, a first loss term, i.e., global clustering, forces the network to map samples closer to the class centroid they belong to while the second one, local clustering, shapes the representation space in such a way that samples of the same class get closer in the representation space while pushing away neighbours belonging to other classes. Moreover, we propose a strategy to learn class-specific rejection thresholds, instead of heuristically estimating a single global threshold, as in previous works. Experiments on three benchmarks show the effectiveness of our approach.
Boosting Deep Open World Recognition by Clustering / Fontanel, D.; Cermelli, F.; Mancini, M.; Bulo, S. R.; Ricci, E.; Caputo, B.. - In: IEEE ROBOTICS AND AUTOMATION LETTERS. - ISSN 2377-3766. - 5:4(2020), pp. 5985-5992.
Scheda prodotto non validato
I dati visualizzati non sono stati ancora sottoposti a validazione formale da parte dello Staff di IRIS, ma sono stati ugualmente trasmessi al Sito Docente Cineca (Loginmiur).
Titolo: | Boosting Deep Open World Recognition by Clustering | |
Autori: | Fontanel, D.; Cermelli, F.; Mancini, M.; Bulo, S. R.; Ricci, E.; Caputo, B. | |
Autori Unitn: | ||
Titolo del periodico: | IEEE ROBOTICS AND AUTOMATION LETTERS | |
Anno di pubblicazione: | 2020 | |
Numero e parte del fascicolo: | 4 | |
Codice identificativo Scopus: | 2-s2.0-85089352603 | |
Codice identificativo WOS: | WOS:000554894900022 | |
Digital Object Identifier (DOI): | http://dx.doi.org/10.1109/LRA.2020.3010753 | |
Handle: | http://hdl.handle.net/11572/277813 | |
Citazione: | Boosting Deep Open World Recognition by Clustering / Fontanel, D.; Cermelli, F.; Mancini, M.; Bulo, S. R.; Ricci, E.; Caputo, B.. - In: IEEE ROBOTICS AND AUTOMATION LETTERS. - ISSN 2377-3766. - 5:4(2020), pp. 5985-5992. | |
Appare nelle tipologie: |