While deep learning architectures have become the standard for remote sensing image classification, most existing frameworks adopt a flat classification paradigm. These approaches often overlook the inherent semantic dependencies within predefined label hierarchies, focusing exclusively on fine-grained labels and failing to exploit the topological structure of the taxonomy. This paper proposes the Semantics-Aware Hierarchical Consensus (SAHC) method, a novel framework designed to explicitly model hierarchical relationships by integrating granularity-specific classification heads into a unified architecture. Unlike rigid rule-based systems, the proposed approach utilizes trainable hierarchy matrices that parameterize the transitions between taxonomic levels, enabling the network to learn the structural mapping between coarse and fine categories in a self-consistent, data-driven manner. Furthermore, we introduce a hierarchical consensus mechanism to align probability distributions across various levels of the taxonomy. This mechanism acts as a learned weighted ensemble that regularizes the feature space by leveraging inherent class dependencies, effectively reducing semantic ambiguity in complex scenes. The SAHC framework is evaluated on a benchmark RS dataset characterized by a complex taxonomy using diverse convolutional and transformer-based backbones. Experimental results demonstrate that SAHC significantly improves classification robustness and feature discriminability, outperforming traditional flat-labeling approaches across multiple evaluation metrics.

A Self-Consistent Approach to Hierarchical Remote Sensing Image Classification / Weikmann, G., Perantoni, G., Bruzzone, L.. - ELETTRONICO. - (2026), pp. 4979-4983. (IGARSS 2026 Washington, DC, USA 9th August-14th August 2026) [10.1109/igarss60577.2026.11730329].

A Self-Consistent Approach to Hierarchical Remote Sensing Image Classification

Weikmann, Giulio;Perantoni, Gianmarco;Bruzzone, Lorenzo
2026-01-01

Abstract

While deep learning architectures have become the standard for remote sensing image classification, most existing frameworks adopt a flat classification paradigm. These approaches often overlook the inherent semantic dependencies within predefined label hierarchies, focusing exclusively on fine-grained labels and failing to exploit the topological structure of the taxonomy. This paper proposes the Semantics-Aware Hierarchical Consensus (SAHC) method, a novel framework designed to explicitly model hierarchical relationships by integrating granularity-specific classification heads into a unified architecture. Unlike rigid rule-based systems, the proposed approach utilizes trainable hierarchy matrices that parameterize the transitions between taxonomic levels, enabling the network to learn the structural mapping between coarse and fine categories in a self-consistent, data-driven manner. Furthermore, we introduce a hierarchical consensus mechanism to align probability distributions across various levels of the taxonomy. This mechanism acts as a learned weighted ensemble that regularizes the feature space by leveraging inherent class dependencies, effectively reducing semantic ambiguity in complex scenes. The SAHC framework is evaluated on a benchmark RS dataset characterized by a complex taxonomy using diverse convolutional and transformer-based backbones. Experimental results demonstrate that SAHC significantly improves classification robustness and feature discriminability, outperforming traditional flat-labeling approaches across multiple evaluation metrics.
2026
IGARSS 2026 - 2026 IEEE International Geoscience and Remote Sensing Symposium
Piscataway, NJ, USA
IEEE
979-8-3195-0862-1
Settore ING-INF/03 - Telecomunicazioni
Settore IINF-03/A - Telecomunicazioni
Weikmann, Giulio; Perantoni, Gianmarco; Bruzzone, Lorenzo
A Self-Consistent Approach to Hierarchical Remote Sensing Image Classification / Weikmann, G., Perantoni, G., Bruzzone, L.. - ELETTRONICO. - (2026), pp. 4979-4983. (IGARSS 2026 Washington, DC, USA 9th August-14th August 2026) [10.1109/igarss60577.2026.11730329].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/510431
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
  • OpenAlex ND
social impact