The advent of powerful neural classifiers has increased interest in problems that require both learning and reasoning. These problems are critical for understanding important properties of models, such as trustworthiness, generalization, interpretability, and compliance to safety and structural constraints. However, recent research observed that tasks requiring both learning and reasoning on background knowledge often suffer from reasoning shortcuts (RSs): predictors can solve the downstream reasoning task without associating the correct concepts to the high-dimensional data. To address this issue, we introduce rsbench, a comprehensive benchmark suite designed to systematically evaluate the impact of RSs on models by providing easy access to highly customizable tasks affected by RSs. Furthermore, rsbench implements common metrics for evaluating concept quality and introduces novel formal verification procedures for assessing the presence of RSs in learning tasks. Using rsbench, we highlight that obtaining high quality concepts in both purely neural and neuro-symbolic models is a far-from-solved problem. rsbench is available at: https://unitn-sml.github.io/rsbench.

A Neuro-Symbolic Benchmark Suite for Concept Quality and Reasoning Shortcuts / Bortolotti, Samuele; Marconato, Emanuele; Carraro, Tommaso; Morettin, Paolo; van Krieken, Emile; Vergari, Antonio; Teso, Stefano; Passerini, Andrea. - 37:(2024). (Intervento presentato al convegno NeurIPS 2024 tenutosi a Vancouver, British Columbia, CA nel 10th 10th December-15th December 2024).

A Neuro-Symbolic Benchmark Suite for Concept Quality and Reasoning Shortcuts

Bortolotti, Samuele
Co-primo
;
Marconato, Emanuele
Co-primo
;
Morettin, Paolo
Penultimo
;
Vergari, Antonio
Co-ultimo
;
Teso, Stefano
Co-ultimo
;
Passerini, Andrea
Co-ultimo
2024-01-01

Abstract

The advent of powerful neural classifiers has increased interest in problems that require both learning and reasoning. These problems are critical for understanding important properties of models, such as trustworthiness, generalization, interpretability, and compliance to safety and structural constraints. However, recent research observed that tasks requiring both learning and reasoning on background knowledge often suffer from reasoning shortcuts (RSs): predictors can solve the downstream reasoning task without associating the correct concepts to the high-dimensional data. To address this issue, we introduce rsbench, a comprehensive benchmark suite designed to systematically evaluate the impact of RSs on models by providing easy access to highly customizable tasks affected by RSs. Furthermore, rsbench implements common metrics for evaluating concept quality and introduces novel formal verification procedures for assessing the presence of RSs in learning tasks. Using rsbench, we highlight that obtaining high quality concepts in both purely neural and neuro-symbolic models is a far-from-solved problem. rsbench is available at: https://unitn-sml.github.io/rsbench.
2024
Advances in Neural Information Processing Systems 37 (NeurIPS 2024)
San Diego, CA
Neural Information Processing Systems Foundation, Inc. (NeurIPS)
Bortolotti, Samuele; Marconato, Emanuele; Carraro, Tommaso; Morettin, Paolo; van Krieken, Emile; Vergari, Antonio; Teso, Stefano; Passerini, Andrea...espandi
A Neuro-Symbolic Benchmark Suite for Concept Quality and Reasoning Shortcuts / Bortolotti, Samuele; Marconato, Emanuele; Carraro, Tommaso; Morettin, Paolo; van Krieken, Emile; Vergari, Antonio; Teso, Stefano; Passerini, Andrea. - 37:(2024). (Intervento presentato al convegno NeurIPS 2024 tenutosi a Vancouver, British Columbia, CA nel 10th 10th December-15th December 2024).
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/437510
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
  • OpenAlex ND
social impact