Traditional definitions of language resourcedness fail to capture the structural inequalities embedded in LLMs’ pre-training data. While historical classifications rely heavily on sociopolitical vitality, artifacts, and human resources, a language’s real-world robustness no longer guarantees equitable algorithmic representation. To address this disparity, this paper proposes a novel tripartite framework that combines four established exogenous criteria with a relative endogenous quantitative metric: a language must hold a dominant or co-dominant statistical share of an LLM’s pre-training dataset to be classified as high-resource. Under this new paradigm, languages with strong societal infrastructure but marginal AI data representation, such as Italian and German in LLMs like GPT-3, are accurately reclassified as few-resource, while those lacking both real-world and digital infrastructure remain low-resource. Despite industry trends toward data opacity, adopting this precise terminology equips researchers with the tools to expose engineered linguistic disparities, challenge the false equivalence of traditional labels, and advocate for genuinely equitable, multilingual AI systems.

Low-resource language / Valentinelli, P.. - In: AI-LINGUISTICA. - ISSN 2943-0070. - 6:1(2026). [10.62408/ai-ling.v6i1.77]

Low-resource language

Valentinelli Paolo
Primo
2026-01-01

Abstract

Traditional definitions of language resourcedness fail to capture the structural inequalities embedded in LLMs’ pre-training data. While historical classifications rely heavily on sociopolitical vitality, artifacts, and human resources, a language’s real-world robustness no longer guarantees equitable algorithmic representation. To address this disparity, this paper proposes a novel tripartite framework that combines four established exogenous criteria with a relative endogenous quantitative metric: a language must hold a dominant or co-dominant statistical share of an LLM’s pre-training dataset to be classified as high-resource. Under this new paradigm, languages with strong societal infrastructure but marginal AI data representation, such as Italian and German in LLMs like GPT-3, are accurately reclassified as few-resource, while those lacking both real-world and digital infrastructure remain low-resource. Despite industry trends toward data opacity, adopting this precise terminology equips researchers with the tools to expose engineered linguistic disparities, challenge the false equivalence of traditional labels, and advocate for genuinely equitable, multilingual AI systems.
2026
1
Valentinelli, Paolo
Low-resource language / Valentinelli, P.. - In: AI-LINGUISTICA. - ISSN 2943-0070. - 6:1(2026). [10.62408/ai-ling.v6i1.77]
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/494130
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
  • OpenAlex ND
social impact