2026-09-20T10:37:00Zhttps://iris.unitn.it/oai/request

oai:iris.unitn.it:11572/4589132026-04-03T00:48:37Zcom_11572_237821com_11572_101871col_11572_237822ou_ou00002

Learning without Labels - Reducing Supervision in Training, Inference, and Evaluation of Deep Neural Networks Conti, Alessandro Conti, Alessandro Ricci, Elisa Rota, Paolo Fine-tuning with domain shift, Inference without labels, Automatic benchmarking This thesis investigates how the reliance on supervision can be reduced across the entire deep learning pipeline. In the training phase, we explore unsupervised fine-tuning, focusing on Source-Free Unsupervised Domain Adaptation scenarios in visual tasks such as Facial Expression Recognition and video-based Action Recognition, primarily leveraging self-supervision and self-training. At inference, we address the challenge of removing fixed output vocabularies from Vision Language Models by formalizing the tasks of Vocabulary-free Image Classification and Vocabulary-free Semantic Segmentation and by introducing a family of efficient methods that adapt CLIP to the tasks. We also evaluate Large Multimodal Models under a similar constrained scenario, analyzing their predictions, categorizing their mistakes, and proposing tailored solutions to optimize their performance. Finally, we investigate unsupervised evaluation by proposing a framework that uses a Large Language Model and modular tools to automatically generate, execute, and interpret evaluation experiments for Large Multimodal Models without ground-truth labels. By reducing the need for human supervision at every stage of the deep learning pipeline, this thesis contributes toward a more flexible and efficient paradigm for developing and deploying deep neural networks in real-world, data-scarce, and open-ended settings. 2025-07-17 info:eu-repo/semantics/doctoralThesis https://hdl.handle.net/11572/458913 http://dx.doi.org/10.15168/11572_458913 10.15168/11572_458913 eng firstpage:1 lastpage:195 numberofpages:195 info:eu-repo/semantics/openAccess Università degli studi di Trento place:TRENTO license:Creative commons license uri:http://creativecommons.org/licenses/by-nc-nd/4.0/