This paper presents solo-learn, a library of self-supervised methods for visual representation learning. Implemented in Python, using Pytorch and Pytorch lightning, the library fits both research and industry needs by featuring distributed training pipelines with mixed-precision, faster data loading via Nvidia DALI, online linear evaluation for better prototyping, and many additional training tricks. Our goal is to provide an easy-to-use library comprising a large amount of Self-supervised Learning (SSL) methods, that can be easily extended and fine-tuned by the community. solo-learn opens up avenues for exploiting large-budget SSL solutions on inexpensive smaller infrastructures and seeks to democratize SSL by making it accessible to all. The source code is available at https://github.com/vturrisi/solo-learn.

solo-learn: A Library of Self-supervised Methods for Visual Representation Learning / Turrisi da Costa, V. G.; Fini, E.; Nabi, M.; Sebe, N.; Ricci, E.. - In: JOURNAL OF MACHINE LEARNING RESEARCH. - ISSN 1532-4435. - 23:(2022), pp. 561-566.

solo-learn: A Library of Self-supervised Methods for Visual Representation Learning

Turrisi da Costa V. G.;Fini E.;Nabi M.;Sebe N.;Ricci E.
2022

Abstract

This paper presents solo-learn, a library of self-supervised methods for visual representation learning. Implemented in Python, using Pytorch and Pytorch lightning, the library fits both research and industry needs by featuring distributed training pipelines with mixed-precision, faster data loading via Nvidia DALI, online linear evaluation for better prototyping, and many additional training tricks. Our goal is to provide an easy-to-use library comprising a large amount of Self-supervised Learning (SSL) methods, that can be easily extended and fine-tuned by the community. solo-learn opens up avenues for exploiting large-budget SSL solutions on inexpensive smaller infrastructures and seeks to democratize SSL by making it accessible to all. The source code is available at https://github.com/vturrisi/solo-learn.
Turrisi da Costa, V. G.; Fini, E.; Nabi, M.; Sebe, N.; Ricci, E.
solo-learn: A Library of Self-supervised Methods for Visual Representation Learning / Turrisi da Costa, V. G.; Fini, E.; Nabi, M.; Sebe, N.; Ricci, E.. - In: JOURNAL OF MACHINE LEARNING RESEARCH. - ISSN 1532-4435. - 23:(2022), pp. 561-566.
File in questo prodotto:
File Dimensione Formato  
JMLR22.pdf

accesso aperto

Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Creative commons
Dimensione 298.91 kB
Formato Adobe PDF
298.91 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/11572/340599
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 1
  • ???jsp.display-item.citation.isi??? 1
social impact