Over the last few years, a rapid growth has been witnessed in the number of digital photos produced per year. This rapid process poses challenges in the organization and management of multimedia collections, and one viable solution consists of arranging the media on the basis of the underlying events. However, album-level annotation and the presence of irrelevant pictures in photo collections make event-based organization of personal photo albums a more challenging task. To tackle these challenges, in contrast to conventional approaches relying on supervised learning, we propose a pipeline for event recognition in personal photo collections relying on a multiple instance-learning (MIL) strategy. MIL is a modified form of supervised learning and fits well for such applications with weakly labeled data. The experimental evaluation of the proposed approach is carried out on two large-scale datasets including a self-collected and a benchmark dataset. On both, our approach significantly outperforms the existing state-of-the-art.

Event recognition in personal photo collections via multiple instance learning-based classification of multiple images / De Natale, Francesco G. B.; Boato, Giulia; Conci, Nicola; Ahmad, Kashif. - In: JOURNAL OF ELECTRONIC IMAGING. - ISSN 1017-9909. - 26:6(2017), pp. 060502-1-060502-4. [10.1117/1.JEI.26.6.060502]

Event recognition in personal photo collections via multiple instance learning-based classification of multiple images

De Natale, Francesco G. B.;Boato, Giulia;Conci, Nicola;Ahmad, Kashif
2017-01-01

Abstract

Over the last few years, a rapid growth has been witnessed in the number of digital photos produced per year. This rapid process poses challenges in the organization and management of multimedia collections, and one viable solution consists of arranging the media on the basis of the underlying events. However, album-level annotation and the presence of irrelevant pictures in photo collections make event-based organization of personal photo albums a more challenging task. To tackle these challenges, in contrast to conventional approaches relying on supervised learning, we propose a pipeline for event recognition in personal photo collections relying on a multiple instance-learning (MIL) strategy. MIL is a modified form of supervised learning and fits well for such applications with weakly labeled data. The experimental evaluation of the proposed approach is carried out on two large-scale datasets including a self-collected and a benchmark dataset. On both, our approach significantly outperforms the existing state-of-the-art.
2017
6
De Natale, Francesco G. B.; Boato, Giulia; Conci, Nicola; Ahmad, Kashif
Event recognition in personal photo collections via multiple instance learning-based classification of multiple images / De Natale, Francesco G. B.; Boato, Giulia; Conci, Nicola; Ahmad, Kashif. - In: JOURNAL OF ELECTRONIC IMAGING. - ISSN 1017-9909. - 26:6(2017), pp. 060502-1-060502-4. [10.1117/1.JEI.26.6.060502]
File in questo prodotto:
File Dimensione Formato  
060502_1.pdf

Solo gestori archivio

Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 574.5 kB
Formato Adobe PDF
574.5 kB Adobe PDF   Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/199650
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 4
  • ???jsp.display-item.citation.isi??? 3
social impact