Separate tracking of objects such as people and the luggages they carry is important for video surveillance applications as it would allow making higher level inferences and timely detection of potential threats. However, this is a challenging problem and in the literature, people and objects they carry are tracked as a single object. In this study, we propose using thermal imagery in addition to the visible band imagery for tracking in indoor applications (such as airports, metro or railway stations). We use adaptive background modeling in association with mean-shift tracking for fully automatic tracking. Trackers are refreshed using the background model to handle occlusion and split and to detect newly emerging objects as well as objects that leave the scene. Visible and thermal domain tracking information are fused to allow tracking of people and the objects they carry separately using their heat signatures. By using the trajectories of these objects, interactions between them could be deduced and potential threats such as abandoning of an object by a person could be detected in real-time. Better tracking performance is also achieved compared to using a single modality as thermal reflection and halo effect which adversely affect tracking are eliminated by the complementing visible band data. The proposed method has been tested on videos containing various scenarios. The experimental results show that the presented method is effective for separate tracking of objects such as people and their belongings and for detecting the interactions in the presence of occlusions. © 2011 SPIE.

Mean-shift tracking for surveillance applications using thermal and visible band data fusion / Beyan, C.; Temizel, A.. - 8020:(2011), p. 802010. (Intervento presentato al convegno Airborne Intelligence, Surveillance, Reconnaissance (ISR) Systems and Applications VIII tenutosi a Orlando, FL, usa nel 2011) [10.1117/12.882838].

Mean-shift tracking for surveillance applications using thermal and visible band data fusion

Beyan C.;
2011-01-01

Abstract

Separate tracking of objects such as people and the luggages they carry is important for video surveillance applications as it would allow making higher level inferences and timely detection of potential threats. However, this is a challenging problem and in the literature, people and objects they carry are tracked as a single object. In this study, we propose using thermal imagery in addition to the visible band imagery for tracking in indoor applications (such as airports, metro or railway stations). We use adaptive background modeling in association with mean-shift tracking for fully automatic tracking. Trackers are refreshed using the background model to handle occlusion and split and to detect newly emerging objects as well as objects that leave the scene. Visible and thermal domain tracking information are fused to allow tracking of people and the objects they carry separately using their heat signatures. By using the trajectories of these objects, interactions between them could be deduced and potential threats such as abandoning of an object by a person could be detected in real-time. Better tracking performance is also achieved compared to using a single modality as thermal reflection and halo effect which adversely affect tracking are eliminated by the complementing visible band data. The proposed method has been tested on videos containing various scenarios. The experimental results show that the presented method is effective for separate tracking of objects such as people and their belongings and for detecting the interactions in the presence of occlusions. © 2011 SPIE.
2011
Proceedings of SPIE - The International Society for Optical Engineering
1000 20TH ST, PO BOX 10, BELLINGHAM, WA 98227-0010 USA
SPIE-INT SOC OPTICAL ENGINEERING
Beyan, C.; Temizel, A.
Mean-shift tracking for surveillance applications using thermal and visible band data fusion / Beyan, C.; Temizel, A.. - 8020:(2011), p. 802010. (Intervento presentato al convegno Airborne Intelligence, Surveillance, Reconnaissance (ISR) Systems and Applications VIII tenutosi a Orlando, FL, usa nel 2011) [10.1117/12.882838].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/298072
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 2
  • ???jsp.display-item.citation.isi??? 1
social impact