TY - JOUR
T1 - Cooperative object tracking and composite event detection with wireless embedded smart cameras
AU - Wang, Youlu
AU - Velipasalar, Senem
AU - Casares, Mauricio
N1 - Funding Information:
Manuscript received September 29, 2009; revised February 25, 2010 and May 18, 2010; accepted May 18, 2010. Date of publication June 14, 2010; date of current version September 17, 2010. This work was supported in part by the National Science Foundation Grant CNS 0834753. The associate editor coordinating the review of this manuscript and approving it for publication was Prof. Janusz Konrad.
PY - 2010/10
Y1 - 2010/10
N2 - Embedded smart cameras have limited processing power, memory, energy, and bandwidth. Thus, many systemand algorithm-wise challenges remain to be addressed to have operational, battery-powered wireless smart-camera networks. We present a wireless embedded smart-camera system for cooperative object tracking and detection of composite events spanning multiple camera views. Each camera is a CITRIC mote consisting of a camera board and wireless mote. Lightweight and robust foreground detection and tracking algorithms are implemented on the camera boards. Cameras exchange small-sized data wirelessly in a peer-to-peer manner. Instead of transferring or saving every frame or trajectory, events of interest are detected. Simpler events are combined in a time sequence to define semantically higher-level events. Event complexity can be increased by increasing the number of primitives and/or number of camera views they span. Examples of consistently tracking objects across different cameras, updating location of occluded/lost objects from other cameras, and detecting composite events spanning two or three camera views, are presented. All the processing is performed on camera boards. Operating current plots of smart cameras, obtained when performing different tasks, are also presented. Power consumption is analyzed based upon these measurements.
AB - Embedded smart cameras have limited processing power, memory, energy, and bandwidth. Thus, many systemand algorithm-wise challenges remain to be addressed to have operational, battery-powered wireless smart-camera networks. We present a wireless embedded smart-camera system for cooperative object tracking and detection of composite events spanning multiple camera views. Each camera is a CITRIC mote consisting of a camera board and wireless mote. Lightweight and robust foreground detection and tracking algorithms are implemented on the camera boards. Cameras exchange small-sized data wirelessly in a peer-to-peer manner. Instead of transferring or saving every frame or trajectory, events of interest are detected. Simpler events are combined in a time sequence to define semantically higher-level events. Event complexity can be increased by increasing the number of primitives and/or number of camera views they span. Examples of consistently tracking objects across different cameras, updating location of occluded/lost objects from other cameras, and detecting composite events spanning two or three camera views, are presented. All the processing is performed on camera boards. Operating current plots of smart cameras, obtained when performing different tasks, are also presented. Power consumption is analyzed based upon these measurements.
KW - Composite event
KW - Embedded
KW - Event detection
KW - Multiobject tracking
KW - Smart camera
KW - Spatio-temporal
KW - Wireless communication
UR - http://www.scopus.com/inward/record.url?scp=77956922963&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=77956922963&partnerID=8YFLogxK
U2 - 10.1109/TIP.2010.2052278
DO - 10.1109/TIP.2010.2052278
M3 - Article
C2 - 20551001
AN - SCOPUS:77956922963
SN - 1057-7149
VL - 19
SP - 2614
EP - 2633
JO - IEEE Transactions on Image Processing
JF - IEEE Transactions on Image Processing
IS - 10
ER -