Detection of composite events spanning multiple camera views with wireless embedded smart cameras

Youlu Wang, Senem Velipasalar, Mauricio Casares
{"title":"Detection of composite events spanning multiple camera views with wireless embedded smart cameras","authors":"Youlu Wang, Senem Velipasalar, Mauricio Casares","doi":"10.1109/ICDSC.2009.5289355","DOIUrl":null,"url":null,"abstract":"With the introduction of battery-powered and embedded smart cameras, it has become viable to install many spatially-distributed cameras interconnected by wireless links. However, there are many problems that need to be solved to build scalable, battery-powered wireless smart-camera networks (Wi-SCaNs). These problems include the limited processing power, memory, energy and bandwidth. Limited resources necessitate light-weight algorithms to be implemented and run on the embedded cameras, and also careful choice of when and what data to transfer. We present a wireless embedded smart camera system, wherein each camera platform consists of a camera board and a wireless mote, and cameras communicate in a peer-to-peer manner over wireless links. Light-weight background subtraction and tracking algorithms are implemented and run on camera boards. Cameras exchange data to track objects consistently, and also to update locations of lost objects. Since frequent transfer of large-sized data requires more power and incurs more communication delay, transferring all captured frames to a server should be avoided. Another challenge is the limited local memory for storage in camera motes. Thus, instead of transferring or saving every frame or every trajectory, there should be a mechanism to detect events of interest. In the presented system, events of interest can be defined beforehand, and simpler events can be combined in a sequence to define semantically higher-level and composite events. Moreover, event scenarios can span multiple camera views, which make the definition of more complex events possible. Cameras communicate with each other about the portions of a scenario to detect an event that spans different camera views. We present examples of label transfer for consistent tracking, and of updating the location of occluded or lost objects from other cameras by wirelessly exchanging small-sized packets. We also show examples of detecting different composite and spatio-temporal event scenarios spanning multiple camera views. All the processing is performed on the camera boards.","PeriodicalId":324810,"journal":{"name":"2009 Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2009-10-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"8","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2009 Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICDSC.2009.5289355","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 8

Abstract

With the introduction of battery-powered and embedded smart cameras, it has become viable to install many spatially-distributed cameras interconnected by wireless links. However, there are many problems that need to be solved to build scalable, battery-powered wireless smart-camera networks (Wi-SCaNs). These problems include the limited processing power, memory, energy and bandwidth. Limited resources necessitate light-weight algorithms to be implemented and run on the embedded cameras, and also careful choice of when and what data to transfer. We present a wireless embedded smart camera system, wherein each camera platform consists of a camera board and a wireless mote, and cameras communicate in a peer-to-peer manner over wireless links. Light-weight background subtraction and tracking algorithms are implemented and run on camera boards. Cameras exchange data to track objects consistently, and also to update locations of lost objects. Since frequent transfer of large-sized data requires more power and incurs more communication delay, transferring all captured frames to a server should be avoided. Another challenge is the limited local memory for storage in camera motes. Thus, instead of transferring or saving every frame or every trajectory, there should be a mechanism to detect events of interest. In the presented system, events of interest can be defined beforehand, and simpler events can be combined in a sequence to define semantically higher-level and composite events. Moreover, event scenarios can span multiple camera views, which make the definition of more complex events possible. Cameras communicate with each other about the portions of a scenario to detect an event that spans different camera views. We present examples of label transfer for consistent tracking, and of updating the location of occluded or lost objects from other cameras by wirelessly exchanging small-sized packets. We also show examples of detecting different composite and spatio-temporal event scenarios spanning multiple camera views. All the processing is performed on the camera boards.
无线嵌入式智能摄像头跨多个摄像头视图的复合事件检测
随着电池供电和嵌入式智能摄像头的引入,安装许多通过无线链路相互连接的空间分布式摄像头已经成为可能。然而,要建立可扩展的、电池供电的无线智能摄像头网络(wi - scan),还有许多问题需要解决。这些问题包括有限的处理能力、内存、能量和带宽。有限的资源需要在嵌入式摄像机上实现和运行轻量级算法,还需要仔细选择何时以及传输哪些数据。我们提出了一种无线嵌入式智能摄像机系统,其中每个摄像机平台由一个摄像机板和一个无线mote组成,并且摄像机通过无线链路以点对点方式进行通信。轻量背景减法和跟踪算法在相机板上实现和运行。摄像头交换数据以持续跟踪物体,并更新丢失物体的位置。由于频繁地传输大数据需要更多的功率并导致更多的通信延迟,因此应避免将所有捕获的帧传输到服务器。另一个挑战是相机芯片存储的本地内存有限。因此,不是传输或保存每一帧或每一条轨迹,而是应该有一种机制来检测感兴趣的事件。在给出的系统中,可以预先定义感兴趣的事件,并且可以将更简单的事件组合成一个序列,以定义语义上更高级的复合事件。此外,事件场景可以跨越多个摄像机视图,这使得定义更复杂的事件成为可能。摄像机之间就场景的各个部分进行通信,以检测跨越不同摄像机视图的事件。我们给出了标签传输的例子,以实现一致的跟踪,并通过无线交换小尺寸的数据包来更新来自其他摄像机的遮挡或丢失物体的位置。我们还展示了检测跨越多个摄像机视图的不同复合和时空事件场景的示例。所有的处理都在摄像板上完成。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信