{"title":"Elevating urban surveillance: A deep CCTV monitoring system for detection of anomalous events via human action recognition","authors":"","doi":"10.1016/j.scs.2024.105793","DOIUrl":null,"url":null,"abstract":"<div><p>In the face of urbanization and the widespread use of CCTV cameras, the processing of surveillance videos has gained importance. This study endeavors to create a city-wide monitoring system utilizing human action recognition that can elevate the social sustainability of citizens. The primary goal is to develop an entire framework to detect unusual events within urban environments, with a specific focus on identifying four aberrant actions: “falling,” “violence,” “loitering,” and “intrusion.”. The processing of CCTV images is vulnerable to adverse weather conditions, particularly impacting human detection and tracking when obstructions like body parts occlusion, such as during falling events. To address these challenges, the paper proposes tracking compensation techniques that boost the system’s ability to detect anomalies without requiring additional training. The proposed approach demonstrates a remarkable 21.21% enhancement in detecting falling events, without compromising its handling of other event types. Overall, the system achieves an impressive average F1 score of 93% across diverse event categories. The system’s effectiveness is thoroughly assessed through an extensive subway domain case study, shedding light on its robustness and adaptability for potential real-world deployment. This study also delves into transfer learning dynamics based on sample quantity and pre-training with relevant human-of-interest data.</p></div>","PeriodicalId":48659,"journal":{"name":"Sustainable Cities and Society","volume":null,"pages":null},"PeriodicalIF":10.5000,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Sustainable Cities and Society","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2210670724006176","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CONSTRUCTION & BUILDING TECHNOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
In the face of urbanization and the widespread use of CCTV cameras, the processing of surveillance videos has gained importance. This study endeavors to create a city-wide monitoring system utilizing human action recognition that can elevate the social sustainability of citizens. The primary goal is to develop an entire framework to detect unusual events within urban environments, with a specific focus on identifying four aberrant actions: “falling,” “violence,” “loitering,” and “intrusion.”. The processing of CCTV images is vulnerable to adverse weather conditions, particularly impacting human detection and tracking when obstructions like body parts occlusion, such as during falling events. To address these challenges, the paper proposes tracking compensation techniques that boost the system’s ability to detect anomalies without requiring additional training. The proposed approach demonstrates a remarkable 21.21% enhancement in detecting falling events, without compromising its handling of other event types. Overall, the system achieves an impressive average F1 score of 93% across diverse event categories. The system’s effectiveness is thoroughly assessed through an extensive subway domain case study, shedding light on its robustness and adaptability for potential real-world deployment. This study also delves into transfer learning dynamics based on sample quantity and pre-training with relevant human-of-interest data.
期刊介绍:
Sustainable Cities and Society (SCS) is an international journal that focuses on fundamental and applied research to promote environmentally sustainable and socially resilient cities. The journal welcomes cross-cutting, multi-disciplinary research in various areas, including:
1. Smart cities and resilient environments;
2. Alternative/clean energy sources, energy distribution, distributed energy generation, and energy demand reduction/management;
3. Monitoring and improving air quality in built environment and cities (e.g., healthy built environment and air quality management);
4. Energy efficient, low/zero carbon, and green buildings/communities;
5. Climate change mitigation and adaptation in urban environments;
6. Green infrastructure and BMPs;
7. Environmental Footprint accounting and management;
8. Urban agriculture and forestry;
9. ICT, smart grid and intelligent infrastructure;
10. Urban design/planning, regulations, legislation, certification, economics, and policy;
11. Social aspects, impacts and resiliency of cities;
12. Behavior monitoring, analysis and change within urban communities;
13. Health monitoring and improvement;
14. Nexus issues related to sustainable cities and societies;
15. Smart city governance;
16. Decision Support Systems for trade-off and uncertainty analysis for improved management of cities and society;
17. Big data, machine learning, and artificial intelligence applications and case studies;
18. Critical infrastructure protection, including security, privacy, forensics, and reliability issues of cyber-physical systems.
19. Water footprint reduction and urban water distribution, harvesting, treatment, reuse and management;
20. Waste reduction and recycling;
21. Wastewater collection, treatment and recycling;
22. Smart, clean and healthy transportation systems and infrastructure;