Crowd Descriptors and Interpretable Gathering Understanding

Zhou, Yuxin; Liu, Chenguang; Ding, Yulong; Yuan, Diping; Yin, Jiyao; Yang, Shuang-Hua

Abstract

Crowd gathering events deeply affect public safety. To enhance city management and avoid potential risks, many algorithms are designed for crowd analysis and deployed on video surveillance. Widely applied deep learning models also can be trained for crowd analysis. However, there are still few works focusing on crowd gathering behavior. Furthermore, as a result of the lack of interpretability of deep learning models, which also brings potential risk of being rejected by the users. In this paper, we categorize crowd behaviors into wandering, merging, walking gathering, standing gathering, and dispersing. Also, we propose an interpretable framework for crowd gathering understanding based on crowd density estimation model and proposed crowd descriptors, named Irregularity, Sparsity, Randomness, and Volatility. The experiments on the PETS2009 dataset demonstrate our method has outperformed the previous works on the crowd gathering understanding task. Moreover, we further analyze the framework performance with different crowd feature extraction models and the relations between our descriptors and crowd behavior. Besides, an ablation study is conducted to investigate the effectiveness of the descriptors and differences between density estimation models. The results demonstrate the effectiveness and the much better interpretability of our framework. Our descriptors also show significant contributions to the quantification of crowd gathering behaviors.

Citation

Zhou, Y., Liu, C., Ding, Y., Yuan, D., Yin, J., & Yang, S.-H. (2024). Crowd Descriptors and Interpretable Gathering Understanding. IEEE Transactions on Multimedia, 26, 8651-8664. https://doi.org/10.1109/tmm.2024.3381040

• Journal Article Type: Article
• Acceptance Date: Mar 12, 2024
• Online Publication Date: Mar 22, 2024
• Publication Date: Mar 22, 2024
• Deposit Date: Jun 10, 2024
• Publicly Available Date: Jun 10, 2024
• Journal: IEEE Transactions on Multimedia
• Print ISSN: 1520-9210
• Electronic ISSN: 1941-0077
• Publisher: Institute of Electrical and Electronics Engineers
• Peer Reviewed: Peer Reviewed
• Volume: 26
• Pages: 8651-8664
• DOI: https://doi.org/10.1109/tmm.2024.3381040
• Public URL: https://durham-repository.worktribe.com/output/2346980