On the Performance of Extended Real-Time Object Detection and Attribute Estimation within Urban Scene Understanding

Ismail, K.N.; Breckon, T.P.

Abstract

Whilst real-time object detection has become an increasingly important task within urban scene understanding for autonomous driving, the majority of prior work concentrates on the detection of obstacles, dynamic scene objects (pedestrians, vehicles) and road sign-age within the scene. By contrast, for an autonomous vehicle to be truly able to interact with occupants and other road users using a common semantic understanding of the environment it is traversing it requires a considerably extended scene understanding capability. In this work, we consider the performance of extended "long-list" object detection, via an extended end-to-end Region-based Convolutional Neural Network (R-CNN) architecture, over a large-scale 31 class detection problem of urban scene objects with integrated object attribute estimation for appropriate colour and primary orientation. We examine the extended performance of this multiple class object detection and attribute estimation task operating in real-time with on-vehicle processing at 10 fps. Our work is evaluated under a range of real-world automotive conditions across multiple complex and cluttered urban environments.

Citation

Ismail, K., & Breckon, T. (2019). On the Performance of Extended Real-Time Object Detection and Attribute Estimation within Urban Scene Understanding. In 2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA), Boca Raton, FL, USA, 2019 (641-646). https://doi.org/10.1109/icmla.2019.00117

• Conference Name: 18th IEEE International Conference on Machine Learning and Applications (ICMLA 2019)
• Conference Location: Boca Raton, Florida, USA
• Start Date: Dec 16, 2019
• End Date: Dec 19, 2019
• Acceptance Date: Sep 21, 2019
• Online Publication Date: Feb 17, 2020
• Publication Date: 2019
• Deposit Date: Dec 20, 2019
• Publicly Available Date: Jun 4, 2020
• Publisher: Institute of Electrical and Electronics Engineers
• Pages: 641-646
• Book Title: 2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA), Boca Raton, FL, USA, 2019.
• DOI: https://doi.org/10.1109/icmla.2019.00117