Skip to main content

Research Repository

Advanced Search

“Just Drive”: Colour Bias Mitigation for Semantic Segmentation in the Context of Urban Driving

Stelling, Jack; Atapour-Abarghouei, Amir

“Just Drive”: Colour Bias Mitigation for Semantic Segmentation in the Context of Urban Driving Thumbnail


Jack Stelling


Biases can filter into AI technology without our knowledge. Oftentimes, seminal deep learning networks champion increased accuracy above all else. In this paper, we attempt to alleviate biases encountered by semantic segmentation models in urban driving scenes, via an iteratively trained unlearning algorithm. Convolutional neural networks have been shown to rely on colour and texture rather than geometry. This raises issues when safety-critical applications, such as self-driving cars, encounter images with covariate shift at test time - induced by variations such as lighting changes or seasonality. Conceptual proof of bias unlearning has been shown on simple datasets such as MNIST. However, the strategy has never been applied to the safety-critical domain of pixel-wise semantic segmentation of highly variable training data - such as urban scenes. Trained models for both the baseline and bias unlearning scheme have been tested for performance on colour-manipulated validation sets showing a disparity of up to 85.50% in mIoU from the original RGB images - confirming segmentation networks strongly depend on the colour information in the training data to make their classification. The bias unlearning scheme shows improvements of handling this covariate shift of up to 61% in the best observed case - and performs consistently better at classifying the “human” and “vehicle” classes compared to the baseline model


Stelling, J., & Atapour-Abarghouei, A. (2021). “Just Drive”: Colour Bias Mitigation for Semantic Segmentation in the Context of Urban Driving. .

Conference Name 2021 IEEE International Conference on Big Data (IEEE BigData 2021)
Conference Location Orlando, FL, USA
Start Date Dec 15, 2021
End Date Dec 18, 2021
Acceptance Date Nov 11, 2021
Publication Date 2021
Deposit Date Dec 2, 2021
Publicly Available Date Dec 3, 2021
Publisher Institute of Electrical and Electronics Engineers
ISBN 9781665445993


Accepted Conference Proceeding (22.4 Mb)

Copyright Statement
© 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

You might also like

Downloadable Citations