Style Augmentation: Data Augmentation via Style Randomization

Jackson, Philip; Atapour-Abarghouei, Amir; Bonner, Stephen; Breckon, Toby; Obara, Boguslaw

Abstract

We introduce style augmentation, a new form of data augmentation based on random style transfer, for improving the robustness of Convolutional Neural Networks (CNN) over both classification and regression based tasks. During training, style augmentation randomizes texture, contrast and color, while preserving shape and semantic content. This is accomplished by adapting an arbitrary style transfer network to perform style randomization, by sampling target style embeddings from a multivariate normal distribution instead of computing them from a style image. In addition to standard classification experiments, we investigate the effect of style augmentation (and data augmentation generally) on domain transfer tasks. We find that data augmentation significantly improves robustness to domain shift, and can be used as a simple, domain agnostic alternative to domain adaptation. Comparing style augmentation against a mix of seven traditional augmentation techniques, we find that it can be readily combined with them to improve network performance. We validate the efficacy of our technique with domain transfer experiments in classification and monocular depth estimation illustrating superior performance over benchmark tasks

Citation

Jackson, P., Atapour-Abarghouei, A., Bonner, S., Breckon, T., & Obara, B. (2019, June). Style Augmentation: Data Augmentation via Style Randomization. Presented at IEEE/CVF Conference on Computer Vision and Pattern Recognition, Deep Vision, Long Beach, CA, USA

• Presentation Conference Type: Conference Paper (published)
• Conference Name: IEEE/CVF Conference on Computer Vision and Pattern Recognition, Deep Vision
• Start Date: Jun 16, 2019
• End Date: Jun 20, 2019
• Acceptance Date: May 12, 2019
• Publication Date: Jan 1, 2019
• Deposit Date: May 13, 2019
• Publicly Available Date: Nov 13, 2019
• Public URL: https://durham-repository.worktribe.com/output/1142178
• Publisher URL: http://cvpr2019.thecvf.com/