Feeling Colours: Crossmodal Correspondences Between Tangible 3D Objects, Colours and Emotions

Lin, Anan; Scheller, Meike; Feng, Feng; Proulx, Michael J; Metatla, Oussama

Abstract

With increasing interest in multisensory experiences in HCI there is a need to consider the potential impact of crossmodal correspondences (CCs) between sensory modalities on perception and interpretation. We investigated CCs between active haptic experiences of tangible 3D objects, visual colour and emotion using the “Bouba/Kiki” paradigm. We asked 30 participants to assign colours and emotional categories to 3D-printed objects with varying degrees of angularity and complexity. We found tendencies to associate high degrees of complexity and angularity with red colours, low brightness and high arousal levels. Less complex round shapes were associated with blue colours, high brightness and positive valence levels. These findings contrast previously reported crossmodal effects triggered by 2D shapes of similar angularity and complexity, suggesting that designers cannot simply extrapolate potential perceptual and interpretive experiences elicited by 2D shapes to seemingly similar 3D tangible objects. Instead, we propose a design space for creating tangible multisensory artefacts that can trigger specific emotional percepts and discuss implications for exploiting CCs in the design of interactive technology.

Citation

Lin, A., Scheller, M., Feng, F., Proulx, M. J., & Metatla, O. (2021, May). Feeling Colours: Crossmodal Correspondences Between Tangible 3D Objects, Colours and Emotions. Presented at Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan

• Presentation Conference Type: Conference Paper (published)
• Conference Name: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
• Start Date: May 8, 2021
• End Date: May 13, 2021
• Online Publication Date: May 10, 2021
• Publication Date: 2021-05
• Deposit Date: Mar 11, 2022
• Publisher: Association for Computing Machinery (ACM)
• Pages: 1-12
• Book Title: CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
• Chapter Number: 187
• ISBN: 9781450380966
• DOI: https://doi.org/10.1145/3411764.3445373
• Public URL: https://durham-repository.worktribe.com/output/1137492
• Related Public URLs: https://abdn.pure.elsevier.com/en/publications/feeling-colours-investigating-crossmodal-correspondences-between-