Actions Speak No Louder Than Words: Symmetrical Cross-Modal Interference Effects in the Processing of Verbal and Gestural Information

Langton, S.R.H.; O'Malley, C.; Bruce, V.

Abstract

Five experiments are reported that investigate the distribution of selective attention to verbal and nonverbal components of an utterance when conflicting information exists in these channels. A Stroop-type interference paradigm is adopted in which attributes from the verbal and nonverbal dimensions are placed into conflict. Static directional (deictic) gestures and corresponding spoken and written words show symmetrical interference (Experiments 1, 2, and 3), as do directional arrows and spoken words (Experiment 4). This symmetry is maintained when the task is switched from a manual keypress to a verbal naming response (Experiment 5), suggesting the mutual influence of the 2 dimensions is independent of spatial stimulus-response compatibility. It is concluded that the results are consistent with a model of interference in which information from pointing gestures and speech is integrated prior to the response selection stage of processing.

Citation

Langton, S., O'Malley, C., & Bruce, V. (1996). Actions Speak No Louder Than Words: Symmetrical Cross-Modal Interference Effects in the Processing of Verbal and Gestural Information. Journal of Experimental Psychology: Human Perception and Performance, 22(6), 1357-1375. https://doi.org/10.1037/0096-1523.22.6.1357

• Journal Article Type: Article
• Online Publication Date: Dec 31, 1996
• Publication Date: 1996
• Deposit Date: Aug 15, 2018
• Journal: Journal of Experimental Psychology: Human Perception and Performance
• Print ISSN: 0096-1523
• Electronic ISSN: 1939-1277
• Publisher: American Psychological Association
• Volume: 22
• Issue: 6
• Pages: 1357-1375
• DOI: https://doi.org/10.1037/0096-1523.22.6.1357
• Public URL: https://durham-repository.worktribe.com/output/1317439