A Supramodal Neural Network for Speech and Gesture Semantics: An fMRI Study

Straube, Benjamin; Green, Antonia; Weis, Susanne; Kircher, Tilo

Abstract

In a natural setting, speech is often accompanied by gestures. As language, speech-accompanying iconic gestures to some extent convey semantic information. However, if comprehension of the information contained in both the auditory and visual modality depends on same or different brain-networks is quite unknown. In this fMRI study, we aimed at identifying the cortical areas engaged in supramodal processing of semantic information. BOLD changes were recorded in 18 healthy right-handed male subjects watching video clips showing an actor who either performed speech (S, acoustic) or gestures (G, visual) in more (+) or less (−) meaningful varieties. In the experimental conditions familiar speech or isolated iconic gestures were presented; during the visual control condition the volunteers watched meaningless gestures (G−), while during the acoustic control condition a foreign language was presented (S−). The conjunction of the visual and acoustic semantic processing revealed activations extending from the left inferior frontal gyrus to the precentral gyrus, and included bilateral posterior temporal regions. We conclude that proclaiming this frontotemporal network the brain's core language system is to take too narrow a view. Our results rather indicate that these regions constitute a supramodal semantic processing network.

Citation

Straube, B., Green, A., Weis, S., & Kircher, T. (2012). A Supramodal Neural Network for Speech and Gesture Semantics: An fMRI Study. PLoS ONE, 7(11), Article e51207. https://doi.org/10.1371/journal.pone.0051207

• Journal Article Type: Article
• Acceptance Date: Oct 30, 2012
• Online Publication Date: Nov 30, 2012
• Publication Date: Nov 30, 2012
• Deposit Date: May 15, 2018
• Publicly Available Date: May 15, 2018
• Journal: PLoS ONE
• Electronic ISSN: 1932-6203
• Publisher: Public Library of Science
• Peer Reviewed: Peer Reviewed
• Volume: 7
• Issue: 11
• Article Number: e51207
• DOI: https://doi.org/10.1371/journal.pone.0051207
• Public URL: https://durham-repository.worktribe.com/output/1358981