Skip to main content

Research Repository

Advanced Search

Processing Speech and Thoughts during Silent Reading: Direct Reference Effects for Speech by Fictional Characters in Voice-Selective Auditory Cortex and a Theory-of-Mind Network

Alderson-Day, Ben; Moffatt, Jamie; Bernini, Marco; Mitrenga, Kaja; Yao, Bo; Fernyhough, Charles

Processing Speech and Thoughts during Silent Reading: Direct Reference Effects for Speech by Fictional Characters in Voice-Selective Auditory Cortex and a Theory-of-Mind Network Thumbnail


Authors

Jamie Moffatt

Kaja Mitrenga

Bo Yao



Abstract

Stories transport readers into vivid imaginative worlds, but understanding how readers create such worlds—populating them with characters, objects, and events—presents serious challenges across disciplines. Auditory imagery is thought to play a prominent role in this process, especially when representing characters' voices. Previous research has shown that direct reference to speech in stories (e.g., He said, “I'm over here”) may prompt spontaneous activation of voice-selective auditory cortex more than indirect speech [Yao, B., Belin, P., & Scheepers, C. Silent reading of direct versus indirect speech activates voice-selective areas in the auditory cortex. Journal of Cognitive Neuroscience, 23, 3146–3152, 2011]. However, it is unclear whether this effect reflects differential processing of speech or differences in linguistic content, source memory, or grammar. One way to test this is to compare direct reference effects for characters speaking and thinking in a story. Here, we present a multidisciplinary fMRI study of 21 readers' responses to characters' speech and thoughts during silent reading of short fictional stories. Activations relating to direct and indirect references were compared for both speaking and thinking. Eye-tracking and independent localizer tasks (auditory cortex and theory of mind [ToM]) established ROIs in which responses to stories could be tracked for individuals. Evidence of elevated auditory cortex responses to direct speech over indirect speech was observed, replicating previously reported effects; no reference effect was observed for thoughts. Moreover, a direct reference effect specific to speech was also evident in regions previously associated with inferring intentions from communication. Implications are discussed for the spontaneous representation of fictional characters and the potential roles of inner speech and ToM in this process.

Citation

Alderson-Day, B., Moffatt, J., Bernini, M., Mitrenga, K., Yao, B., & Fernyhough, C. (2020). Processing Speech and Thoughts during Silent Reading: Direct Reference Effects for Speech by Fictional Characters in Voice-Selective Auditory Cortex and a Theory-of-Mind Network. The Journal of Cognitive Neuroscience, 32(9), 1637-1653. https://doi.org/10.1162/jocn_a_01571

Journal Article Type Article
Acceptance Date Apr 6, 2020
Online Publication Date Jul 31, 2020
Publication Date 2020
Deposit Date May 12, 2020
Publicly Available Date May 13, 2020
Journal Journal of Cognitive Neuroscience
Print ISSN 0898-929X
Electronic ISSN 1530-8898
Publisher Massachusetts Institute of Technology Press
Peer Reviewed Peer Reviewed
Volume 32
Issue 9
Pages 1637-1653
DOI https://doi.org/10.1162/jocn_a_01571

Files


Accepted Journal Article (708 Kb)
PDF

Copyright Statement
© 2020 Massachusetts Institute of Technology. Published under a
Creative Commons Attribution 4.0 International (CC BY 4.0) license







You might also like



Downloadable Citations