Multisensory cue combination after sensory loss: audio-visual localization in patients with progressive retinal disease

Garcia, S.E.; Jones, P.R.; Reeve, E.I.; Michaelides, M.; Rubin, G.S.; Nardini, M.

Abstract

Human adults can combine perceptual estimates from different senses to minimize uncertainty, by taking a reliability-weighted average (the maximum likelihood estimate, MLE). Although research has shown that healthy human adults reweight estimates as their reliability changes from one trial to the next, less is known about how humans adapt to gradual long-term changes in sensory reliability. This study assessed whether individuals diagnosed with progressive visual deterioration, due to retinal disease, combined auditory and visual cues to location according to optimal (MLE) predictions. Twelve patients with central visual loss, 10 patients with peripheral visual loss, and 12 normally sighted adults were asked to localize visual and/or auditory targets in central (1°–18°) and peripheral (36°–53°) locations. Normally sighted adults and patients with peripheral visual loss showed multisensory uncertainty reduction and cue weighting in line with MLE predictions. In contrast, patients with central visual loss did not weight estimates appropriately in either the center or the periphery, and failed to meet MLE predictions in the periphery. Our results show that one visual loss patient group succeeded at optimal cue combination, whereas the other patient group (patients with central vision loss) did not. We propose that sensory remapping due to changes in fixation behavior may contribute to apparent failures in the latter group.

Citation

Garcia, S., Jones, P., Reeve, E., Michaelides, M., Rubin, G., & Nardini, M. (2017). Multisensory cue combination after sensory loss: audio-visual localization in patients with progressive retinal disease. Journal of Experimental Psychology: Human Perception and Performance, 43(4), 729-740. https://doi.org/10.1037/xhp0000344

• Journal Article Type: Article
• Acceptance Date: Oct 20, 2016
• Online Publication Date: Feb 9, 2017
• Publication Date: Apr 1, 2017
• Deposit Date: Oct 27, 2016
• Publicly Available Date: Oct 27, 2016
• Journal: Journal of Experimental Psychology: Human Perception and Performance
• Print ISSN: 0096-1523
• Electronic ISSN: 1939-1277
• Publisher: American Psychological Association
• Peer Reviewed: Peer Reviewed
• Volume: 43
• Issue: 4
• Pages: 729-740
• DOI: https://doi.org/10.1037/xhp0000344
• Public URL: https://durham-repository.worktribe.com/output/1373494