J Negen
Multisensory perception and decision-making with a new sensory skill
Negen, J; Bird, L; Slater, H; Thaler, L; Nardini, M
Authors
Laura-Ashleigh Bird laura-ashleigh.bird@durham.ac.uk
PGR Student Doctor of Philosophy
H Slater
Dr Lore Thaler lore.thaler@durham.ac.uk
Professor
Professor Marko Nardini marko.nardini@durham.ac.uk
Professor
Abstract
It is clear that people can learn a new sensory skill – a new way of mapping sensory inputs onto world states. It remains unclear how flexibly a new sensory skill can become embedded in multisensory perception and decision-making. To address this, we trained typically-sighted participants (N=12) to use a new echo-like auditory cue to distance in a virtual world, together with a noisy visual cue. Using model-based analyses, we tested for key markers of efficient multisensory perception and decision-making with the new skill. We found that twelve of fourteen participants learned to judge distance using the novel auditory cue. Their use of this new sensory skill showed three key features: (1) it enhanced the speed of timed decisions; (2) it largely resisted interference from a simultaneous digit span task; and (3) it integrated with vision in a Bayes-like manner to improve precision. We also show some limits following this relatively short training: precision benefits were lower than the Bayesoptimal prediction, and there was no forced fusion of signals. We conclude that people already embed new sensory skills in flexible multisensory perception and decision-making after a short training period. A key application of these insights is to the development of sensory augmentation systems that can enhance human perceptual abilities in novel ways. The limitations we reveal (sub-optimality, lack of fusion) provide a foundation for further investigations of the limits of these abilities and their brain basis.
Citation
Negen, J., Bird, L., Slater, H., Thaler, L., & Nardini, M. (2023). Multisensory perception and decision-making with a new sensory skill. Journal of Experimental Psychology: Human Perception and Performance, 49(5), 600-622. https://doi.org/10.1037/xhp0001114
Journal Article Type | Article |
---|---|
Acceptance Date | Jan 9, 2023 |
Online Publication Date | Jun 1, 2023 |
Publication Date | 2023-05 |
Deposit Date | Jan 9, 2023 |
Publicly Available Date | Jan 10, 2023 |
Journal | Journal of Experimental Psychology: Human Perception and Performance |
Print ISSN | 0096-1523 |
Electronic ISSN | 1939-1277 |
Publisher | American Psychological Association |
Peer Reviewed | Peer Reviewed |
Volume | 49 |
Issue | 5 |
Pages | 600-622 |
DOI | https://doi.org/10.1037/xhp0001114 |
Public URL | https://durham-repository.worktribe.com/output/1183280 |
Files
Published Journal Article
(5.8 Mb)
PDF
Publisher Licence URL
http://creativecommons.org/licenses/by/4.0/
Accepted Journal Article
(1.4 Mb)
PDF
Copyright Statement
Open Access funding provided by Liverpool John Moores University: This work is licensed under a Creative Commons Attribution 4.0 International License (CC BY 4.0;https://creativecommons.org/licenses/by/4.0). This license permits copying and redistributing the work in any medium or format, as well as adapting the material for any purpose, even commercially.
You might also like
Different types of uncertainty in multisensory perceptual decision making
(2023)
Journal Article
Sensory Augmentation for a Rapid Motor Task in a Multisensory Environment
(2023)
Journal Article
Internal Biases Are Linked to Disrupted Cue Combination in Children and Adults"
(2022)
Journal Article
Developmental changes in colour constancy in a naturalistic object selection task
(2022)
Journal Article
Downloadable Citations
About Durham Research Online (DRO)
Administrator e-mail: dro.admin@durham.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search