Skip to main content

Research Repository

Advanced Search

Raters’ scoring process in assessment of interpreting: an empirical study based on eye tracking and retrospective verbalisation

Han, Chao; Zheng, Binghan; Xie, Mingqing; Chen, Shirong

Raters’ scoring process in assessment of interpreting: an empirical study based on eye tracking and retrospective verbalisation Thumbnail


Authors

Chao Han

Mingqing Xie mingqing.xie@durham.ac.uk
PGR Student Doctor of Philosophy

Shirong Chen



Abstract

Human raters’ assessment of interpreting is a complex process. Previous researchers have mainly relied on verbal reports to examine this process. To advance our understanding, we conducted an empirical study, collecting raters’ eye-movement and retrospection data in a computerised interpreting assessment in which three groups of raters (n = 35) used an analytic rubric to assess 12 English-to-Chinese consecutive interpretations. We examined how the raters interacted with the source text, the rating scale, and the audio player displayed on the computer screen when they were assessing. We found that a) the source text and the rating scale were competing for the raters’ visual attention, with the former attracting more attention than the latter across the rater groups; b) when the raters were consulting the rating scale, they fixated less frequently on the sub-scale of target language quality than the other two sub-scales; c) the rater groups did not seem to exhibit substantially discrepant gazing behaviours overall, although there emerged different eye-movement patterns concerning certain sub-scales; and d) the raters utilised an array of strategies and shortcuts to facilitate their assessment. We discuss these findings in relation to rater training and validation of score meaning for interpreting assessment.

Citation

Han, C., Zheng, B., Xie, M., & Chen, S. (2024). Raters’ scoring process in assessment of interpreting: an empirical study based on eye tracking and retrospective verbalisation. The Interpreter and Translator Trainer, 18(3), 400-422. https://doi.org/10.1080/1750399x.2024.2326400

Journal Article Type Article
Acceptance Date Feb 19, 2024
Online Publication Date Mar 12, 2024
Publication Date Mar 23, 2024
Deposit Date May 28, 2024
Publicly Available Date May 28, 2024
Journal The Interpreter and Translator Trainer
Print ISSN 1750-399X
Electronic ISSN 1757-0417
Publisher Taylor and Francis Group
Peer Reviewed Peer Reviewed
Volume 18
Issue 3
Pages 400-422
DOI https://doi.org/10.1080/1750399x.2024.2326400
Public URL https://durham-repository.worktribe.com/output/2466486

Files

Published Journal Article (Advanced Online Version) (4.8 Mb)
PDF

Licence
http://creativecommons.org/licenses/by-nc-nd/4.0/

Publisher Licence URL
http://creativecommons.org/licenses/by-nc-nd/4.0/

Copyright Statement
© 2024 The Author(s). Published by Informa UK Limited, trading as Taylor & Francis Group.
This is an Open Access article distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives License (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is properly cited, and is not altered, transformed, or built upon in any way. The terms on which this article has been published allow the posting of the Accepted Manuscript in a repository by the author(s) or with their consent.





You might also like



Downloadable Citations