The Effect of Explanatory Captions on the Reception of Foreign Audiovisual Products: A Study Drawing on Eyetracking Data and Retrospective Interviews

Zheng, Binghan; Xie, Mingqing

Abstract

The present research triangulates questionnaire, retrospective interview and eyetracking data, aiming to investigate how Explanatory Captions (ECs) are received by different viewers with varied educational backgrounds, and whether or not the presence of ECs improves their understanding of the AV content. The results show that the provision of ECs, for a subtitled video in a foreign language, greatly increased positive cognitive effects on the viewers. Viewers tend to reduce time spent on viewing images, but invest additional processing effort on the ECs, although their allocation of processing effort on subtitles experienced little change. Furthermore, the eyetracking data suggest that most participants adopted a fixed reading pattern on subtitles and ECs when they appeared simultaneously, which could balance some of the negative impact of ECs on their viewing experience. The findings gained through this experimental research will provide some guidance and suggestions for subtitlers when preparing subtitles and ECs.

Citation

Zheng, B., & Xie, M. (2018). The Effect of Explanatory Captions on the Reception of Foreign Audiovisual Products: A Study Drawing on Eyetracking Data and Retrospective Interviews. Translation, cognition & behavior, 1(1), 119-146. https://doi.org/10.1075/tcb.00006.zhe

• Journal Article Type: Article
• Acceptance Date: Nov 17, 2017
• Online Publication Date: Mar 2, 2018
• Publication Date: Mar 2, 2018
• Deposit Date: Dec 13, 2017
• Publicly Available Date: Dec 14, 2017
• Journal: Translation, cognition and behavior
• Print ISSN: 2542-5277
• Electronic ISSN: 2542-5285
• Publisher: John Benjamins Publishing
• Peer Reviewed: Peer Reviewed
• Volume: 1
• Issue: 1
• Pages: 119-146
• DOI: https://doi.org/10.1075/tcb.00006.zhe
• Public URL: https://durham-repository.worktribe.com/output/1338068