Developing and Evaluating a Novel Gamified Virtual Learning Environment for ASL

Wang, Jindi; Ivrissimtzis, Ioannis; Li, Zhaoxing; Zhou, Yunzhan; Shi, Lei

Abstract

The use of sign language is a highly effective way of communicating with individuals who experience hearing loss. Despite extensive research, many learners find traditional methods of learning sign language, such as web-based question-answer methods, to be unengaging. This has led to the development of new techniques, such as the use of virtual reality (VR) and gamification, which have shown promising results. In this paper, we describe a gamified immersive American Sign Language (ASL) learning environment that uses the latest VR technology to gradually guide learners from numeric to alphabetic ASL. Our hypothesis is that such an environment would be more engaging than traditional webbased methods. An initial user study showed that our system scored highly in some aspects, especially the hedonic factor of novelty. However, there is room for improvement, particularly in the pragmatic factor of dependability. Overall, our findings suggest that the use of VR and gamification can significantly improve engagement in ASL learning.

Citation

Wang, J., Ivrissimtzis, I., Li, Z., Zhou, Y., & Shi, L. (2023). Developing and Evaluating a Novel Gamified Virtual Learning Environment for ASL. In Human-Computer Interaction – INTERACT 2023: 19th IFIP TC13 International Conference, York, UK, August 28 – September 1, 2023, Proceedings, Part I (459-468). https://doi.org/10.1007/978-3-031-42280-5_29

• Presentation Conference Type: Conference Paper (Published)
• Conference Name: INTERACT 2023: IFIP Conference on Human-Computer Interaction
• Start Date: Aug 28, 2023
• End Date: Sep 1, 2023
• Acceptance Date: May 25, 2023
• Online Publication Date: Aug 25, 2023
• Publication Date: 2023
• Deposit Date: Jun 15, 2023
• Publicly Available Date: Aug 26, 2024
• Publisher: Springer Verlag
• Pages: 459-468
• Series Title: Lecture Notes in Computer Science
• Series Number: 14142
• Series ISSN: 0302-9743
• Book Title: Human-Computer Interaction – INTERACT 2023: 19th IFIP TC13 International Conference, York, UK, August 28 – September 1, 2023, Proceedings, Part I
• ISBN: 9783031422799
• DOI: https://doi.org/10.1007/978-3-031-42280-5_29
• Public URL: https://durham-repository.worktribe.com/output/1647672
• Publisher URL: https://link.springer.com/conference/interact