Binocular eye-tracking for the control of a 3D immersive multimedia user interface

Sidorakis, Nikolaos; Koulieris, George Alex; Mania, Katerina

Abstract

In this paper, we present an innovative approach to design a gaze-controlled Multimedia User Interface for modern, immersive headsets. The wide-spread availability of consumer grade Virtual Reality Head Mounted Displays such as the Oculus RiftTM transformed VR to a commodity available for everyday use. However, Virtual Environments require new paradigms of User Interfaces, since standard 2D interfaces are designed to be viewed from a static vantage point only, e.g. the computer screen. Additionally, traditional input methods such as the keyboard and mouse are hard to manipulate when the user wears a Head Mounted Display. We present a 3D Multimedia User Interface based on eye-tracking and develop six applications which cover commonly operated actions of everyday computing such as mail composing and multimedia viewing. We perform a user study to evaluate our system by acquiring both quantitative and qualitative data. The study indicated that users make less type errors while operating the eye-controlled interface compared to using the standard keyboard during immersive viewing. Subjects stated that they enjoyed the eye-tracking 3D interface more than the keyboard/mouse combination.

Citation

Sidorakis, N., Koulieris, G. A., & Mania, K. (2015). Binocular eye-tracking for the control of a 3D immersive multimedia user interface. In 2015 IEEE 1st Workshop on Everyday Virtual Reality (WEVR) : proceedings of a meeting held 23 March 2015, Arles, Camargue, Provence, France (15-18). https://doi.org/10.1109/wevr.2015.7151689

• Conference Name: Everyday Virtual Reality (WEVR), 2015 IEEE 1st Workshop on IEEE
• Conference Location: Arles, Camargue, Provence, France
• Start Date: Mar 23, 2015
• Acceptance Date: Feb 16, 2015
• Online Publication Date: Jul 9, 2015
• Publication Date: Jul 9, 2015
• Deposit Date: Jun 5, 2018
• Publicly Available Date: Jul 25, 2018
• Publisher: Institute of Electrical and Electronics Engineers
• Pages: 15-18
• Book Title: 2015 IEEE 1st Workshop on Everyday Virtual Reality (WEVR) : proceedings of a meeting held 23 March 2015, Arles, Camargue, Provence, France.
• DOI: https://doi.org/10.1109/wevr.2015.7151689