User interaction in hands-free gaming: a comparative study of gaze-voice and touchscreen interface control

The goal of the present study is to contribute to the research on the use of eye tracking in hands-free gaming.We report the results of an experimental study by using a platform game designed by the authors. The game allowedgaze-voice command control, as well touchscreen control of the interface by the player. We employed a set of performancemeasures and we measured player engagement as an indicator of user experience. The findings revealed that the playersdid not improve in game performance when they used the gaze-voice control compared to the touchscreen control. On theother hand, they exhibited stronger engagement, which indicates the potential of gaze-voice combination as an acceptableinteraction method compared to touchscreen in mobile games.

PDF

___

[1] Paivio A. Mental Representations: A Dual Coding Approach. New York, NY, USA: Oxford University Press, 1990.
[2] Alais D, Morrone C, Burr D. Separate attentional resources for vision and audition. P Roy Soc B-Biol Sci 2006; 273: 1339-1345.
[3] Bernsen NO, Dybkjær L. Multimodal Usability. New York, NY, USA: Springer Science & Business Media, 2009.
[4] Špakov O, Miniotas D. EyeChess: A tutorial for endgames with gaze-controlled pieces. In: European Conference on Eye Movements; 14–18 August 2005; Bern, Switzerland. pp. 1-32.
[5] Jönsson E. If looks could kill–an evaluation of eye tracking in computer games. MSc, Royal Institute of Technology, Stockholm, Sweden, 2005.
[6] Dorr M, Böhme M, Martinetz T, Barth E. Gaze beats mouse: a case study. In: Conference on Communication by Gaze Interaction; 2007; Leicester, UK. pp. 16-19.
[7] Istance H, Vickers S, Hyrskykari A. Gaze-based interaction with massively multiplayer on-line games. In: CHI’09 Extended Abstracts on Human Factors in Computing Systems; 4–9 April 2009; Boston, MA, USA. New York, NY, USA: ACM. pp. 4381-4386.
[8] Nielsen AM, Petersen AL, Hansen JP. Gaming with gaze and losing with a smile. In: Symposium on Eye Tracking Research and Applications; 28–30 March 2012; Santa Barbara, CA, USA. New York, NY, USA: ACM. pp. 365-368.
[9] McMahan A. Immersion, engagement, and presence: A method for analysing 3-D video games. In: Wolf MJP, Perron B, editors. The Video Game Theory Reader. New York, NY, US: Routledge, Taylor & Francis Group, 2003. pp. 67-86.
[10] Lankoski P. Player character engagement in computer games. Games Cult 2011; 6: 291-311.
[11] Weibel D, Wissmath B, Habegger S, Steiner Y, Groner R. Playing online games against computer- vs. humancontrolled opponents: effects on presence, flow, and enjoyment. Comput Hum Behav 2008; 24: 2274-2291.
[12] Chanel G, Rebetez C, Bétrancourt M, Pun T. Boredom, engagement and anxiety as indicators for adaptation to difficulty in games. In: 12th International Conference on Entertainment and Media in the Ubiquitous Era; 7–10 October 2008; Tampere, Finland. New York, NY, USA: ACM. pp. 13-17.
[13] Schoenau-Fog H. The player engagement process–an exploration of continuation desire in digital games. In: 2011 DiGRA International Conference: Think Design Play; 14–17 September 2011; Utrecht, the Netherlands. Utrecht, the Netherlands: DiGRA/Utrecht School of the Arts. pp. 1-18.
[14] Boyle EA, Connolly TM, Hainey T, Boyle JM. Engagement in digital entertainment games: a systematic review. Comput Hum Behav 2012; 28: 771-780.
[15] Brockmyer JH, Fox CM, Curtiss KA, McBroom E, Burkhart KM, Pidruzny JN. The development of the Game Engagement Questionnaire: A measure of engagement in video game-playing. J Exp Soc Psychol 2009; 45: 624-634.
[16] Singer MJ, Witmer BG. On selecting the right yardstick. Presence-Teleop Virt 1999; 8: 566-573.
[17] Mania K, Chalmers A. The effects of levels of immersion on memory and presence in virtual environments: A reality centered approach. Cyberpsychol Behav 2001; 4: 247-264.
[18] Csikszentmihalyi M. Flow: The Psychology of Optimal Experience. New York, NY, USA: Harper Perennial, 1990.
[19] Irwin HJ. Pathological and nonpathological dissociation: the relevance of childhood trauma. J Psychol 1999; 133: 157-164.
[20] Isokoski P, Martin B. Eye tracker input in first person shooter games. In: Conference on Communication by Gaze Interaction; 4–5 September 2006; Turin, Italy. pp. 78-81.
[21] Gowases T, Bednarik R, Tukiainen M. Gaze vs. mouse in games: the effects on user experience. In: International Conference on Computers in Education; 2008; Taipei, Taiwan. pp. 773-777
[22] Velloso E, Fleming A, Alexander J, Gellersen H. Gaze-supported gaming: MAGIC techniques for first person shooters. In: Annual Symposium on Computer-Human Interaction in Play; 5–7 October 2015; London, UK. New York, NY, USA: ACM. pp. 343-347.
[23] Navarro D. Improving player performance by developing gaze aware games. MSc, Blekinge Institute of Technology, Karlskrona, Sweden, 2014.
[24] Isokoski P, Joos M, Spakov O, Martin B. Gaze controlled games. Universal Access Inf 2009; 8: 323-337.
[25] Agustin JS, Mateo JC, Hansen JP, Villanueva A. Evaluation of the potential of gaze input for game interaction. PsychNology Journal 2009; 7: 213-236.
[26] Petrini A, Forslin H. Evaluation of player performance with a brain computer interface and eye tracking control in an entertainment game application. MSc, Blekinge Institute of Technology, Karlskrona, Sweden, 2016.
[27] Sundstedt V, Navarro D, Mautner J. Possibilities and challenges with eye tracking in video games and virtual reality applications. In: SIGGRAPH ASIA Courses 2016; 5–8 December 2016; Macau, China. New York, NY, USA: ACM. pp. 1-17.
[28] Vinnikov M, Allison RS, Fernandes S. Gaze-contingent auditory displays for improved spatial attention in virtual reality. ACM T Comput-Hum Int 2017; 24: 19.
[29] Wilcox T, Evans M, Pearce C, Pollard N, Sundstedt V. Gaze and voice based game interaction: the revenge of the killer penguins. In: ACM SIGGRAPH Posters; 11–15 August 2008; Los Angeles, CA, USA. New York, NY, USA: ACM. p. 81.
[30] O’Donovan J, Ward J, Hodgins S, Sundstedt V. Rabbit Run: Gaze and voice based game interaction. In: Eurographics Ireland Workshop; 11 December 2009; Dublin, Ireland. pp. 1-8.
[31] van der Kamp J, Sundstedt V. Gaze and voice controlled drawing. In: Conference on Novel Gaze-Controlled Applications; 26–27 May 2011; Karlskrona, Sweden. New York, NY, USA: ACM. pp. 1-9.
[32] Sundstedt V. Gazing at games: an introduction to eye tracking control. In: Barsky BA, editor. Synthesis Lectures on Computer Graphics and Animation. San Rafael, CA, USA: Morgan & Claypool Publishers, 2012. pp. 1-113.
[33] Lankes M, Stiglbauer B. GazeAR: Mobile gaze-based interaction in the context of augmented reality games. In: International Conference on Augmented Reality, Virtual Reality and Computer Graphics; 2016; Lecce, Italy. New York, NY, USA: Springer International Publishing. pp. 397-406.
[34] Clark RE. Research on instructional media, 1978-1988. In: Ely D, editor. Educational Media and Technology Yearbook. Littleton, CO, USA: Libraries Unlimited, 1988. pp. 19-36.
[35] Zain NH, Jaafar A. Integrating digital games based learning environments with eye gaze-based interaction. In: Pattern Analysis and Intelligent Robotics ICPAIR; 28–29 June 2011; Kuala Lumpur, Malaysia. New York, NY, USA: IEEE. pp. 222-227.