Bora ERGİN, Abdullah Ruhi SOYLU, Görkem YAVAŞ, Sumru KEÇELİ

Effect of touch coordinate display as a form of augmented, concurrent visual feedback on the accuracy of single-handed typing via smartphone virtual keyboards

This study assessed the effect of an easily perceived real-time visual feedback method on touchscreen typing accuracy. Thirty subjects were asked to hold a smartphone with a capacitive touchscreen in one hand and enter a text using the thumb of the same hand via a custom designed virtual keyboard. There were two types of text entry sessions: with or without visual feedback. The visual feedback consisted of a full-screen crosshair, representing the accurate coordinate of touch in real time. In each session, touch-down time on the virtual keyboard and touch coordinates were recorded for every touch action. Two types of typing errors were defined: 1) centering error (CE), which was calculated as the mm distance between the coordinate of the touch and the center of the key, and 2) incorrect entry (IE), which was the number of missed keys. Student t-tests and Wilcoxon tests were used for mean and mean-rank comparisons of CE and IE, respectively. The results showed that visual feedback decreased CE (mean ± SD) significantly from 1.34 ± 0.38 mm to 0.85 ± 0.24 mm (P < 0.0005), and decreased IE (median and range, # of incorrect entries) significantly from 5.50 and 32.00 to 1.00 and 7.00 (P < 0.005). In conclusion, the accurate, easily perceived, and 2D real-time feedback decreases touch-typing error rates markedly and therefore can be of practical importance for increasing the productivity of smartphone users.

PDF

___

[1] Perry KB, Hourcade JP. Evaluating one handed thumb tapping on mobile touchscreen devices. In: Graphics Interface 2008 Conference; 2830 May 2008; Windsor, Canada. Toronto, Canada: Canadian Information Processing Society. pp. 57-64.
[2] Bicheno, S. Global Smartphone Installed Base Forecast by Operating System for 88 Countries: 2007 to 2017. Boston, MA, USA: Strategy Analytics, 2012.
[3] eMarketer. Worldwide Mobile Phone Users: H1 2014 Forecast and Comparative Estimates. New York, NY, USA: eMarketer, 2014.
[4] Findlater L, Wobnrock JO. From plastic to pixels: in search of touch-typing touchscreen keyboards. Int Interact 2012; 19: 44-49.
[5] Holz C, Baudisch P. The generalized perceived input point model and how to double touch accuracy by extracting fingerprints. In: SIGCHI 2010 Conference on Human Factors in Computing Systems; 1015 April 2010; Atlanta, GA, USA. New York, NY, USA: ACM. pp. 581-590.
[6] Vogel D, Baudisch P. Shift: a technique for operating pen-based interfaces using touch. In: SIGCHI 2007 Conference on Human Factors in Computing Systems; 28 April3 May 2007; San Jose, CA, USA. New York, NY, USA: ACM. pp. 657-666.
[7] Sigrist R, Rauter G, Riener R, Wolf P. Augmented visual, auditory, haptic, and multimodal feedback in motor learning: a review. Psychon Bull Rev 2013; 20: 21-53.
[8] Topal C, Benligiray B, Akinlar C. On the efficiency issues of virtual keyboard design. In: IEEE 2012 International Conference on Virtual Environments, HumanComputer Interfaces and Measurement Systems; 24 July 2012; Tianjin, China. New York, NY, USA: IEEE. pp. 38-42.
[9] Kwon S, Lee D, Chung MK. Effect of key size and activation area on the performance of a regional error correction method in a touch-screen QWERTY keyboard. Int J Ind Ergonom 2009; 39: 888-893.
[10] Gomide RS, Loja LFB, Flores EL, Lemos RP, Carvalho SD, Silva REM. A systematic review on methods and techniques for optimizing assistive virtual keyboards. IEEE Lat Am T 2015; 13: 2687-2693.
[11] Kim HK, Lee S, Yun KS. Capacitive tactile sensor array for touch screen application. Sensor Actuat A-Phys 2011; 165: 2-7.
[12] Baxter L. Capacitive Sensors: Design and Applications. New York, NY, USA: IEEE Press, 1996.
[13] Park YS, Han SH. Touch key design for one-handed thumb interaction with a mobile phone: effects of touch key size and touch key location. Int J Ind Ergonom 2010; 40: 68-76.
[14] Park YS, Han SH. One-handed thumb interaction of mobile devices from the input accuracy perspective. Int J Ind Ergonom 2010; 40: 746-756.
[15] Parhi P, Karlson KA, Bedeson BB. Target size study for one-handed thumb use on small touchscreen devices. In: 2006 International Conference on HumanComputer Interaction with Mobile Devices and Services; 1215 September 2006; Espoo, Finland. New York, NY, USA: ACM. pp. 203-210.
[16] Kwon S, Kim C, Kim S, Han SH. Two-mode target selection: considering target layouts in small touch screen devices. Int J Ind Ergonom 2010; 40: 733-745.
[17] Pouprey I, Maruyama S. Tactile interfaces for small touch screens. In: ACM 2003 Symposium on User Interface Software and Technology; 25 November 2003; Vancouver, Canada. New York, NY, USA: ACM, pp. 217-220.
[18] Lee S, Zhai S. The performance of touch screen soft buttons. In: SIGCHI 2007 Conference on Human Factors in Computing Systems; 49 April 2009; Boston, MA, USA. New York, NY, USA: ACM. pp. 309-318.
[19] Goel M, Jansen A, Mandel T, Patel SN, Wobbrock JO. ContextType: Using hand posture information to improve mobile touch screen text entry. In: SIGCHI 2013 Conference on Human Factors in Computing Systems; 27 April2 May 2013; Paris, France. New York, NY, USA: ACM. pp. 2795-2798.
[20] Karlson AK, Bederson BB. ThumbSpace: generalized one-handed input for touchscreen-based mobile devices. In: IFIP 2007 Conference on HumanComputer Interaction; 1014 September 2007; Rio de Janeiro, Brazil. Berlin, Germany: Springer. pp. 324-338.
[21] Perry KB, Hourcade JP. Evaluating one handed thumb tapping on mobile touchscreen devices. In: Graphics Interface 2008 Conference; 2830 May 2008; Windsor, Canada. Toronto, Canada: Canadian Information Processing Society. pp. 57-64.
[22] Potter, RL, Weldon LJ, Shneiderman B. Improving the accuracy of touch screens: an experimental evaluation of three strategies. In: SIGCHI 1988 Conference on Human Factors in Computing Systems; 1519 June 1988; Washington, DC, USA. New York, NY, USA: ACM. pp. 27-32.
[23] Roudaut A, Huot S, Lecolinet E. TapTap and MagStick: improving one-handed target acquisition on small touchscreens. In: 2008 Conference on Advanced Visual Interfaces; 2830 May 2008; Naples, Italy. New York, NY, USA: ACM. pp. 146-153.
[24] Bi X, Li Y, Zhai S. FFitts law: modeling finger touch with Fitts law. In: SIGCHI 2013 Conference on Human Factors in Computing Systems; 27 April2 May 2013; Paris, France. New York, NY, USA: ACM. pp. 1363-1372.
[25] Leversedge FJ. Anatomy and pathomechanics of the thumb. Hand Clin 2008; 24: 219-229.