S. KARABULUT, Y. YEŞİLADA, Ş. ERASLAN, M.C. ATALAY

Evaluation of Visualisation of Scanpath Trend Analysis (ViSTA) Tool

Eye tracking plays a key role in user behaviour understanding and usability studies. We previously proposed an algorithm called STA (Scanpath Trend Analysis) that analyses multiple individual scanpaths on a web page to discover their trending path in terms of the areas of interest (AOIs). This algorithm provides the most representative path of multiple users compared to other algorithms (i.e., provides the most similar path to individual scanpaths). However, its current implementation has no graphical user interface and provides a sequence of characters that represent AOIs. Some external modules should also be installed in advance to run it. In our previous work, we presented the first web-based visualisation tool for the STA algorithm called ViSTA along with its initial evaluation. This tool allows to visualise individual scanpaths on a particular web page with gaze plots, visually draw AOIs, apply the STA algorithm, and visualise the result of the algorithm. In this paper, we present the extended version of ViSTA with a follow up user evaluation. The first version of ViSTA uses the STA algorithm which identifies trending AOIs based on all individual scanpaths. However, the extended one uses the STA algorithm with the tolerance level parameter which means trending elements can be identified based on a subset of individual scanpaths for discovering a more representative path. Both of our initial and follow up evaluations show that the workload in terms of NASA Task Load Index (TLX) is lower with ViSTA compared to the current implementation of the STA algorithm.

PDF

___

Y. Yesilada, S. Harper and S. Eraslan, “Experiential Transcoding: An EyeTracking Approach,” in Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility, New York, NY, USA, 2013.
T. Blascheck, K. Kurzhals, M. Raschke, M. Burch, D. Weiskopf and T. Ertl, “Visualization of Eye Tracking Data: A Taxonomy and Survey,” Computer Graphics Forum, vol. 36, pp. 260-284, 2017.
M. E. Akpınar and Y. Yeşilada, “Vision Based Page Segmentation Algorithm: Extended and Perceived Success,” in Current Trends in Web Engineering: ICWE 2013 International Workshops ComposableWeb, QWE, MDWE, DMSSW, EMotions, CSE, SSN, and PhD Symposium, Aalborg, Denmark, July 8-12, 2013. Revised Selected Papers, Q. Z. Sheng and J. Kjeldskov, Eds., Cham, Springer International Publishing, 2013, pp. 238-252.
S. Eraslan, Y. Yesilada and S. Harper, “Eye tracking scanpath analysis techniques on web pages: A survey, evaluation and comparison,” Journal of Eye Movement Research, vol. 9, 2015.
S. Eraslan, Y. Yesilada and S. Harper, “Scanpath Trend Analysis on Web Pages: Clustering Eye Tracking Scanpaths,” ACM Trans. Web, vol. 10, pp. 20:1--20:35, 11 2016.
C. Tablatin and M. M. Rodrigo, “Identifying Common Code Reading Patterns using Scanpath Trend Analysis with a Tolerance,” in Proceedings of thee 26th International Conference for Computers in Education (ICCE 2018), Metro Manila, Philippines, 2018.
S. Eraslan, V. Yaneva, Y. Yesilada and S. Harper, “Do Web Users with Autism Experience Barriers When Searching for Information Within Web Pages?,” in Proceedings of the 14th Web for All Conference on The Future of Accessible Work, New York, NY, USA, 2017.
S. Eraslan, V. Yaneva, Y. Yesilada and S. Harper, “Web users with autism: eye tracking evidence for differences,” Behaviour & Information Technology, vol. 38, pp. 678-700, 2019.
H. Y. Yatbaz, S. Eraslan, Y. Yesilada and E. Ever, “Activity Recognition Using Binary Sensors for Elderly People Living Alone: Scanpath Trend Analysis Approach,” IEEE Sensors Journal, 2019.
Ş. Eraslan, S. Karabulut, M. C. Atalay and Y. Yeşilada, “ViSTA: Visualisation of Scanpath Trend Analysis (STA) / Scanpath Trend Analysis (STA)'in Görselleştirilmesi,” in Proceedings of the 12th Turkish National Symposium on Software Engineering (12. Ulusal Yazılım Mühendisligi Sempozyumu, UYMS 2018), İstanbul, Turkey, 2018.
Tobii Technology AB, “Tobii Studioᵀᴹ 2.X User Manual (Sep. 2010),” 2010.
M. Burch, A. Kull and D. Weiskopf, “AOI rivers for visualizing dynamic eye gaze frequencies,” in Computer Graphics Forum, 2013.
K. Holmqvist, J. Holsanova, M. Barthelson and D. Lundqvist, “Reading or scanning? A study of newspaper and net paper reading.,” J. R. In Hyönä and H. Deubel, Eds., Elsevier, 2003, pp. 657-670.
L. Herman, S. Popelka and V. Hejlova, “Eye-tracking Analysis of Interactive 3D Geovisualization,” Journal of Eye Movement Research, vol. 10, 2017.
M. Burch, A. Kumar and N. Timmermans, “An Interactive Web-based Visual Analytics Tool for Detecting Strategic Eye Movement Patterns,” in Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications, New York, NY, USA, 2019.
J. Dolezalova and S. Popelka, “ScanGraph: A Novel Scanpath Comparison Method Using Visualisation of Graph Cliques,” Journal of Eye Movement Research, vol. 9, 2016. G. Topić, A. Yamaya, A. Aizawa and P. Martínez-Gómez, “FixFix: Fixing the Fixations,” in Proceedings of the Ninth Biennial ACM Symposium on ETRA, New York, NY, USA, 2016.
S. Eraslan, Y. Yesilada and S. Harper, “Engineering web-based interactive systems: trend analysis in eye tracking scanpaths with a tolerance,” in Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems, EICS 2017, New York, NY, USA, 2017.
S. Eraslan and C. Bailey, “End-User Evaluations,” in Web Accessibility: A Foundation for Research, Y. Yesilada and S. Harper, Eds., London, : Springer London, 2019, pp. 185-210.
A. Cao, K. K. Chintamani, A. K. Pandya and R. D. Ellis, “NASA TLX: Software for assessing subjective mental workload,” Behavior Research Methods, vol. 41, pp. 113-117, 01 2 2009.
A. Santella and D. DeCarlo, “Robust Clustering of Eye Movement Recordings for Quantification of Visual Interest,” in Proceedings of the 2004 Symposium on ETRA, New York, NY, USA, 2004.
P. Hejmady and N. H. Narayanan, “Visual Attention Patterns During Program Debugging with an IDE,” in Proceedings of the 2012 Symposium on ETRA, New York, NY, USA, 2012.
K.-J. Räihä, A. Aula, P. Majaranta, H. Rantala and K. Koivunen, “Static Visualization of Temporal Eye- Tracking Data,” in Human-Computer Interaction - INTERACT 2005: IFIP TC13 International Conference, Rome, Italy, September 12-16, 2005. Proceedings, M. F. Costabile and F. Paternò, Eds., Berlin, Heidelberg: Springer Berlin Heidelberg, 2005, pp. 946-949.