Melih Öder, Şükrü Eraslan, Yeliz Yeşilada

Automatically classifying familiar web users from eye-tracking data: a machine learning approach

Eye-tracking studies typically collect enormous amount of data encoding rich information about user behaviours and characteristics on the web. Eye-tracking data has been proved to be useful for usability and accessibility testing and for developing adaptive systems. The main objective of our work is to mine eye-tracking data with machine learning algorithms to automatically detect users’ characteristics. In this paper, we focus on exploring different machine learning algorithms to automatically classify whether users are familiar or not with a web page. We present our work with an eye-tracking data of 81 participants on six web pages. Our results show that by using eye-tracking features, we are able to classify whether users are familiar or not with a web page with the best accuracy of approximately 72% for raw data. We also show that with a resampling technique this accuracy can be improved more than 10%. This work paves the way for using eye-tracking data for identifying familiar users that can used for different purposes, for example, it can be used to better locate certain elements on pages such as adverts to meet the users’ needs or it can be used to do better profiling of users for usability and accessibility assessment of pages.

PDF

___

[1] Deng T, Zhao L,Feng L. Enhancing web revisitation by contextual keywords. In: the 13th International Conference on Web Engineering 2013; 323–337.
[2] Tüzün H, Akıncı A, Kurtoğlu M, Atal D,Pala FK. A study on the usability of a university registrar’s office website through the methods of authentic tasks and eye-tracking. The Turkish Online Journal of Educational Technology 2013; 12 (2):26–38.
[3] Poole A, Ball LJ. Eye tracking in human-computer interaction and usability research: Current status and future. In: Ghaoui C (editor). Encyclopedia of Human-Computer Interaction. Pennsylvania: Idea Group Inc 2005; 211–219.
[4] Eraslan S, Yesilada Y,Harper S. Eye tracking scanpath analysis on web pages: How many users?. In: the Ninth Biennial ACM Symposium on Eye Tracking Research & Applications, ETRA’16 2016; 103–110.
[5] Eraslan S, Yesilada Y, Harper S. Eye tracking analysis techniques on web pages: A survey, evaluation and comparison. Journal of Eye Movement Research 2015; 9 (1): article 2.
[6] Eraslan S,Yesilada Y. Patterns in eyetracking scanpaths and the affecting factors. Journal of Web Engineering 2015; 14 (5-6):363–385.
[7] Rello L,Ballesteros M. Detecting readers with dyslexia using machine learning with eye tracking measures. In: the 12th Web for All Conference W4A’15 2015; 16:1–8,
[8] Matsuda N,Takeuchi H. Frequent pattern mining of eye-tracking records partitioned into cognitive chunks. Appl. Comp. Intell. Soft Comput. 2014; article 10.
[9] Yaneva V, Ha LA, Eraslan S, Yesilada Y,Mitkov R. Detecting autism based on eye-tracking data from web searching tasks. In: the Internet of Accessible Things W4A’18 2018; 16:1–10.
[10] Eraslan S, Yesilada Y, Yaneva V, Harper S. Autism detection based on eye movement sequences on the web: A scanpath trend analysis approach. In: the 17th International Web for All Conference W4A’20 2020; 11:1–10.
[11] Pan B, Hembrooke HA, Gay GK, Granka LA, Feusner MK et al. The determinants of web page viewing behavior: An eye-tracking study. In: the 2004 Symposium on Eye Tracking Research & Applications ETRA’04 2004; 147–154.
[12] Habuchi Y, Takeuchi H, Kitajima M. The influence of web browsing experience on web-viewing behavior. In: the 2006 Symposium on Eye Tracking Research & Applications ETRA’06 2006; 47–47.
[13] Marchionini G. Exploratory search: from finding to understanding. Communications of the ACM 2006; 49 (4):41–46.
[14] Eraslan E, Yesilada Y, Yaneva, Ha LA “Keep it simple!”: an eye-tracking study for exploring complexity and distinguishability of web pages for people with autism. Universal Access in the Information Society 2021; 20:69-–84.
[15] Zhang J,Ghorbani AA. Familiarity and trust: Measuring familiarity with a web site. In: the 2nd Annual Conference on Privacy, Trust and Security PST’04 2004; 23–28.
[16] Holzinger A. Human-Computer Interaction and Knowledge Discovery (HCI-KDD): What Is the Benefit of Bringing Those Two Fields to Work Together? In: Availability, Reliability, and Security in Information Systems and HCI: IFIP WG 8.4, 8.9, TC 5 International Cross-Domain Conference CD-ARES 2013 2013; 319–328.
[17] Klaib AF, Alsrehin NO, Melhem WY, Bashtawi HO, Magableh AA. Eye tracking algorithms, techniques, tools, and applications with an emphasis on machine learning and internet of things technologies. Expert Systems with Applications 2021; 166:114037.
[18] Dong J, Zhang Y, Yue J, Hu Z. Comparison of random forest, random ferns and support vector machine for eye state classification. Multimedia Tools and Applications 2016; 75 (1):11763–11783.
[19] Yaneva V, Ha LA, Eraslan S, Yesilada Y, Mitkov R. Detecting high-functioning autism in adults using eye tracking and machine learning. IEEE Transactions on Neural Systems and Rehabilitation Engineering 2020; 28 (6):1254– 1261.
[20] Marchal F, Castagnos S, Boyer A. Tell me what you see, i will tell you what you remember. In: The 2016 Conference on User Modeling Adaptation and Personalization UMAP’16 2016; 293–294.
[21] Salojarvi J, Kojo I, Simola J, Kaski S. Can relevance be inferred from eye movements in information retrieval? In: Workshop on Self-Organizing Maps WSOM’03 2003; 261–266.
[22] Santella D. Robust clustering of eye movement recordings for quantification of visual interest. In: the 2004 Symposium on Eye Tracking Research & Applications ETRA’04 2004; 27–-34.
[23] Bondareva D, Conati C, Feyzi R, Harley JM, Azevedo R et al. Inferring Learning from Gaze Data during Interaction with an Environment to Support Self-Regulated Learning. In: Artificial Intelligence in Education: 16th International Conference AIED 2013; 229–238.
[24] Steichen B, Wu MMA, Toker D, Conati C,Carenini G. Te,Te,Hi,Hi: Eye Gaze Sequence Analysis for Informing User-Adaptive Information Visualizations. In: User Modeling, Adaptation, and Personalization: 22nd International Conference UMAP 2014; 183–194.
[25] Toker D, Conati C, Steichen B, Carenini G. Individual user characteristics and information visualization: Connecting the dots through eye tracking. In: the SIGCHI Conference on Human Factors in Computing Systems CHI ’13 2013; 295–304.
[26] Eraslan S, Yesilada Y, Harper S. Less users more confidence: How aois don’t affect scanpath trend analysis. Journal of Eye Movement Research 2017; 10 (4): article 6.
[27] Eraslan S, Yesilada Y,Harper S. Scanpath trend analysis on web pages: Clustering eye tracking scanpaths. ACM Transactions on the Web 2016; 10 (4): article 20.
[28] Michailidou E, Eraslan S, Yesilada Y,Harper S. Automated prediction of visual complexity of web pages: Tools and evaluations. International Journal of Human-Computer Studies 2021; 145:102523.
[29] Akpinar ME, Yesilada Y. Vision based page segmentation algorithm: Extended and perceived success. In: the ICWE 2013 International Workshops on Current Trends in Web Engineering - Springer-Verlag 2013; 8295:238–252.
[30] Greene HH, Rayner K. Eye movements and familiarity effects in visual search. Vision Research 2001; 41 (27):3763– 3773.
[31] Jacob RJK, and Karn KS. Eye tracking in Human-Computer interaction and usability research: Ready to deliver the promises. In: Hyona J, Radach R, and Deubel H. The Mind’s eye: Cognitive The Mind’s Eye: Cognitive and Applied Aspects of Eye Movement Research, Elsevier Science 2003; 573–603.
[32] Goldberg JH, Kotval XP. Computer interface evaluation using eye movements: methods and constructs. International Journal of Industrial Ergonomics 1999; (6):631–645.
[33] Sumner M, Frank E, Hall M. Speeding Up Logistic Model Tree Induction. In: Knowledge Discovery in Databases: PKDD 2005: 9th European Conference on Principles and Practice of Knowledge Discovery in Databases 2005; 675–683.
[34] Platt JC. Fast Training of Support Vector Machines Using Sequential Minimal Optimization. In: Scholkopf B and Burges CJC and Smola AJ (editors). Advances in Kernel Methods - Support Vector Learning MIT Press, Cambridge, MA, USA 1999; 185–208.
[35] Chawla NV, Bowyer KW, Hall LO, Kegelmeyer WP. Smote: Synthetic minority over-sampling technique. J. Artif. Int. Res. 2002; 16 (1):321–357.
[36] Demisse GB, Tadesse T, Bayissa Y. Data Mining Attribute Selection Approach for Drought Modelling: A Case Study for Greater Horn of Africa. International Journal of Data Mining & Knowledge Management Process 2007; 7:1–16.
[37] Owens JW, Chaparro BS, Palmer EM. Text advertising blindness: The new banner blindness?. J. Usability Studies 2011; 6 (3):172–197.
[38] Kaya B, Behravesh E, Abubakar AM, Kaya OS, Orús C. The moderating role of website familiarity in the relationships between e-service quality, e-satisfaction and e-loyalty. Journal of Internet Commerce 2019; 18 (4):369– 394.
[39] Akpinar E, Yesilada Y, Temizer S. The effect of context on small screen and wearable device users’ performance - a systematic review. ACM Comput. Surv. 2020; 53 (3): article 52.
[40] Rello L, Ballesteros M. Detecting readers with dyslexia using machine learning with eye tracking measures. In: The 12th Web for All Conference W4A ’15 2015; 16:1–8.
[41] Gefen, D. E-commerce: the role of familiarity and trust. Omega 2000; 28 (6):725–737.