Miraç Barış USTA, M. Z. Koray KARABEKİROĞLU

Computational analysis of affective facial behavior in children with the specific learning disorder

Objective: Clinical characterization of facial behavior is getting more critical in psychiatric disorders; however, there are no objective measures of these expressions. Our study aims to investigate to affective facial behaviors in specific learning disorder (SLD), collect objective facial behavior information to help decision making, and examine the discrimination ability of these behaviors in SLD and healthy controls (HC). Methods: SLD and HC group watched three, 5-minute scenes from cartoon videos and between these scenes in 2-minute question session was applied. Openface software for video analysis used three machine learning algorithms and the performance of these algorithms tested on our data using SLD and HC groups as prediction class. ROC curves and AUC had been calcu-lated. Results:Prediction models using three machine learning classifiers had been created independently with tenfold cross-validation. SVM method showed the highest AUC=0.76 with sensitivity 72%, specifity 96%. Conclu-sion: Computational identification of facial behavior in children a promising beginning for the technologies to aid psychiatrists in the evaluation of learning and other neurodevelopmental disorders.Quantitative assessment of faci-al expression in neurodevelopmental disorders are both beneficial and informative and in future may be used as an addition to traditional methods of psychiatric examination.

PDF

___

1.Tannock R. Learning disorders. BJ Sadock, VA Sadock, P Ruiz (Eds.), Kaplan and Sadock’s Comprehensive Textbook of Psychiatry, Philadelphia: LippincottWilliams & Wilkins, 2008, pp.3475-3500.

2.Eyuboglu D, Bolat N, Eyuboglu M. Empathy and theory of mind abilities of children with specific learning disorder (SLD). Psychiat Clin Psych 2018; 28:136-141.

3.Mary A, Slama H, Mousty P, Massat I, Capiau T,Drabs V, et al. Executive and attentional contributions to theory of mind deficit in attention deficit/hyperactivity disorder (ADHD). Child Neuropsychol 2016; 22:345-365.

4.Mashal N, Kasirer A. Thinking maps enhance meta-phoric competence in children with autism and learning disabilities. Res Dev Disabil 2011; 32:2045-2054.

5.Şahin B, Karabekiroğlu K, Bozkurt A, Usta MB, Aydın M, Çobanoğlu C. The relationship of clinical symptoms with social cognition in children diagnosed with attention deficit hyperactivity disorder, specific learning disorder or autism spectrum disorder. Psychiatry Investig 2018; 15:1144.

6.Deschamps PKH, Schutter DJLG, Kenemans JL, Matthys W. Empathy and prosocial behavior in response to sadness and distress in 6-to 7-year olds diagnosed with disruptive behavior disorder and attention-deficit hyperactivity disorder. Eur Child Adolesc Psychiatry 2015; 24(1):105-113.

7.Sariyanidi E, Gunes H, Cavallaro A. Automatic analysis of facial affect: a survey of registration, representation, and recognition. IEEE Transac-tions on Pattern Analysis and Machine Intelligence 2015; 37(6):1113.

8.Stratou G, Scherer S, Gratch J, Morency LP. Automatic nonverbal behavior indicators of depression and PTSD: Exploring gender differences. Humaine Association Conference on Affective Computing and Intelligent Interaction IEEE 2013; 147-152.

9.Cohn JF, Kruez TS, Matthews I, Yang Y, Nguyen MH, Padilla MT, et al. Detecting depression from facial actions and vocal prosody. 3rd International Conferenceon Affective Computing and Intelligent Interaction and Workshops, IEEE 2009,pp.1-7.

10.Alghowinem S, Goecke R, Wagner M, Parkerx G, Breakspear M. Head pose and movement analysis as an indicator of depression. Humaine Association Confer-ence on AffectiveComputing and Intelligent Interaction; IEEE 2013,pp.283-288.

11.Girard JM, Cohn JF, Mahoor MH, Mavadati S, Rosen-wald DP. Social risk and depression: Evidence from manual and automatic facial expression analysis. 10th IEEE International Conference and Workshops on Auto-matic Face and Gesture Recognition IEEE 2013.Pp.1-8.

12.Kaufman J, Birmaher B, Brent D, Rao U, Flynn C, Moreci P, et al. Schedule for affective disorders and schizophre-nia for school-age children-present and lifetime version (K-SADS-PL): initial reliability and validity data. J Am Acad Child Adolesc Psychiatry 1997; 36:980-988.

13.Gökler B, Ünal F, Pehlivantürk B, Kültür EÇ, Akdemir D, Taner Y. Reliability and validity of schedule for affective disorders and schizophrenia for school agechildren-pre-sent and lifetime version-Turkish version.Turk J Child Adolesc Ment Health2004; 11:109-116.

14.Wechsler D. Wechsler Intelligence Scale for Children, 1949.

15.Savaşır I, Şahin N. Wechsler Çocuklar için Zeka Ölçeği (WISC-R) El Kitabı. Ankara: Türk Psikologlar Derneği Yayınları, 1995.

16.Baltrušaitis T, Mahmoud M, Robinson P. Cross-dataset learning and person-specific normalisation for automatic action unit detection. 11thIEEE International Conference and Workshops on Automatic Face and Gesture Recog-nition IEEE 2015,pp.1-6.

17.Ekman R. What the face reveals: Basic and applied studies of spontaneous expression using the Facial Action Coding System (FACS). USA: Oxford University Press, 1997.

18.Baltrusaitis T, Zadeh A, Lim YC, MorencyLP. Openface 2.0: Facial behavior analysis toolkit. 13th IEEE Inter-national Conference on Automatic Face and Gesture Recognition IEEE 2018,pp.59-66.

19.Mierswa I, Wurst M, Klinkenberg R, Scholz M, Euler T. Yale: Rapid prototyping for complex data mining tasks. Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM 2006,pp.935-940.

20.Cardillo R, Garcia RB, Mammarella IC, Cornoldi C. Pragmatics of language and theory of mind in children with dyslexia with associated language difficulties or nonverbal learning disabilities. Applied Neuropsychol 2018; 7:245-256.

21.Ryan C, Charragáin CN. Teaching emotion recognition skills to children with autism. J Autism Dev Disord 2010; 40:1505-1511.

22.Eicher JD,Gruen JR. Language impairment and dyslexia genes influence language skills in children with autism spectrum disorders. Autism Res 2015; 8:229-234.

23.Cowell JR, Ayesh A. Extracting subtle facial expression for emotional analysis. IEEE International Conference on Systems, Man and Cybernetics IEEE 2004,pp.677-681.