İnsansı robot ile bazı Türkçe işaret dili ifadelerinin gerçekleştirilmesi

Dünya genelinde 466 milyon Türkiye’de ise yaklaşık 1.5 milyon işitme ve konuşma engelli bireyin kendi aralarında ve diğer bireyler ile iletişimlerini sağlamak için kullandıkları dil işaret dilidir. El, yüz ve vücut mimikleri ile gerçekleştirilen bu dil, ülkeden ülkeye ve konuşulduğu ülkelerde ise bölgeden bölgeye değişiklik gösterebilen dinamik bir dildir. Bireyin daha küçük yaşta işaret dili öğrenmesi, bireyin hem bilişsel ve entelektüel gelişimi hem de akademik gelişimi açısından önemli olması bu dilin önemini gözler önüne sermektedir. Bu nedenle işaret dili öğrenimi konusunda teknolojinin kullanılmasına dönük geliştirilen bir dizi çalışma bulunmaktadır. Geliştirilen insansı robotların işaret dili öğreniminde başarılı bir şekilde icra edildiği kanıtlandı. Ülkemizde işaret dili öğrenimi üzerine geliştirilen herhangi bir insansı robotun bulunmaması ve bu alanda yapılan güncel çalışmaların literatürde yer edinmesi üzerine Türkçe İşaret Dili ifadelerini gerçekleştiren insansı robot çalışması yapıldı. Çalışma kapsamında insansı robotun geliştirme aşamaları detaylı bir şekilde tartışılmaktadır.

Anahtar Kelimeler:

İnsan-robot etkileşimi, İnsansı robot, İşaret dili, Derin öğrenme

Realization of some Turkish sign language expressions with humanoid robot

There are about 466 million hearing and speech disabilities people in the world, and there are about 1.5 million hearing and speech disabilities people in Turkey, the sign language is the language that used by hearing and speech impaired individuals to communicate among themselves and with other individuals. This language, realized with hand, face and body gestures, is a dynamic language that can vary from country to country and from region to region in the countries where it is spoken. Learning of sing language at younger age is important especially in terms of both cognitive and intellectual development and academic development of the individual. For this reason, there are a number of studies developed for the use of technology in sign language learning. It has been proven that the developed humanoid robots are successfully performed in sign language learning. Since there is no humanoid robot developed for sign language learning in our country and current studies in this field have taken place in the literature, a humanoid robot study that performs Turkish Sign Language expressions was conducted. Within the scope of the study, the development stages of the humanoid robot are discussed in detail.

Keywords:

Human-robot interaction, Humanoid robot, Sign language, Deep learning,

PDF

___

[1] Ishiguro, H. Ono, T. Imai, M. Maeda, T. Kanda, T. Nakatsu, R. Robovie: An Interactive Humanoid Robot. Ind. Rob. 28 (6), 498–504. 2001
[2] Han, J. Kim, D. R-Learning Services for Elementary School Students with a Teaching Assistant Robot. In Proceedings of the 4th ACM/IEEE international conference on Human robot interaction - HRI ’09; ACM Press: New York, New York, USA, 2009.
[3] Dünya Sağlık Örgütü https://www.who.int/deafness/estimates/en/ (Erişim tarihi: 21/03/2021)
[4] Türkiye Cumhuriyeti Aile, Çalışma ve Sosyal Hizmetler Bakanlığı, Engelli ve Yaşlı İstatistik Bülteni, 2020 Mart, https://www.ailevecalisma.gov.tr/media/42250/istatistik-bulteni-2020-mart.pdf (Erişim tarihi: 01/09/2020)
[5] Courtin, C. The Impact of Sign Language on the Cognitive Development of Deaf Children: The Case of Theories of Mind. J. Deaf Stud. Deaf Educ. 5 (3), 266–276. 2000
[6] How Deaf Children Learn: What Parents and Teachers Need to Know. Choice (Middletown) 49 (11), 49-6411-49–6411. 2012
[7] Freel, B. L. Clark, M. D. Anderson, M. L. Gilbert, G. L. Musyoka, M. M. Hauser, P. C. Deaf Individuals’ Bilingual Abilities: American Sign Language Proficiency, Reading Skills, and Family Characteristics. Psychology (Irvine) 02 (01), 18–23. 2011
[8] Mayberry, R. I. Cognitive development in deaf children: The interface of language and perception in neuropsychology. Handbook of neuropsychology, 8(Part II), 71-107. 2002
[9] Besio, S. Dini, S. Ferrari, E. & Robins, B. Critical factors involved in using interactive robots for play activities of children with disabilities. In 9th European Conference for Advancement of Assistive Technology in Europe, San Sebastian, Spain, (Vol. 20, pp. 505-509). IOS Press. 2007
[10] Janssen, J. B. van der Wal, C. C. Neerincx, M. A. Looije, R. Motivating Children to Learn Arithmetic with an Adaptive Robot Game. In Social Robotics; Springer Berlin Heidelberg: Berlin, Heidelberg, 2011; pp 153–162.
[11] Nalin, M. Baroni, I. Kruijff-Korbayova, I. Canamero, L. Lewis, M. Beck, A. Cuayahuitl, H. Sanna, A. Children’s Adaptation in Multi-Session Interaction with a Humanoid Robot. In 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication; IEEE, 2012.
[12] Baranwal N, Singh A.K., Nandi G.C. Development of a Framework for Human–Robot interactions with Indian Sign Language Using Possibility Theory, Int J of Soc Robotics doi:10.1007/s12369-017-0412-0. 2017
[13] Gago J.J., Victores J.G., Balaguer C., Sign Language Representation by TEO Humanoid Robot: End-User Interest, Comprehension and Satisfaction, Electronics, 8, 57; doi:10.3390/electronics8010057. 2019
[14] Al-Khulaidi R.A., Akmeliawati R, Azlan N.Z., Bakr N.H.A, Fauzi N.M. Development of robotic hands of signbot, advanced Malaysian sign-language performing robot, Advances in Robotics Research, Vol. 2, No. 3. 183-199 DOI: https://doi.org/10.12989/arr.2018.2.3.183. 2018
[15] Meghdari A, Alemi M, Zakipour M, Kashanian S.A. Design and Realization of a Sign Language Educational Humanoid Robot, Journal of Intelligent & Robotic Systems. 95:3–17. 2019
[16] Kose H, Akalin N, Uluer P. Socially Interactive Robotic Platforms as Sign Language Tutors, International Journal of Humanoid Robotics Vol. 11, No. 1 (2014) 1450003, doi: 10.1142/S0219843614500030. 2014
[17] Köse H, Uluer P, Akalın N, Yorgancı R, Özkul A, Ince G. The Effect of Embodiment in Sign Language Tutoring with Assistive Humanoid Robots, Int J of Soc Robotics (2015) 7:537–548, doi: 10.1007/s12369-015-0311-1. 2015
[18] Gürpınar C, UluerP, Akalın N, Köse H. Sign Recognition System for an Assistive Robot Sign Tutor for Children, International Journal of Social Robotics, https://doi.org/10.1007/s12369-019-00609-9. 2019
[19] National Geographic https://www.nationalgeographic.com/history/magazine/2020/07-08/ismail-al-jazari-muslim-inventor-called-father-robotics/ (Erişim tarihi: 19/01/2021)
[20] Woods, S. Exploring the design space of robots: children’s perspectives. Interact. Comput. 18(6), 1390–1418. 2006
[21] Valli, C., Lucas, C. Linguistics of American Sign Language: An Introduction. Gallaudet University Press, Washington DC. 2000
[22] Thingiverse açık kaynak model web sayfası https://www.thingiverse.com/thing:2269115 (Erişim tarihi: 01/03/2020)
[23] Hirose, S., Umetani, Y.: The development of soft gripper for the versatile robot hand. Mech. Mach. Theory 13(3), 351–359. 1978
[24] SG90 mini servo motor datasheet https://www.electronicoscaldas.com/datasheet/SG90_Tower-Pro.pdf (Erişim tarihi: 01/12/2020)
[25] MG996R servo motor datasheet https://www.electronicoscaldas.com/datasheet/MG996R_Tower-Pro.pdf (Erişim tarihi: 01/12/2020)
[26] LX5560 servo motor http://www.lxrcmodel.com/details.asp?prodid=3506&classId= (Erişim tarihi: 01/12/2020)
[27] WER algorithm, https://martin-thoma.com/word-error-rate-calculation/ (Erişim tarihi: 22/01/2021)
[28] Këpuska V, Bohouta G. Comparing Speech Recognition Systems (Microsoft API, Google API And CMU Sphinx), Veton Këpuska. Int. Journal of Engineering Research and Application, ISSN : 2248-9622, Vol. 7, Issue 3, ( Part -2), pp.20-24. 2017
[29] J.E. Aguilar-Chacon, D.A. Segura-Torres. Evaluation methodology for Speech To Text Services similarity and speed characteristics focused on small size computers, IOP Conf. Series: Materials Science and Engineering 844. 012039, doi:10.1088/1757-899X/844/1/012039. 2020
[30] Jerri, A.J. The shannon sampling theoremits various extensions and applications: A tutorial review. Proceedings of the IEEE 65(11), 1565–1596. 1977
[31] Westphal, M.: The use of cepstral means in conversational speech recognition. In: EUROSPEECH. 1997
[32] Rainer E. Gruhn, W.M., Nakamura, S. Statistical pronunciation modeling for non-native speech processing. In: Springer Science and Business Media. 2011
[33] Tanigaki, K., Yamamoto, H., Sagisaka, Y. A hierarchical language model incorporating class-dependent word models for oov words recognition. In: INTERSPEECH. 2000
[34] Soudamalla S.K, Implications of Conversational AI on Humanoid Robots, site: https://nbn-resolving.org/urn:nbn:de:bsz:ch1-qucosa2-724268