Türkçede McGurk İllüzyonu

McGurk illüzyonu İngilizce başta olmak üzere aralarında Almanca, Japonca, İspanyolca ve Çincenin de bulunduğu pek çok dilde işitsel-görsel konuşma algısı çalışmalarında görsel bilgiyi ölçmede bir araç olarak kullanılagelmiştir. Ancak konuşma esnasındaki yüz ve dudak hareketleri ile tanımlayabileceğimiz görsel konuşma bilgisinin nasıl bir rolü olduğu halen pek çok dilde bilinmemektedir. Türkçe de bu dillerden biri olup şu ana kadar konuyla ilgili hakkında neredeyse hiç çalışma yapılmamıştır. Bu öncü çalışmada anadilde (Türkçe) ve yabancı dilde (İngilizce) görsel-işitsel (AV) ve sadece görsel (VO) uyaranlar ile McGurk illüzyonunun Türkçedeki durumu basit bir şekilde irdelenmiştir. Elde edilen bulgular görsel bazı dillerde (İngilizce, Almanca, Macarca, vb.) olduğu gibi Türkçede de görsel bilginin anlamlı bir ölçüde kullanıldığını göstermektedir. Bunun yanı sıra, Türkçe dışında yapılan tüm çalışmalarda da kısmen gözlemlendiği üzere anadili Türkçe olan katılımcıların Türkçe uyaranlara kıyasla yabancı uyaranları gözlemlemelerinde McGurk İllüzyonuna daha kuvvetli bir şekilde rastlanmıştır. Dudak okuma olarak da adlandırabileceğimiz sadece görsel uyaranlarda ise iki uyaran dili arasında herhangi bir farka rastlanmamıştır. Sonuçlar hâlihazırdaki alanyazın ışığında irdelenmiş ve Türkçe ortamına özgü gelecek çalışmalarda test edilmelerinin gerekli olduğu düşünülen hipotezler sunulmuştur.

The McGurk effect has been used as an index of auditory-visual speech integration and explored in a variety of languages such as Japanese, English, German and Spanish. However, most languages still to be remain unchartered territories in auditory-visual speech perception research and Turkish is one of them. In this preliminary study, the status of McGurk effect among native Turkish speakers has been looked at using native (Turkish) and non-native (English) McGurk stimuli as well as visual-only (VO; lipreading) stimuli. Results showed that Turkish speakers give visually based responses above chance levels, i.e., use visual speech information when auditory and visual speech information are in conflict. In addition, similar to previous studies with other languages, Turkish speakers use more visual speech information when they are exposed to non-native speech than when they observe speech stimuli in their native language. No inter-language differences were observed in the lipreading condition. Results are discussed in the light of existing literature and further predictions regarding auditory-visual speech perception in the context of Turkish language are proposed.

___

Bovo, R. Ciorba, A., Prosser, S. ve Martini, A. (2009). The Mc-Gurk phenomenon in Italian listeners. Acta Otorhinolar-yngol Italica, 29, 203-208.

Burnham, D., Lau, S., Tam, H. ve Schoknecht, C. (2001). Vi-sual discrimination of cantonese tone by tonal but non-cantonese speakers, and by non-tonal language speakers. D. Massaro, J. Light ve K. Geraci, (Ed.), Proceedings of the International Conference on Auditory-Visual Speech Processing (AVSP2001) içinde (155-160). Aalborg, Den-mark: ISCA.

Burnham, D., Ciocca, V., Lauw, C. Lau, S. ve Stokes, S. (2000). Perception of visual information for Cantonese tones. M. Barlow, (Ed.), Proceedings of the Eighth Australian In-ternational Conference on Speech Science and Technoogy içinde (86-91). Canberra: Australian Speech Science and Technology Association, Inc.

Burnham, D. ve Dodd, B. (2004) Auditory-visual speech inte-gration by prelinguistic infants: Perception of an emer-gent consonant in the McGurk effect. Developmental Psychobiology, 45, 1-17.

Chen, Y. ve Hazan, V. (2009). Developmental factor and the nonnative speaker effect in auditory-visual speech per-ception. Journal of the Acoustical Society of America, 126, 858-865.

Davis, C. ve Kim, J. (2001). Repeating and remembering for-eign language words: Implications for language teaching systems. Artificial Intelligence Review, 16, 37-47.

Desjardins, R. N. ve Werker, J. F. (2004). Is the integration of heard and seen speech mandatory for infants? Develop-mental Psychobiology, 45, 187-203.

Desjardins, R. N., Rogers, J. ve Werker, J. F. (1997). An explo-ration of why preschoolers perform differently than do adults in audiovisual speech perception tasks. Journal of Experimental Child Psychology, 66, 85-110.

Erdener, V. D. ve Burnham, D. K. (2005). The role of audio-visual speech and orthographic information in nonnative speech production. Language Learning, 55, 191-228.

Erdener, D. ve Burnham, D. (2013). The relationship between auditory-visual speech perception and language-specific speech perception at the onset of reading instruction in english-speaking children. Journal of Experimental Child Psychology, 116, 120-138.

Erdener, D. (2012). Basic to applied research: the benefits of audio-visual speech perception research in teaching for-eign languages. The Language Learning Journal, iFirst,1-9. doi: 10.1080/09571736.2012.724080

Erdener, D. ve Pehlivan, E. B. (hazırlama aşamasında). The awareness of visual speech information in L2 acquisition context: A Turkish sample. Grassegger, H. (1995). McGurk effect in German and Hungar-ian listeners. Proceedings of the International Congress of Phonetics Sciences, Stockholm, 4, 210-213.

Hardison, D. M. (2003). Acquisition of second-language speech: Effects of visual cues, context, and talker vari-ability. Applied Psycholinguistics, 24, 495-522.

Hazan, V., Sennema, A, Faulkner, A. ve Ortega-Llebaria, M. (2006). The use of visual cues in the perception of non-native consonant contrasts. Journal of the Acoustical So-ciety of America, 119, 1740-1751.

Hazan, V., Sennema, A., Iba, M. ve Faulkner, A. (2005). Effect of audiovisual perceptual training on the perception and production of consonants by Japanese learners of Eng-lish. Speech Communication, 47, 360-378.

Kuhl, P. K. ve Meltzoff, A. N. (1982). The bimodal perception of speech in infancy. Science, 218, 1138-1144. Learn NC Editions (2013). Mandarin Chinese I: Tones. 4 Ocak 2013, http://www.learnnc.org/lp/editions/manda-rin1/4480Mc

Gurk, H. ve MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746-748.

Nath, A. ve Beauchamp, M. (2012). A neural basis for inter-individual differences in McGurk effect, a multisensory speech illusion. Neuroimage, 59, 781-787.

Ortega-Llebaria, M., Faulkner, A. ve Hazan, V. (2001). Audito-ry-visual L2 speech perception: effects of visual cues and acoustic-phonetic context for Spanish learners of English. Speech, Hearing and Language: Work in Progress, 13, 39-51.

Plant, G., Gnosspelius, J. ve Levitt, H. (2000). The use of tactile supplements in lipreading Swedish and English: A single-subject study. Journal of Speech and Hearing Research, 43, 172-183.

Reisberg, D., McLean, J. ve Goldfield, A. (1987). Easy to hear but hard to understand: a lip-reading advantage with intact auditory stimuli. B. Dodd ve R. Campbell, (Ed.), Hearing by eye: The psychology of lip-reading içinde (97-114). Hillsdale, NJ: Erlbaum Associates.Rosenblum, L. D., Schmuckler, M. A. ve Johnson, J. A. (1997). The McGurk effect in infants. Perception ve Psychophys-ics, 59(3), 347-357.

Sams, M., Manninen, P., Surakka, V., Helin, P. ve Kättö, R. (1998). McGurk effect in Finnish syllables, isolated words, and words in sentences: Effects of word mean-ing and sentence context. Speech Communication, 26, 75-8-7.

Sekiyama, K. ve Burnham, D. (2008) Impact of language on development of auditory-visual speech perception. De-velopmental Science, 11(2), 306-320.

Sekiyama, K. ve Tohkura, Y. I. (1993). Inter-language differ-ences in the influence of visual cues in speech perception. Journal of Phonetics, 21(4), 427-444.

Sekiyama, K. (1997). Audiovisual speech perception and its inter-language differences. Japanese Journal of Psycho-nomic Science, 15(2), 122-127.

Sumby, W. H. ve Pollack, I. (1954). Visual contribution to speech intelligibility in noise. Journal of the Acoustical Society of America, 26, 212-215.

Wang, Y., Behne, D. ve Jiang, H. (2009). Influence of native language phonetic system on audio-visual speech percep-tion. Journal of Phonetics, 37, 344-356.