Home » Amazing World » The McGurk effect: when we hear with our eyes

The McGurk effect: when we hear with our eyes

Sometimes, when we can’t hear a person clearly, we look at their mouth. However, when trying to “hear with our eyes” and read their lips, we sometimes make small mistakes. It’s the McGurk effect.

We have all seen a poorly dubbed movie in which we read his lips to know what the actor is saying. Suddenly, we find ourselves “listening with our eyes”, that is, we are deciphering sounds through another channel that is not auditory. This phenomenon in which there is a mismatch between sound and visual signals is known as the McGurk effect.

Although this experience sometimes leads us to make some mistakes that we will analyze below, it also emerges as a very efficient brain strategy. For example, we may be at a party with the music very loud and when trying to have a conversation with someone, what we do is look at their mouth to try to “read” their words.

There is something important that this effect shows us. People do not use each of our senses separately. In reality, every perceptual experience happens as a result of the interaction of more than one sense. Sight and hearing work together, so although sometimes there may be small errors, they are our best allies…

People with Alzheimer’s disease frequently experience alterations in the McGurk effect: they cannot identify sounds and words visually.

What is the McGurk effect?

Much of our communication processes occur in situations where we can hear each other clearly. However, in recent times Due to the increase in video calls, we are experiencing the McGurk effect more frequently.

Read Also:  Daughters of narcissistic mothers: the link between selfishness and coldness

Sometimes, due to poor connections, we do not hear the other person well and then we go from the auditory channel to the visual channel to try to read lips, but it is not easy at all. Sometimes, even having the person’s face and mouth as a reference, we make mistakes.

This fact was studied in the 70s by cognitive psychologists Harry McGurk and John MacDonald. It was following research work in 1976 when this term was first coined in the article Hearing Lips and Seeing Voices.

They did it after verifying something very specific in a famous experiment. A fact that has been demonstrated for decades and that never fails. If someone moves their lips pronouncing the syllable “ga”, but at the same time out loud what they say is “ba”, the brain will hear “da”. That is to say, Sometimes, what the eyes read is not the same as what the ear perceives.

Why does the McGurk effect occur?

We already know that the McGurk effect happens when we try to “read” with our eyes and what we see (lip movement) does not match the real sound. Well, it’s interesting to note that The brain region where this phenomenon occurs is in the superior temporal sulcus. When trying to decode two sensory modalities (sight and sound) it is common for errors to appear.

Now, from the Department of Neurosurgery at the Houston College of Medicine (Texas) they point out something important in a study: When we have a face-to-face conversation, the brain listens through ears and also deciphers words with sight. We do it unconsciously.

Read Also:  The 10 ethical commitments, according to the Buddhist tradition

Paying attention to the movement of the lips allows us to reinforce communication in case any difficulty appears, like environmental noise. However, there are sounds and syllables that are interpreted incorrectly. Small inferences, small errors occur.

There are people who suffer from this experience to a greater degree.

We pointed it out at the beginning. People with Alzheimer’s disease suffer intensely from the McGurk effect. If at any time they have to read lips to understand a message, they will not be able to decipher it.

Research works such as those carried out by Delbeuck, Collette and Van der Linden, 2007) indicate that the cause may lie in the deterioration of brain connectivity.

In addition, It has also been seen that children with expressive language disorder do not pay attention to the articulation of words, they do not use the visual channel to imitate or understand what is expressed to them. This hinders the development of the language itself.

The visual system helps us discriminate sounds

The McGurk effect appears when we read other people’s lips and confuse some syllables or words. It is something completely normal that demonstrates something interesting. Human beings always use the visual system during communication. It is not something that people with hearing impairments resort to exclusively.

The brain needs to ensure that the communication process is carried out effectively. To do this, we not only limit ourselves to listening, to making use of the sense of hearing: we also use our sight.

Looking at our interlocutor’s mouth facilitates understanding in any context, hence the importance of face-to-face conversations. Reading with our eyes is one more skill we can be proud of.

You might be interested…

Read Also:  Much of what you attract is much of what you transmit

All cited sources were reviewed in depth by our team to ensure their quality, reliability, validity and validity. The bibliography in this article was considered reliable and of academic or scientific accuracy.

Alsius, A., Navarra, J., & Soto-Faraco, S. (2007). Attention to touch weakens audiovisual speech integration. Experimental Brain Research, 183(3), 399-404.Baynes, K., Funnell, MG, & Fowler, CA (1994). Hemispheric contributions to the integration of visual and auditory information in speech perception. Perception & Psychophysics, 55(6), 633-641. Delbeuck, X., Collette, F., & Van der Linden, M. (2007). Is Alzheimer’s disease a disconnection syndrome?: Evidence from a crossmodal audio-visual illusory experiment. Neuropsychology, Four. Five(14), 3315-3323.Tiippana K. (2014). What is the McGurk effect? Frontiers in psychology, 5, 725. https://doi.org/10.3389/fpsyg.2014.00725McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264(5588), 746-748.Nath, AR, & Beauchamp, MS (2012). A neural basis for interindividual differences in the McGurk effect, a multisensory speech illusion. Neuroimaging, 59(1), 781-787.

Are You Ready to Discover Your Twin Flame?

Answer just a few simple questions and Psychic Jane will draw a picture of your twin flame in breathtaking detail:

Leave a Reply

Your email address will not be published. Los campos marcados con un asterisco son obligatorios *

*

This site uses Akismet to reduce spam. Learn how your comment data is processed.