Hearing lips and seeing voices: The science of the McGurk Effect

Описание: Spoken language is all about sound, right? Maybe not!

Our brains make use of every bit of information available to figure out what we’re experiencing, but this process can cause us to experience some trippy illusions.

Let’s explore the McGurk effect - the visual/auditory illusion where what you see rewrites what you hear!

If you're interested in perception, check out the Perception Census project! You can contribute to the largest study on perceptual diversity in the world! https://perceptioncensus.dreamachine....

--------------------------------------

0:00 – Intro
1:10 – The McGurk effect
2:06 – Timing
3:19 – McGurk on the brain
5:53 – Can you McGurk a baby?
7:48 – Tactile McGurk
9:19 – Why do we get McGurked?
10:11 – Outro


Sources:
McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. https://doi.org/10.1038/264746a0
Van Wassenhove, Grant & Poeppel (2007). Temporal window of integration in auditory-visual speech perception. https://doi.org/10.1016/j.neuropsycho...
Colin, Radeau, Soquet, Demolin, Colin & Deltenre (2002). Mismatch negativity evoked by the McGurk–MacDonald effect: a phonetic representation within short-term memory. https://doi.org/10.1016/S1388-2457(02...
Kislyuk, Möttönen & Sams (2008). Visual processing affects the neural basis of auditory discrimination. https://doi.org/10.1162/jocn.2008.20152
Rosenblum, Schmuckler & Johnson (1997). The McGurk effect in infants. https://doi.org/10.3758/BF03211902
Burnham & Dodd (2004). Auditory–visual speech integration by prelinguistic infants: perception of an emergent consonant in the McGurk effect. https://doi.org/10.1002/dev.20032
Fowler & Dekle (1991). Listening with eye and hand: cross-modal contributions to speech perception. https://doi.org/10.1037/0096-1523.17....