Brains 'listen' to speech through skin: researchers
Last Updated: Monday, November 30, 2009 | 8:15 AM ET
By John Bowman, CBC News
Related
External Links
(Note: CBC does not endorse and is not responsible for the content of external sites - links will open in new window)
Our brains can be fooled into perceiving one speech sound as a completely different one if the sound is accompanied by an inaudible puff of air, Canadian researchers have found.
The research published this week in Nature suggests that our perception of language isn't made up of only sound and visual data, but tactile information such as airflow as well.
Bryan Gick and Donald Derrick at the University of British Columbia created an experiment where people were made to listen to recorded sounds while puffs of air were simultaneously applied to their hands or necks.
When the inaudible puff of air was applied, the subjects perceived speech sounds that don't normally come with a puff of air in English speech — "ba" and "da" — as different sounds that do — "pa" and "ta."
"'Ba' and 'pa' are only really distinguished by this puff of air, and we're used to hearing that, but we're not so used to feeling it on our skin, because you'd have to be pretty close to somebody to pick that information up," said Gick.
Gick said that because we don't normally feel puffs of air on our skin when we're listening to people, it's interesting that our brain would be fooled by this airflow information.
In a famous illusion known as the McGurk Effect, people can be fooled into thinking they're hearing "da" when they're actually hearing "ba" at the same time as seeing a face mouthing the syllable "ga."
Gick says one theory to explain this illusion is that the brain goes through a lifetime of learning to integrate visual and sound information to perceive speech, so it becomes fooled when that information is mismatched, as in the McGurk Effect.
Gick says his research suggests that this integration of different senses into the perception of speech may not be something that we learn through experience.
"It's much less frequent that you would hear somebody speak and feel these puffs of air on your skin at the same time. The fact that we can get the same kind of illusion with [air puffs] suggests that there might be something different going on," said Gick.
Gick said it's also interesting that our brains can be fooled by a puff of air that most people don't hear and don't realize they produce when they speak.
The research could lead to "possible future directions in audio and telecommunication applications and aids for the hearing impaired," Gick and Derrick wrote in Nature.
Share Tools
Top News Headlines
- Markets gain after Greece approves austerity plan
- World stock markets rise after Greece's parliament approves a new set of austerity measures that were required by international lenders in exchange for an emergency bailout. more »
- Hit and run victim's family fears accused will walk
- The family of a young mother killed in a hit and run is outraged that the case against the alleged driver is among thousands in B.C. at risk of being thrown out because of a huge court backlog. more »
- CBC launches digital music service
- CBC is diving into the world of online music with the goal of providing listeners access to their favourite tunes and a way to discover new artists and connect with fellow music fans. more »
- Market moves: Is it time to start investing in the world yet?
- Investors have always been told that diversification is one of the best ways to reduce the risk associated with a portfolio, but they often aren't told the whole story. more »
Latest Technology & Science News Headlines
- CBC launches digital music service
- CBC is diving into the world of online music with the goal of providing listeners access to their favourite tunes and a way to discover new artists and connect with fellow music fans. more »
- Create-your-own-app product to launch in Moncton
- A Moncton entrepreneur is hoping to revolutionize the way mobile applications are created by launching a new product that allows people to develop their own app within minutes. more »
- Ancient Antarctic lake may harbour microbial life
- If scientists find microbes in a frigid lake 3.2 kilometres beneath the thick ice of Antarctica, it will illustrate once again that somehow life finds a way to survive in the strangest and harshest places, and it will offer hope that life exists beyond Earth. more »
- B.C. killer whale habitat protection ruled a legal duty
- The federal minister of fisheries has no discretion when it comes to protecting the critical habitat of B.C.'s southern resident killer whales, the Federal Court of Appeal has ruled. more »
Bob McDonald's Blog
Glacier Discovery Walk: Will the visitor centre enhance the view? Feb. 10, 2012 3:17 PM Environment minister Peter Kent has announced the construction of a new Glacier Discovery Walk and visitor centre on the Icefields Parkway in Jasper National Park. It raises the issue of how to balance commercial development in our National Parks against the preservation of the last refuges of wilderness.
Quirks & Quarks
- February 11: Inside the Mind of a Neandertal Feb. 10, 2012 4:01 PM Can we get inside the mind of a species that's been dead for 30,000 years? A new book, How to Think Like a Neanderthal, suggests we can. The authors reconstruct a creature like us in many ways, but with important differences.
Latest Features
- Adele wins best album, best record Grammys
- Houston autopsy results withheld by police
- Quebec town 'heartbroken' after killing of woman, sisters
- Pop queen Whitney Houston dies at 48
- Hit and run victim's family fears accused will walk
- Manitoba man dies after falling off moving SUV
- Doors blocked in fatal Manitoba trailer blaze
- Greece passes new austerity deal amid rioting
- Northern lights viewed from space

