Brains 'listen' to speech through skin: researchers
Last Updated: Monday, November 30, 2009 | 8:15 AM ET
By John Bowman, CBC News
Related
External Links
(Note: CBC does not endorse and is not responsible for the content of external sites - links will open in new window)
Our brains can be fooled into perceiving one speech sound as a completely different one if the sound is accompanied by an inaudible puff of air, Canadian researchers have found.
The research published this week in Nature suggests that our perception of language isn't made up of only sound and visual data, but tactile information such as airflow as well.
Bryan Gick and Donald Derrick at the University of British Columbia created an experiment where people were made to listen to recorded sounds while puffs of air were simultaneously applied to their hands or necks.
When the inaudible puff of air was applied, the subjects perceived speech sounds that don't normally come with a puff of air in English speech — "ba" and "da" — as different sounds that do — "pa" and "ta."
"'Ba' and 'pa' are only really distinguished by this puff of air, and we're used to hearing that, but we're not so used to feeling it on our skin, because you'd have to be pretty close to somebody to pick that information up," said Gick.
Gick said that because we don't normally feel puffs of air on our skin when we're listening to people, it's interesting that our brain would be fooled by this airflow information.
In a famous illusion known as the McGurk Effect, people can be fooled into thinking they're hearing "da" when they're actually hearing "ba" at the same time as seeing a face mouthing the syllable "ga."
Gick says one theory to explain this illusion is that the brain goes through a lifetime of learning to integrate visual and sound information to perceive speech, so it becomes fooled when that information is mismatched, as in the McGurk Effect.
Gick says his research suggests that this integration of different senses into the perception of speech may not be something that we learn through experience.
"It's much less frequent that you would hear somebody speak and feel these puffs of air on your skin at the same time. The fact that we can get the same kind of illusion with [air puffs] suggests that there might be something different going on," said Gick.
Gick said it's also interesting that our brains can be fooled by a puff of air that most people don't hear and don't realize they produce when they speak.
The research could lead to "possible future directions in audio and telecommunication applications and aids for the hearing impaired," Gick and Derrick wrote in Nature.
Share Tools
Top News Headlines
- Montreal telemarketers in fraud case still making calls
- CBC News has learned that no government agency has taken legal action to try to stop a Montreal-based telemarketing company accused of defrauding thousands of small businesses. more »
- Dog kills newborn in Alberta community
- A newborn was mauled to death by a family dog in Airdrie, Alta., RCMP say. more »
- Children of immigrants caught between 2 cultures
- By 2016, foreign-born youth and Canadian-born youth from immigrant families will make up a quarter of the country's population, according to predictions by the Canadian Council on Social Development. As their numbers grow, more attention is being paid to their successes and failures. more »
- Bully victim's mother tells of 'suicide box'
- A mother who hired a bodyguard to protect her bullied daughter says the girl had prepared a "suicide box" in case the violence became unbearable. more »
Latest Technology & Science News Headlines
- Online surveillance bill could change, Harper signals
- The government says it's open to amending its bill that would give police and intelligence agencies new powers to access Canadians' electronic communications and get telecommunications subscriber data. more »
- Canada helps target pollution in developing world
- Soot and methane pollution in the developing world are being targeted by a new coalition of six countries, including Canada. more »
- Smashing stereotypes around women and gaming
- The misconception that video games are not for girls is nothing new, but more and more developers, games reviewers and other pivotal figures in the industry are getting behind the effort to counter it. more »
- Swiss satellite will clean up space junk
- Swiss scientists plan to launch a "janitor satellite" specially designed to get rid of space junk, the orbiting debris that can seriously damage satellites and manned space ships. more »
Bob McDonald's Blog
Glacier Discovery Walk: Will the visitor centre enhance the view? Feb. 14, 2012 9:22 AM Environment minister Peter Kent has announced the construction of a new Glacier Discovery Walk and visitor centre on the Icefields Parkway in Jasper National Park. It raises the issue of how to balance commercial development in our National Parks against the preservation of the last refuges of wilderness.
Quirks & Quarks
- February 18: Guitar Hero, or Guitar Zero? Feb. 15, 2012 10:53 AM An NYU professor of psychology describes how he was able to learn to play the guitar in midlife in spite of a limited musical aptitude, and what it tells us about how our brains learn.
Latest Features
- Montreal telemarketers in fraud case still making calls
- Refugee reforms include fingerprints, no appeals for some
- Honduras prison fire is world's deadliest
- Nortel collapse linked to Chinese hackers
- Barefoot girl's icy trek not blamed on babysitter
- Drummond report on Ontario calls for cutbacks
- B.C. house party trial hears from tearful teens
- Bully victim's mother tells of 'suicide box'
- 2 NDP MPs back final Commons vote to kill gun registry

